[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:00:14.791188   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37183
I20260709 13:00:14.793303   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:00:14.794664   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:14.818403   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:14.818898   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:14.821300   431 server_base.cc:1061] running on GCE node
W20260709 13:00:14.819726   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:16.118459   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:16.118829   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:16.119131   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602016119097 us; error 0 us; skew 500 ppm
I20260709 13:00:16.120404   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:16.126928   431 webserver.cc:533] Webserver started at http://127.0.107.254:42269/ using document root <none> and password file <none>
I20260709 13:00:16.127907   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:16.128221   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:16.128767   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:16.136547   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/master-0-root/instance:
uuid: "813fe3d24de34cf99ce8e633903e694c"
format_stamp: "Formatted at 2026-07-09 13:00:16 on dist-test-slave-smzk"
I20260709 13:00:16.146674   431 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:00:16.152916   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:16.154520   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:00:16.154991   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/master-0-root
uuid: "813fe3d24de34cf99ce8e633903e694c"
format_stamp: "Formatted at 2026-07-09 13:00:16 on dist-test-slave-smzk"
I20260709 13:00:16.155335   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:16.213317   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:16.215096   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:00:16.216106   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:16.326292   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37183
I20260709 13:00:16.326380   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37183 every 8 connection(s)
I20260709 13:00:16.336225   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:16.360805   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c: Bootstrap starting.
I20260709 13:00:16.367517   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:16.369601   498 log.cc:826] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c: Log is configured to *not* fsync() on all Append() calls
I20260709 13:00:16.375460   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c: No bootstrap required, opened a new log
I20260709 13:00:16.398046   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813fe3d24de34cf99ce8e633903e694c" member_type: VOTER }
I20260709 13:00:16.398635   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:16.398939   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 813fe3d24de34cf99ce8e633903e694c, State: Initialized, Role: FOLLOWER
I20260709 13:00:16.400082   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813fe3d24de34cf99ce8e633903e694c" member_type: VOTER }
I20260709 13:00:16.400697   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:16.401151   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:16.401604   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:16.406633   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813fe3d24de34cf99ce8e633903e694c" member_type: VOTER }
I20260709 13:00:16.407506   498 leader_election.cc:304] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 813fe3d24de34cf99ce8e633903e694c; no voters: 
I20260709 13:00:16.409399   498 leader_election.cc:290] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:16.409933   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:16.414608   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 1 LEADER]: Becoming Leader. State: Replica: 813fe3d24de34cf99ce8e633903e694c, State: Running, Role: LEADER
I20260709 13:00:16.415750   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:16.415593   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813fe3d24de34cf99ce8e633903e694c" member_type: VOTER }
I20260709 13:00:16.432966   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "813fe3d24de34cf99ce8e633903e694c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813fe3d24de34cf99ce8e633903e694c" member_type: VOTER } }
I20260709 13:00:16.434346   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:16.433393   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 813fe3d24de34cf99ce8e633903e694c. Latest consensus state: current_term: 1 leader_uuid: "813fe3d24de34cf99ce8e633903e694c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813fe3d24de34cf99ce8e633903e694c" member_type: VOTER } }
I20260709 13:00:16.435845   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:16.439900   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:16.455509   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:16.458297   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:16.477504   511 catalog_manager.cc:1383] Generated new cluster ID: c34ecee5da7b4a8c95be90147f029506
I20260709 13:00:16.477828   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:16.504565   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:16.507151   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:16.525038   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c: Generated new TSK 0
I20260709 13:00:16.526211   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:16.589988   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:16.601850   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:16.604003   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:16.610754   431 server_base.cc:1061] running on GCE node
W20260709 13:00:16.611968   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:16.613981   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:16.614307   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:16.614554   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602016614533 us; error 0 us; skew 500 ppm
I20260709 13:00:16.615492   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:16.622102   431 webserver.cc:533] Webserver started at http://127.0.107.193:33359/ using document root <none> and password file <none>
I20260709 13:00:16.622956   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:16.623234   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:16.623656   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:16.625412   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-0-root/instance:
uuid: "99dcb9201d674f379f38b6b609a29f55"
format_stamp: "Formatted at 2026-07-09 13:00:16 on dist-test-slave-smzk"
I20260709 13:00:16.634053   431 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:00:16.641568   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:16.643005   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:00:16.643455   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "99dcb9201d674f379f38b6b609a29f55"
format_stamp: "Formatted at 2026-07-09 13:00:16 on dist-test-slave-smzk"
I20260709 13:00:16.643882   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:16.674206   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:16.676405   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:16.679647   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:16.686458   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:16.686836   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:16.687202   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:16.687469   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:16.811101   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:37427
I20260709 13:00:16.811184   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:37427 every 8 connection(s)
I20260709 13:00:16.823583   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:16.837620   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:16.840286   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:16.848212   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:16.853735   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37183
I20260709 13:00:16.854350   591 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:16.854470   431 server_base.cc:1061] running on GCE node
I20260709 13:00:16.855949   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:16.856091   591 heartbeater.cc:507] Master 127.0.107.254:37183 requested a full tablet report, sending...
W20260709 13:00:16.856410   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:16.856693   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602016856666 us; error 0 us; skew 500 ppm
I20260709 13:00:16.857667   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:16.861231   463 ts_manager.cc:194] Registered new tserver with Master: 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427)
I20260709 13:00:16.861545   431 webserver.cc:533] Webserver started at http://127.0.107.194:44743/ using document root <none> and password file <none>
I20260709 13:00:16.862143   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:16.862336   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:16.862600   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:16.863927   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-1-root/instance:
uuid: "8c8221909dbb46d2a6f41f14a753c598"
format_stamp: "Formatted at 2026-07-09 13:00:16 on dist-test-slave-smzk"
I20260709 13:00:16.865053   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56268
I20260709 13:00:16.871814   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:16.877449   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:16.878579   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:00:16.878913   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-1-root
uuid: "8c8221909dbb46d2a6f41f14a753c598"
format_stamp: "Formatted at 2026-07-09 13:00:16 on dist-test-slave-smzk"
I20260709 13:00:16.879217   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:16.898331   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:16.899822   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:16.902782   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:16.907012   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:16.907224   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:16.907574   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:16.907718   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:17.043737   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41545
I20260709 13:00:17.043870   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41545 every 8 connection(s)
I20260709 13:00:17.053458   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:17.065025   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:17.067926   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:17.072837   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37183
I20260709 13:00:17.073503   666 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:17.074733   666 heartbeater.cc:507] Master 127.0.107.254:37183 requested a full tablet report, sending...
I20260709 13:00:17.078455   463 ts_manager.cc:194] Registered new tserver with Master: 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:17.079339   431 server_base.cc:1061] running on GCE node
I20260709 13:00:17.080351   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56272
W20260709 13:00:17.081130   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:17.082389   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:17.082664   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:17.082872   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602017082856 us; error 0 us; skew 500 ppm
I20260709 13:00:17.083633   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:17.086938   431 webserver.cc:533] Webserver started at http://127.0.107.195:38409/ using document root <none> and password file <none>
I20260709 13:00:17.087585   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:17.087834   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:17.088192   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:17.089620   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-2-root/instance:
uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
format_stamp: "Formatted at 2026-07-09 13:00:17 on dist-test-slave-smzk"
I20260709 13:00:17.096010   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:00:17.100857   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:17.101840   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:00:17.102234   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-2-root
uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
format_stamp: "Formatted at 2026-07-09 13:00:17 on dist-test-slave-smzk"
I20260709 13:00:17.102609   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602014598663-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:17.135820   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:17.137557   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:17.139813   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:17.144613   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:17.144930   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:17.145259   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:17.145509   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:17.262590   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:40863
I20260709 13:00:17.262749   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:40863 every 8 connection(s)
I20260709 13:00:17.284729   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37183
I20260709 13:00:17.285239   740 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:17.286187   740 heartbeater.cc:507] Master 127.0.107.254:37183 requested a full tablet report, sending...
I20260709 13:00:17.288682   463 ts_manager.cc:194] Registered new tserver with Master: df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:17.288852   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020082254s
I20260709 13:00:17.291595   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56288
I20260709 13:00:17.356998   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56294:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:17.361006   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:00:17.449492   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:17.497920   704 tablet_service.cc:1511] Processing CreateTablet for tablet 965be54504314193800a99ead8d7b03f (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:17.499970   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965be54504314193800a99ead8d7b03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.509274   700 tablet_service.cc:1511] Processing CreateTablet for tablet 329a9841909f468280996643aacf35c4 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:17.502710   705 tablet_service.cc:1511] Processing CreateTablet for tablet 2c19b75e67f84497b4a6138358b330c1 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:17.506152   702 tablet_service.cc:1511] Processing CreateTablet for tablet e9de7ac0ccfc4e56aa9dcc6bb8cc609e (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:17.507858   701 tablet_service.cc:1511] Processing CreateTablet for tablet 57dee02a511d4ec69224adb44434a8a7 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:17.503875   703 tablet_service.cc:1511] Processing CreateTablet for tablet f09acacbb8b04b15adeec003aad88887 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:17.515666   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329a9841909f468280996643aacf35c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.520798   699 tablet_service.cc:1511] Processing CreateTablet for tablet acc725db50024889bc0a60626d1fd6e5 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:17.522976   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c19b75e67f84497b4a6138358b330c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.530579   556 tablet_service.cc:1511] Processing CreateTablet for tablet 2c19b75e67f84497b4a6138358b330c1 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:17.535971   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c19b75e67f84497b4a6138358b330c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.536901   555 tablet_service.cc:1511] Processing CreateTablet for tablet 965be54504314193800a99ead8d7b03f (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:17.539369   554 tablet_service.cc:1511] Processing CreateTablet for tablet f09acacbb8b04b15adeec003aad88887 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:17.550469   553 tablet_service.cc:1511] Processing CreateTablet for tablet e9de7ac0ccfc4e56aa9dcc6bb8cc609e (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:17.551367   552 tablet_service.cc:1511] Processing CreateTablet for tablet 57dee02a511d4ec69224adb44434a8a7 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:17.541877   698 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfea1b8377642998710874f9f020f08 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:17.554673   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965be54504314193800a99ead8d7b03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.586910   551 tablet_service.cc:1511] Processing CreateTablet for tablet 329a9841909f468280996643aacf35c4 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:17.590126   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9de7ac0ccfc4e56aa9dcc6bb8cc609e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.596401   550 tablet_service.cc:1511] Processing CreateTablet for tablet acc725db50024889bc0a60626d1fd6e5 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:17.590660   628 tablet_service.cc:1511] Processing CreateTablet for tablet e9de7ac0ccfc4e56aa9dcc6bb8cc609e (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:00:17.612388   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09acacbb8b04b15adeec003aad88887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.613725   629 tablet_service.cc:1511] Processing CreateTablet for tablet f09acacbb8b04b15adeec003aad88887 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:00:17.611148   630 tablet_service.cc:1511] Processing CreateTablet for tablet 965be54504314193800a99ead8d7b03f (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:00:17.620362   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9de7ac0ccfc4e56aa9dcc6bb8cc609e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.611294   631 tablet_service.cc:1511] Processing CreateTablet for tablet 2c19b75e67f84497b4a6138358b330c1 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:00:17.617142   626 tablet_service.cc:1511] Processing CreateTablet for tablet 329a9841909f468280996643aacf35c4 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:00:17.626235   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09acacbb8b04b15adeec003aad88887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.620373   549 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfea1b8377642998710874f9f020f08 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:17.625017   624 tablet_service.cc:1511] Processing CreateTablet for tablet 0cfea1b8377642998710874f9f020f08 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:00:17.624946   548 tablet_service.cc:1511] Processing CreateTablet for tablet 5f58d697b30c4a80aa5eb3a51c6e1fbd (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:17.639667   627 tablet_service.cc:1511] Processing CreateTablet for tablet 57dee02a511d4ec69224adb44434a8a7 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:00:17.613765   625 tablet_service.cc:1511] Processing CreateTablet for tablet acc725db50024889bc0a60626d1fd6e5 (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:00:17.634251   697 tablet_service.cc:1511] Processing CreateTablet for tablet 5f58d697b30c4a80aa5eb3a51c6e1fbd (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:17.643728   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9de7ac0ccfc4e56aa9dcc6bb8cc609e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.646129   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09acacbb8b04b15adeec003aad88887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.647564   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965be54504314193800a99ead8d7b03f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.647554   623 tablet_service.cc:1511] Processing CreateTablet for tablet 5f58d697b30c4a80aa5eb3a51c6e1fbd (DEFAULT_TABLE table=test-workload [id=ec99419d920d4ee2858985cb6a112672]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:00:17.652488   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc725db50024889bc0a60626d1fd6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.645737   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dee02a511d4ec69224adb44434a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.660401   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfea1b8377642998710874f9f020f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.664883   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329a9841909f468280996643aacf35c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.676250   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfea1b8377642998710874f9f020f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.680933   758 tablet_bootstrap.cc:492] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
I20260709 13:00:17.680806   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f58d697b30c4a80aa5eb3a51c6e1fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.689495   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329a9841909f468280996643aacf35c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.687139   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f58d697b30c4a80aa5eb3a51c6e1fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.711205   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dee02a511d4ec69224adb44434a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.719292   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0cfea1b8377642998710874f9f020f08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.721308   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57dee02a511d4ec69224adb44434a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.726402   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f58d697b30c4a80aa5eb3a51c6e1fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.733208   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc725db50024889bc0a60626d1fd6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.766563   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc725db50024889bc0a60626d1fd6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.802768   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c19b75e67f84497b4a6138358b330c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:17.874089   591 heartbeater.cc:499] Master 127.0.107.254:37183 was elected leader, sending a full tablet report...
I20260709 13:00:17.937173   758 tablet_bootstrap.cc:654] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:17.952203   759 tablet_bootstrap.cc:492] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:17.971244   760 tablet_bootstrap.cc:492] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:17.989236   758 tablet_bootstrap.cc:492] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:17.989809   758 ts_tablet_manager.cc:1403] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.329s	user 0.014s	sys 0.021s
I20260709 13:00:18.006469   759 tablet_bootstrap.cc:654] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.038821   758 raft_consensus.cc:359] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.042385   758 raft_consensus.cc:385] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.043047   760 tablet_bootstrap.cc:654] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.042826   758 raft_consensus.cc:740] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.044013   758 consensus_queue.cc:260] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.060840   758 ts_tablet_manager.cc:1434] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.060s	user 0.014s	sys 0.012s
I20260709 13:00:18.061345   762 raft_consensus.cc:493] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.061359   740 heartbeater.cc:499] Master 127.0.107.254:37183 was elected leader, sending a full tablet report...
I20260709 13:00:18.062618   760 tablet_bootstrap.cc:492] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.062654   758 tablet_bootstrap.cc:492] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
I20260709 13:00:18.063335   760 ts_tablet_manager.cc:1403] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.000s
I20260709 13:00:18.062402   762 raft_consensus.cc:515] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.067625   760 raft_consensus.cc:359] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.070139   758 tablet_bootstrap.cc:654] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.072014   759 tablet_bootstrap.cc:492] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.072588   759 ts_tablet_manager.cc:1403] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.149s	user 0.027s	sys 0.020s
I20260709 13:00:18.077064   759 raft_consensus.cc:359] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.077833   759 raft_consensus.cc:385] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.078136   759 raft_consensus.cc:740] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.079047   759 consensus_queue.cc:260] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.070204   760 raft_consensus.cc:385] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.080437   760 raft_consensus.cc:740] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.081918   760 consensus_queue.cc:260] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.083585   666 heartbeater.cc:499] Master 127.0.107.254:37183 was elected leader, sending a full tablet report...
I20260709 13:00:18.083568   758 tablet_bootstrap.cc:492] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:18.084595   758 ts_tablet_manager.cc:1403] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.006s
I20260709 13:00:18.088223   758 raft_consensus.cc:359] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.089144   758 raft_consensus.cc:385] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.089493   758 raft_consensus.cc:740] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.090402   762 leader_election.cc:290] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.092682   760 ts_tablet_manager.cc:1434] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.011s
I20260709 13:00:18.093716   760 tablet_bootstrap.cc:492] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:18.091063   758 consensus_queue.cc:260] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.096900   758 ts_tablet_manager.cc:1434] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:00:18.097976   758 tablet_bootstrap.cc:492] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
I20260709 13:00:18.099356   759 ts_tablet_manager.cc:1434] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:00:18.100770   759 tablet_bootstrap.cc:492] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:18.105422   758 tablet_bootstrap.cc:654] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.127583   760 tablet_bootstrap.cc:654] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.134914   759 tablet_bootstrap.cc:654] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.181190   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965be54504314193800a99ead8d7b03f" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.181596   758 tablet_bootstrap.cc:492] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:18.182386   641 raft_consensus.cc:2468] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 0.
I20260709 13:00:18.183977   758 ts_tablet_manager.cc:1403] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.024s
I20260709 13:00:18.185842   680 leader_election.cc:304] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.186959   762 raft_consensus.cc:2804] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.187371   762 raft_consensus.cc:493] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.187179   758 raft_consensus.cc:359] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.188017   762 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.188206   758 raft_consensus.cc:385] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.188525   758 raft_consensus.cc:740] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.190299   758 consensus_queue.cc:260] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.192783   758 ts_tablet_manager.cc:1434] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:18.193786   758 tablet_bootstrap.cc:492] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
I20260709 13:00:18.198962   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965be54504314193800a99ead8d7b03f" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55" is_pre_election: true
I20260709 13:00:18.200157   566 raft_consensus.cc:2468] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 0.
I20260709 13:00:18.201722   760 tablet_bootstrap.cc:492] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.203135   760 ts_tablet_manager.cc:1403] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.110s	user 0.021s	sys 0.004s
I20260709 13:00:18.206547   760 raft_consensus.cc:359] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.207407   760 raft_consensus.cc:385] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.207767   760 raft_consensus.cc:740] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.209345   760 consensus_queue.cc:260] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.211236   762 raft_consensus.cc:515] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.216362   758 tablet_bootstrap.cc:654] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.217886   760 ts_tablet_manager.cc:1434] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:00:18.219116   760 tablet_bootstrap.cc:492] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:18.227550   760 tablet_bootstrap.cc:654] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.231310   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965be54504314193800a99ead8d7b03f" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:18.232142   566 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.234514   759 tablet_bootstrap.cc:492] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.235028   759 ts_tablet_manager.cc:1403] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.032s
I20260709 13:00:18.239415   762 leader_election.cc:290] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.241375   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965be54504314193800a99ead8d7b03f" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:18.242069   641 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.243897   762 raft_consensus.cc:493] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.244717   762 raft_consensus.cc:515] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.249590   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55" is_pre_election: true
I20260709 13:00:18.251741   566 raft_consensus.cc:2468] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 1.
W20260709 13:00:18.252722   678 leader_election.cc:343] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.254724   678 leader_election.cc:304] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.256131   764 raft_consensus.cc:2804] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.255209   641 raft_consensus.cc:2468] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 1.
I20260709 13:00:18.260244   758 tablet_bootstrap.cc:492] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:18.260778   758 ts_tablet_manager.cc:1403] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.015s
I20260709 13:00:18.262034   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
W20260709 13:00:18.263468   680 leader_election.cc:343] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.263979   680 leader_election.cc:304] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55
I20260709 13:00:18.265535   759 raft_consensus.cc:359] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.265902   758 raft_consensus.cc:359] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.267576   758 raft_consensus.cc:385] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.260715   762 leader_election.cc:290] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.268193   759 raft_consensus.cc:385] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.268561   759 raft_consensus.cc:740] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.268574   762 raft_consensus.cc:2749] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.269570   759 consensus_queue.cc:260] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.271471   758 raft_consensus.cc:740] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.272670   758 consensus_queue.cc:260] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.273874   764 raft_consensus.cc:697] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Becoming Leader. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:18.275708   758 ts_tablet_manager.cc:1434] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:00:18.275535   764 consensus_queue.cc:237] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.277668   758 tablet_bootstrap.cc:492] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
W20260709 13:00:18.283541   741 tablet.cc:2406] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:18.284897   760 tablet_bootstrap.cc:492] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.285663   760 ts_tablet_manager.cc:1403] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.009s
I20260709 13:00:18.286758   759 ts_tablet_manager.cc:1434] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.003s
I20260709 13:00:18.289667   760 raft_consensus.cc:359] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.290187   760 raft_consensus.cc:385] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.290472   760 raft_consensus.cc:740] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.291263   760 consensus_queue.cc:260] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.293926   759 tablet_bootstrap.cc:492] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:18.297739   760 ts_tablet_manager.cc:1434] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 13:00:18.297900   758 tablet_bootstrap.cc:654] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.298998   760 tablet_bootstrap.cc:492] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:18.311332   463 catalog_manager.cc:5697] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.314316   759 tablet_bootstrap.cc:654] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.323668   760 tablet_bootstrap.cc:654] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.334491   758 tablet_bootstrap.cc:492] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:18.335213   758 ts_tablet_manager.cc:1403] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.026s
I20260709 13:00:18.339599   758 raft_consensus.cc:359] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.340305   760 tablet_bootstrap.cc:492] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.340430   758 raft_consensus.cc:385] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.341625   760 ts_tablet_manager.cc:1403] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.012s
I20260709 13:00:18.341732   758 raft_consensus.cc:740] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.343730   759 tablet_bootstrap.cc:492] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.344249   759 ts_tablet_manager.cc:1403] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.009s
I20260709 13:00:18.344684   760 raft_consensus.cc:359] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.345444   760 raft_consensus.cc:385] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.345741   760 raft_consensus.cc:740] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.346509   760 consensus_queue.cc:260] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.348146   759 raft_consensus.cc:359] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.348912   759 raft_consensus.cc:385] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.349218   759 raft_consensus.cc:740] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.350116   760 ts_tablet_manager.cc:1434] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:18.350068   759 consensus_queue.cc:260] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.351238   760 tablet_bootstrap.cc:492] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:18.352563   759 ts_tablet_manager.cc:1434] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:18.353287   758 consensus_queue.cc:260] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.356437   758 ts_tablet_manager.cc:1434] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.005s
I20260709 13:00:18.357486   758 tablet_bootstrap.cc:492] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
I20260709 13:00:18.361320   760 tablet_bootstrap.cc:654] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.365051   759 tablet_bootstrap.cc:492] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:18.375581   760 tablet_bootstrap.cc:492] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.376016   759 tablet_bootstrap.cc:654] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.376200   760 ts_tablet_manager.cc:1403] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.012s
I20260709 13:00:18.383881   758 tablet_bootstrap.cc:654] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.384330   760 raft_consensus.cc:359] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.385118   760 raft_consensus.cc:385] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.385960   770 raft_consensus.cc:493] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.386490   770 raft_consensus.cc:515] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.385421   760 raft_consensus.cc:740] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.388866   760 consensus_queue.cc:260] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.390640   770 leader_election.cc:290] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.406929   759 tablet_bootstrap.cc:492] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.409898   759 ts_tablet_manager.cc:1403] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.003s
I20260709 13:00:18.415617   759 raft_consensus.cc:359] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.431059   759 raft_consensus.cc:385] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.431715   759 raft_consensus.cc:740] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.433302   758 tablet_bootstrap.cc:492] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:18.435973   758 ts_tablet_manager.cc:1403] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.036s
I20260709 13:00:18.433871   759 consensus_queue.cc:260] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.439330   764 raft_consensus.cc:493] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.440207   759 ts_tablet_manager.cc:1434] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:00:18.439894   764 raft_consensus.cc:515] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.441290   759 tablet_bootstrap.cc:492] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:18.442190   760 ts_tablet_manager.cc:1434] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.062s	user 0.010s	sys 0.011s
I20260709 13:00:18.445890   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.446614   760 tablet_bootstrap.cc:492] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:18.446640   641 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 0.
I20260709 13:00:18.448622   680 leader_election.cc:304] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.449107   758 raft_consensus.cc:359] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.450256   758 raft_consensus.cc:385] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.450554   758 raft_consensus.cc:740] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.450568   779 raft_consensus.cc:2804] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.451225   779 raft_consensus.cc:493] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:18.451581   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:18.451433   758 consensus_queue.cc:260] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.451582   779 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.444377   764 leader_election.cc:290] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.458346   758 ts_tablet_manager.cc:1434] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:00:18.459916   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55" is_pre_election: true
I20260709 13:00:18.460667   566 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 0.
I20260709 13:00:18.476605   764 raft_consensus.cc:493] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.477133   764 raft_consensus.cc:515] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.480435   764 leader_election.cc:290] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.481128   758 tablet_bootstrap.cc:492] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
I20260709 13:00:18.481842   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55" is_pre_election: true
I20260709 13:00:18.481842   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
W20260709 13:00:18.484251   678 leader_election.cc:343] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:18.485821   680 leader_election.cc:343] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.486297   680 leader_election.cc:304] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55
I20260709 13:00:18.487231   760 tablet_bootstrap.cc:654] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.487869   764 raft_consensus.cc:2749] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.472285   779 raft_consensus.cc:515] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.494207   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" is_pre_election: true
I20260709 13:00:18.495774   715 raft_consensus.cc:2393] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99dcb9201d674f379f38b6b609a29f55 in current term 1: Already voted for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in this term.
I20260709 13:00:18.499703   779 leader_election.cc:290] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.500002   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:18.501773   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:18.502266   566 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.502502   641 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.510056   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.510620   566 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 1.
I20260709 13:00:18.511745   641 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 1.
I20260709 13:00:18.511802   678 leader_election.cc:304] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.512980   760 tablet_bootstrap.cc:492] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.513556   760 ts_tablet_manager.cc:1403] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.004s
I20260709 13:00:18.514308   531 leader_election.cc:304] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55; no voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:18.514793   759 tablet_bootstrap.cc:654] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.515515   791 raft_consensus.cc:2749] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.515967   779 raft_consensus.cc:2804] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.517580   779 raft_consensus.cc:697] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Becoming Leader. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:18.518603   779 consensus_queue.cc:237] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:18.519254   760 raft_consensus.cc:359] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.519963   760 raft_consensus.cc:385] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.520282   760 raft_consensus.cc:740] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.522996   791 raft_consensus.cc:493] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.523834   759 tablet_bootstrap.cc:492] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.523492   791 raft_consensus.cc:515] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.524992   759 ts_tablet_manager.cc:1403] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.006s
I20260709 13:00:18.525597   760 consensus_queue.cc:260] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.526638   791 leader_election.cc:290] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.527523   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.528204   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" is_pre_election: true
I20260709 13:00:18.528362   641 raft_consensus.cc:2468] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 0.
W20260709 13:00:18.529711   532 leader_election.cc:343] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.525070   758 tablet_bootstrap.cc:654] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.531875   759 raft_consensus.cc:359] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.532846   759 raft_consensus.cc:385] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.533157   759 raft_consensus.cc:740] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.533993   759 consensus_queue.cc:260] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.531911   760 ts_tablet_manager.cc:1434] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:00:18.534823   531 leader_election.cc:304] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:18.535633   791 raft_consensus.cc:493] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.536150   770 raft_consensus.cc:2804] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.536556   770 raft_consensus.cc:493] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.536280   791 raft_consensus.cc:515] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.539852   791 leader_election.cc:290] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.540333   760 tablet_bootstrap.cc:492] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:18.542090   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" is_pre_election: true
I20260709 13:00:18.543255   759 ts_tablet_manager.cc:1434] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
W20260709 13:00:18.543634   532 leader_election.cc:343] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.536945   770 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.546820   759 tablet_bootstrap.cc:492] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:18.560690   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.561183   760 tablet_bootstrap.cc:654] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:18.568461   531 leader_election.cc:343] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.569002   531 leader_election.cc:304] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55; no voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:18.571667   791 raft_consensus.cc:2749] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:18.572651   759 tablet_bootstrap.cc:654] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.566982   462 catalog_manager.cc:5697] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.580260   758 tablet_bootstrap.cc:492] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:18.580942   758 ts_tablet_manager.cc:1403] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.009s
I20260709 13:00:18.589437   758 raft_consensus.cc:359] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.591571   758 raft_consensus.cc:385] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.594190   758 raft_consensus.cc:740] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.597790   760 tablet_bootstrap.cc:492] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.595288   758 consensus_queue.cc:260] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.598372   760 ts_tablet_manager.cc:1403] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.021s
I20260709 13:00:18.600046   758 ts_tablet_manager.cc:1434] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 13:00:18.601153   758 tablet_bootstrap.cc:492] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
I20260709 13:00:18.601763   759 tablet_bootstrap.cc:492] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.601835   760 raft_consensus.cc:359] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.602526   759 ts_tablet_manager.cc:1403] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.001s
I20260709 13:00:18.602764   760 raft_consensus.cc:385] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.603130   760 raft_consensus.cc:740] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.604810   760 consensus_queue.cc:260] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.605238   770 raft_consensus.cc:515] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.606565   759 raft_consensus.cc:359] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.607458   759 raft_consensus.cc:385] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.607826   759 raft_consensus.cc:740] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.609187   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:18.609768   641 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.609638   759 consensus_queue.cc:260] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.611768   770 leader_election.cc:290] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 election: Requested vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.611995   759 ts_tablet_manager.cc:1434] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:00:18.607148   760 ts_tablet_manager.cc:1434] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:00:18.614349   760 tablet_bootstrap.cc:492] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:18.612852   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:18.613348   759 tablet_bootstrap.cc:492] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:18.617779   715 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.619597   758 tablet_bootstrap.cc:654] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.626633   759 tablet_bootstrap.cc:654] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.637159   760 tablet_bootstrap.cc:654] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.643266   779 raft_consensus.cc:493] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.643949   779 raft_consensus.cc:515] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.646433   779 leader_election.cc:290] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.647661   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.653486   640 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 0.
I20260709 13:00:18.648283   715 raft_consensus.cc:2468] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 1.
I20260709 13:00:18.655646   680 leader_election.cc:304] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.656263   532 leader_election.cc:304] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.650015   641 raft_consensus.cc:2468] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 1.
I20260709 13:00:18.650324   770 raft_consensus.cc:493] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.657359   791 raft_consensus.cc:2804] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.657753   770 raft_consensus.cc:515] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.660090   760 tablet_bootstrap.cc:492] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.660302   791 raft_consensus.cc:697] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:18.652537   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55" is_pre_election: true
I20260709 13:00:18.660652   760 ts_tablet_manager.cc:1403] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.001s
I20260709 13:00:18.661296   791 consensus_queue.cc:237] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
W20260709 13:00:18.662226   678 leader_election.cc:343] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:18.662982   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.663666   641 raft_consensus.cc:2468] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 0.
I20260709 13:00:18.663808   760 raft_consensus.cc:359] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.664610   760 raft_consensus.cc:385] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.664866   760 raft_consensus.cc:740] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.656870   779 raft_consensus.cc:2804] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.666196   531 leader_election.cc:304] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:18.666349   770 leader_election.cc:290] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.665576   779 raft_consensus.cc:493] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.667511   779 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.667514   770 raft_consensus.cc:2804] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.668294   770 raft_consensus.cc:493] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.668685   770 raft_consensus.cc:3060] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.668658   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" is_pre_election: true
I20260709 13:00:18.669240   760 consensus_queue.cc:260] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.669574   715 raft_consensus.cc:2468] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 0.
I20260709 13:00:18.671154   760 ts_tablet_manager.cc:1434] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:00:18.672158   760 tablet_bootstrap.cc:492] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55: Bootstrap starting.
I20260709 13:00:18.674228   758 tablet_bootstrap.cc:492] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:18.674691   759 tablet_bootstrap.cc:492] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.674751   758 ts_tablet_manager.cc:1403] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.016s
I20260709 13:00:18.675235   759 ts_tablet_manager.cc:1403] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.008s
I20260709 13:00:18.680025   461 catalog_manager.cc:5697] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.683292   758 raft_consensus.cc:359] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.684109   758 raft_consensus.cc:385] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.684417   758 raft_consensus.cc:740] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.685523   760 tablet_bootstrap.cc:654] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.686715   770 raft_consensus.cc:515] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.689538   759 raft_consensus.cc:359] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.689960   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:18.690493   759 raft_consensus.cc:385] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.690618   641 raft_consensus.cc:3060] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.702986   758 consensus_queue.cc:260] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.724705   764 raft_consensus.cc:493] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.691000   759 raft_consensus.cc:740] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.748106   764 raft_consensus.cc:515] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.748191   759 consensus_queue.cc:260] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.748570   770 leader_election.cc:290] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 election: Requested vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.750846   758 ts_tablet_manager.cc:1434] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:00:18.753913   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:18.754637   715 raft_consensus.cc:3060] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.755293   758 tablet_bootstrap.cc:492] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9: Bootstrap starting.
I20260709 13:00:18.757059   641 raft_consensus.cc:2468] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 1.
I20260709 13:00:18.764403   759 ts_tablet_manager.cc:1434] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.016s
I20260709 13:00:18.767675   759 tablet_bootstrap.cc:492] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:18.775630   759 tablet_bootstrap.cc:654] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.780817   760 tablet_bootstrap.cc:492] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55: No bootstrap required, opened a new log
I20260709 13:00:18.781491   760 ts_tablet_manager.cc:1403] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.023s
I20260709 13:00:18.767262   779 raft_consensus.cc:515] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.781939   715 raft_consensus.cc:2468] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 1.
I20260709 13:00:18.783910   531 leader_election.cc:304] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:18.786623   770 raft_consensus.cc:2804] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.787590   770 raft_consensus.cc:697] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:18.789511   770 consensus_queue.cc:237] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.789738   760 raft_consensus.cc:359] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.790328   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f58d697b30c4a80aa5eb3a51c6e1fbd" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55" is_pre_election: true
I20260709 13:00:18.790522   760 raft_consensus.cc:385] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.791226   760 raft_consensus.cc:740] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.794584   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:18.795449   565 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.805676   778 consensus_queue.cc:1048] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:18.805442   764 leader_election.cc:290] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.812892   779 leader_election.cc:290] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.814455   758 tablet_bootstrap.cc:654] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.814301   760 consensus_queue.cc:260] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.816332   759 tablet_bootstrap.cc:492] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.816895   759 ts_tablet_manager.cc:1403] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.018s
I20260709 13:00:18.816696   566 raft_consensus.cc:2468] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 0.
I20260709 13:00:18.822885   759 raft_consensus.cc:359] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.823676   759 raft_consensus.cc:385] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.824139   759 raft_consensus.cc:740] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.823522   565 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 1.
I20260709 13:00:18.824949   759 consensus_queue.cc:260] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.826973   759 ts_tablet_manager.cc:1434] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:18.828272   759 tablet_bootstrap.cc:492] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598: Bootstrap starting.
I20260709 13:00:18.837904   759 tablet_bootstrap.cc:654] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:18.840881   678 leader_election.cc:304] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.841876   779 raft_consensus.cc:2804] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.842465   779 raft_consensus.cc:697] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Becoming Leader. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:18.843493   779 consensus_queue.cc:237] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.845623   758 tablet_bootstrap.cc:492] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9: No bootstrap required, opened a new log
I20260709 13:00:18.846176   758 ts_tablet_manager.cc:1403] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent bootstrapping tablet: real 0.093s	user 0.021s	sys 0.008s
I20260709 13:00:18.850188   759 tablet_bootstrap.cc:492] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598: No bootstrap required, opened a new log
I20260709 13:00:18.850718   759 ts_tablet_manager.cc:1403] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:00:18.856652   759 raft_consensus.cc:359] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.856971   758 raft_consensus.cc:359] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.857491   759 raft_consensus.cc:385] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.857684   758 raft_consensus.cc:385] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:18.857923   759 raft_consensus.cc:740] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.858011   758 raft_consensus.cc:740] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Initialized, Role: FOLLOWER
I20260709 13:00:18.860783   759 consensus_queue.cc:260] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.863188   759 ts_tablet_manager.cc:1434] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:00:18.864203   758 consensus_queue.cc:260] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.866034   758 ts_tablet_manager.cc:1434] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:00:18.866392   678 leader_election.cc:304] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.867209   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:18.867594   779 raft_consensus.cc:2804] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.867802   640 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.868008   779 raft_consensus.cc:493] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.868440   779 raft_consensus.cc:3060] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.870421   770 raft_consensus.cc:493] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.870954   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f58d697b30c4a80aa5eb3a51c6e1fbd" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.871071   770 raft_consensus.cc:515] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.871781   641 raft_consensus.cc:2468] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 0.
I20260709 13:00:18.873049   769 raft_consensus.cc:493] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.873567   769 raft_consensus.cc:515] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.876205   770 leader_election.cc:290] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.875702   640 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 1.
I20260709 13:00:18.875687   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" is_pre_election: true
I20260709 13:00:18.881614   715 raft_consensus.cc:2468] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 0.
I20260709 13:00:18.876888   769 leader_election.cc:290] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.883282   532 leader_election.cc:304] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.884400   770 raft_consensus.cc:2804] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.884871   770 raft_consensus.cc:493] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.885298   770 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.887521   460 catalog_manager.cc:5697] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:18.893333   760 ts_tablet_manager.cc:1434] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55: Time spent starting tablet: real 0.111s	user 0.010s	sys 0.016s
I20260709 13:00:18.896402   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.890028   461 catalog_manager.cc:5697] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:18.897244   640 raft_consensus.cc:2468] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 0.
I20260709 13:00:18.900561   803 raft_consensus.cc:493] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.901189   803 raft_consensus.cc:515] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.906224   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" is_pre_election: true
I20260709 13:00:18.907287   715 raft_consensus.cc:2468] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 0.
I20260709 13:00:18.908751   532 leader_election.cc:304] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.909101   762 consensus_queue.cc:1048] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:18.906224   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598" is_pre_election: true
I20260709 13:00:18.910261   791 raft_consensus.cc:2804] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:18.910713   791 raft_consensus.cc:493] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:18.910843   640 raft_consensus.cc:2468] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 0.
I20260709 13:00:18.911247   791 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.903818   803 leader_election.cc:290] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.893378   779 raft_consensus.cc:515] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.919402   779 leader_election.cc:290] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:18.922243   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f58d697b30c4a80aa5eb3a51c6e1fbd" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:18.923032   565 raft_consensus.cc:3060] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.931465   770 raft_consensus.cc:515] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.934875   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:18.935007   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:18.935724   640 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.935823   715 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.936702   770 leader_election.cc:290] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 election: Requested vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.939044   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f58d697b30c4a80aa5eb3a51c6e1fbd" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:18.953002   641 raft_consensus.cc:3060] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.956835   791 raft_consensus.cc:515] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:18.965761   791 leader_election.cc:290] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 election: Requested vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:18.967195   715 raft_consensus.cc:2468] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 1.
I20260709 13:00:18.968852   638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:18.960776   565 raft_consensus.cc:2468] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 1.
I20260709 13:00:18.970577   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:18.972976   638 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.975160   714 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:18.982355   532 leader_election.cc:304] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.982448   678 leader_election.cc:304] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:18.985140   791 raft_consensus.cc:2804] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.989626   791 raft_consensus.cc:697] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:18.993091   762 raft_consensus.cc:2804] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:18.997246   791 consensus_queue.cc:237] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.002563   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55" is_pre_election: true
I20260709 13:00:19.001627   762 raft_consensus.cc:697] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Becoming Leader. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:19.014165   762 consensus_queue.cc:237] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.017474   714 raft_consensus.cc:2468] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 1.
I20260709 13:00:19.022903   764 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.011865   640 raft_consensus.cc:2468] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 1.
I20260709 13:00:19.032114   532 leader_election.cc:304] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:19.033466   770 raft_consensus.cc:2804] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:19.034137   770 raft_consensus.cc:697] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:19.035305   770 consensus_queue.cc:237] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.039187   638 raft_consensus.cc:2468] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 1.
I20260709 13:00:19.050051   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" is_pre_election: true
I20260709 13:00:19.051875   714 raft_consensus.cc:2393] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c8221909dbb46d2a6f41f14a753c598 in current term 1: Already voted for candidate 99dcb9201d674f379f38b6b609a29f55 in this term.
I20260709 13:00:19.060411   607 leader_election.cc:304] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598; no voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:19.063381   461 catalog_manager.cc:5697] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.065812   462 catalog_manager.cc:5697] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.060609   769 raft_consensus.cc:493] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.068562   769 raft_consensus.cc:515] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.073207   769 leader_election.cc:290] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:19.080600   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55" is_pre_election: true
I20260709 13:00:19.080763   769 raft_consensus.cc:2749] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:19.081368   565 raft_consensus.cc:2468] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 0.
I20260709 13:00:19.085546   604 leader_election.cc:304] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:19.090629   770 consensus_queue.cc:1048] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.091677   769 raft_consensus.cc:2804] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:19.092178   769 raft_consensus.cc:493] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.092494   769 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.092643   641 raft_consensus.cc:2468] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 1.
I20260709 13:00:19.099045   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" is_pre_election: true
I20260709 13:00:19.099732   714 raft_consensus.cc:2468] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 0.
I20260709 13:00:19.105466   762 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.124362   462 catalog_manager.cc:5697] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.150595   769 raft_consensus.cc:515] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.157298   803 consensus_queue.cc:1048] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.175014   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:19.175892   566 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.183142   566 raft_consensus.cc:2468] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 1.
I20260709 13:00:19.184437   604 leader_election.cc:304] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:19.185585   824 raft_consensus.cc:2804] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:19.186261   824 raft_consensus.cc:697] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:19.187368   824 consensus_queue.cc:237] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.191404   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:19.192256   714 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:19.199115   769 leader_election.cc:290] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 1 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:19.204247   714 raft_consensus.cc:2468] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 1.
I20260709 13:00:19.208551   462 catalog_manager.cc:5697] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.243414   779 consensus_queue.cc:1048] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.259851   779 consensus_queue.cc:1048] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.287436   803 consensus_queue.cc:1048] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:19.306272   803 consensus_queue.cc:1048] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:19.336241   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
mode: GRACEFUL
new_leader_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:54352
I20260709 13:00:19.337137   714 raft_consensus.cc:606] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Received request to transfer leadership to TS 99dcb9201d674f379f38b6b609a29f55
I20260709 13:00:19.347002   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "965be54504314193800a99ead8d7b03f"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
mode: GRACEFUL
new_leader_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:54352
I20260709 13:00:19.347641   714 raft_consensus.cc:606] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Received request to transfer leadership to TS 99dcb9201d674f379f38b6b609a29f55
I20260709 13:00:19.355067   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
mode: GRACEFUL
new_leader_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:54352
I20260709 13:00:19.355679   714 raft_consensus.cc:606] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Received request to transfer leadership to TS 99dcb9201d674f379f38b6b609a29f55
I20260709 13:00:19.373590   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
mode: GRACEFUL
new_leader_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:00:19.374367   566 raft_consensus.cc:606] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Received request to transfer leadership to TS 8c8221909dbb46d2a6f41f14a753c598
I20260709 13:00:19.381385   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "329a9841909f468280996643aacf35c4"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
mode: GRACEFUL
new_leader_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:00:19.382144   566 raft_consensus.cc:606] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Received request to transfer leadership to TS 8c8221909dbb46d2a6f41f14a753c598
I20260709 13:00:19.388705   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
mode: GRACEFUL
new_leader_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:00:19.389410   566 raft_consensus.cc:606] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Received request to transfer leadership to TS 8c8221909dbb46d2a6f41f14a753c598
I20260709 13:00:19.407601   779 consensus_queue.cc:1048] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.420647   779 consensus_queue.cc:1048] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:19.451403   803 consensus_queue.cc:1048] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.463752   803 raft_consensus.cc:993] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55: : Instructing follower 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:19.464417   803 raft_consensus.cc:1081] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Signalling peer 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:19.468600   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "329a9841909f468280996643aacf35c4"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:36534
I20260709 13:00:19.469295   640 raft_consensus.cc:493] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.469678   640 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.478848   803 consensus_queue.cc:1048] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:19.479880   640 raft_consensus.cc:515] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.483417   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:19.484390   566 raft_consensus.cc:3055] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:19.484766   566 raft_consensus.cc:740] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:19.485635   566 consensus_queue.cc:260] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.486646   566 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.495139   640 leader_election.cc:290] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 2 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:19.496294   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:19.497470   566 raft_consensus.cc:2468] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 2.
I20260709 13:00:19.499209   604 leader_election.cc:304] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:19.501380   824 raft_consensus.cc:2804] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.501878   824 raft_consensus.cc:697] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:19.502684   824 consensus_queue.cc:237] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.505232   778 raft_consensus.cc:993] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9: : Instructing follower 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:19.505890   779 raft_consensus.cc:1081] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Signalling peer 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:19.508808   565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "965be54504314193800a99ead8d7b03f"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:52540
I20260709 13:00:19.509407   565 raft_consensus.cc:493] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.509779   565 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.512183   462 catalog_manager.cc:5697] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 1 to 2, leader changed from 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193) to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.516984   565 raft_consensus.cc:515] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.521018   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965be54504314193800a99ead8d7b03f" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:19.521756   640 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.523025   779 raft_consensus.cc:993] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: : Instructing follower 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:19.523545   779 raft_consensus.cc:1081] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Signalling peer 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:19.524675   565 leader_election.cc:290] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 2 election: Requested vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:19.525792   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965be54504314193800a99ead8d7b03f" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:19.525975   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:52540
I20260709 13:00:19.526450   714 raft_consensus.cc:3055] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:19.526484   566 raft_consensus.cc:493] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.526925   714 raft_consensus.cc:740] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:19.527084   566 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.527873   714 consensus_queue.cc:260] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.529237   714 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.530416   640 raft_consensus.cc:2468] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 2.
I20260709 13:00:19.531929   531 leader_election.cc:304] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:19.533078   803 raft_consensus.cc:2804] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.533574   803 raft_consensus.cc:697] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:19.534431   803 consensus_queue.cc:237] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.536403   566 raft_consensus.cc:515] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:19.537789   714 raft_consensus.cc:2468] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 2.
I20260709 13:00:19.540655   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:19.541278   566 leader_election.cc:290] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 2 election: Requested vote from peers df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:19.541410   714 raft_consensus.cc:3055] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:19.542112   714 raft_consensus.cc:740] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:19.543346   714 consensus_queue.cc:260] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:19.545049   714 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.548594   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:19.549409   640 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.550741   462 catalog_manager.cc:5697] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 1 to 2, leader changed from df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195) to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.553726   714 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 2.
I20260709 13:00:19.555826   532 leader_election.cc:304] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:19.557513   791 raft_consensus.cc:2804] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.558698   791 raft_consensus.cc:697] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:19.560441   640 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 2.
I20260709 13:00:19.560009   791 consensus_queue.cc:237] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:19.565131   803 consensus_queue.cc:1048] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.574712   803 consensus_queue.cc:1048] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:19.585675   462 catalog_manager.cc:5697] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 1 to 2, leader changed from df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195) to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.599355   791 raft_consensus.cc:993] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55: : Instructing follower 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:19.599886   803 raft_consensus.cc:1081] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Signalling peer 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:19.602035   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:36534
I20260709 13:00:19.602680   639 raft_consensus.cc:493] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.603056   639 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.611744   639 raft_consensus.cc:515] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.612905   640 raft_consensus.cc:1240] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Rejecting Update request from peer 99dcb9201d674f379f38b6b609a29f55 for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:19.614938   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:19.615643   566 raft_consensus.cc:3055] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:19.616051   566 raft_consensus.cc:740] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:19.616919   566 consensus_queue.cc:260] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.618062   566 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.618254   639 leader_election.cc:290] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 2 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:19.619565   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:19.620266   714 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.626940   566 raft_consensus.cc:2468] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 2.
I20260709 13:00:19.628206   604 leader_election.cc:304] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:19.628684   714 raft_consensus.cc:2468] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 2.
I20260709 13:00:19.628950   824 raft_consensus.cc:2804] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.629571   824 raft_consensus.cc:697] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:19.630439   824 consensus_queue.cc:237] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.638556   462 catalog_manager.cc:5697] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 1 to 2, leader changed from 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193) to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.686885   824 consensus_queue.cc:1048] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:19.701578   824 consensus_queue.cc:1048] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:19.721519   779 raft_consensus.cc:993] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9: : Instructing follower 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:19.722098   835 raft_consensus.cc:1081] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Signalling peer 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:19.724301   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:52540
I20260709 13:00:19.725010   566 raft_consensus.cc:493] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.725466   566 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.733582   566 raft_consensus.cc:515] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.736271   566 leader_election.cc:290] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 2 election: Requested vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:19.736582   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:19.737319   639 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.737740   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:19.738400   715 raft_consensus.cc:3055] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:19.738778   715 raft_consensus.cc:740] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:19.739699   715 consensus_queue.cc:260] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.741956   715 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.747004   639 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 2.
I20260709 13:00:19.748785   531 leader_election.cc:304] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:19.749976   715 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 2.
I20260709 13:00:19.750536   803 raft_consensus.cc:2804] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.751091   803 raft_consensus.cc:697] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:19.752072   803 consensus_queue.cc:237] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.759210   461 catalog_manager.cc:5697] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 1 to 2, leader changed from df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195) to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.834813   791 raft_consensus.cc:993] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55: : Instructing follower 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:19.835431   803 raft_consensus.cc:1081] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Signalling peer 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:19.838140   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:36534
I20260709 13:00:19.839051   639 raft_consensus.cc:493] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:19.839509   639 raft_consensus.cc:3060] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.850574   639 raft_consensus.cc:515] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.852479   639 leader_election.cc:290] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 2 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:19.853549   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:19.853842   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc725db50024889bc0a60626d1fd6e5" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:19.854245   566 raft_consensus.cc:3055] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:19.854460   715 raft_consensus.cc:3060] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.854673   566 raft_consensus.cc:740] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:19.855634   566 consensus_queue.cc:260] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.856915   566 raft_consensus.cc:3060] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.862797   715 raft_consensus.cc:2468] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 2.
I20260709 13:00:19.865211   566 raft_consensus.cc:2468] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 2.
I20260709 13:00:19.865103   607 leader_election.cc:304] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:19.866436   843 raft_consensus.cc:2804] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:19.867004   843 raft_consensus.cc:697] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:19.867952   843 consensus_queue.cc:237] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:19.877635   462 catalog_manager.cc:5697] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 1 to 2, leader changed from 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193) to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.923462   566 raft_consensus.cc:1275] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:19.925479   843 consensus_queue.cc:1048] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:19.936282   715 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:19.939435   714 raft_consensus.cc:1275] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:19.941066   803 consensus_queue.cc:1048] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:19.949716   715 raft_consensus.cc:1275] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:19.951689   639 raft_consensus.cc:1275] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:19.951402   845 consensus_queue.cc:1048] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:00:19.955731   791 consensus_queue.cc:1048] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.016239   714 raft_consensus.cc:1275] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.017895   845 consensus_queue.cc:1048] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.031415   566 raft_consensus.cc:1275] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.033124   769 consensus_queue.cc:1048] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.042078   715 raft_consensus.cc:1275] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.044106   791 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.056473   639 raft_consensus.cc:1275] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.058152   803 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.234159   639 raft_consensus.cc:1275] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.236078   803 consensus_queue.cc:1048] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.247219   715 raft_consensus.cc:1275] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.249528   791 consensus_queue.cc:1048] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:20.325568   715 raft_consensus.cc:1275] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.327126   769 consensus_queue.cc:1048] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:20.337095   566 raft_consensus.cc:1275] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:20.338975   843 consensus_queue.cc:1048] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:22.433907   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:00:22.435014   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:22.458314   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cfea1b8377642998710874f9f020f08"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
mode: GRACEFUL
new_leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
 from {username='slave'} at 127.0.0.1:42044
I20260709 13:00:22.459062   639 raft_consensus.cc:606] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 LEADER]: Received request to transfer leadership to TS df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:22.472158   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
mode: GRACEFUL
new_leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
 from {username='slave'} at 127.0.0.1:49004
I20260709 13:00:22.472661   566 raft_consensus.cc:606] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Received request to transfer leadership to TS df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:22.473923   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:22.474503   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:22.490257   847 raft_consensus.cc:993] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598: : Instructing follower df4a2bbec58c4607bcd6bc90f24da6c9 to start an election
I20260709 13:00:22.490660   847 raft_consensus.cc:1081] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 LEADER]: Signalling peer df4a2bbec58c4607bcd6bc90f24da6c9 to start an election
I20260709 13:00:22.492357   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cfea1b8377642998710874f9f020f08"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
 from {username='slave'} at 127.0.0.1:54350
I20260709 13:00:22.492880   714 raft_consensus.cc:493] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:22.493243   714 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.498883   714 raft_consensus.cc:515] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:22.501354   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:22.501839   566 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.501680   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:22.502391   639 raft_consensus.cc:3055] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:22.502761   639 raft_consensus.cc:740] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:22.503646   639 consensus_queue.cc:260] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:22.504937   639 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:22.506547   714 leader_election.cc:290] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 2 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:22.508589   566 raft_consensus.cc:2468] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 2.
I20260709 13:00:22.509706   678 leader_election.cc:304] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:22.510545   779 raft_consensus.cc:2804] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:22.512066   779 raft_consensus.cc:697] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 LEADER]: Becoming Leader. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:22.513144   639 raft_consensus.cc:2468] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 2.
I20260709 13:00:22.513000   779 consensus_queue.cc:237] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:22.521520   460 catalog_manager.cc:5697] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 reported cstate change: term changed from 1 to 2, leader changed from 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194) to df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:22.640322   803 raft_consensus.cc:993] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55: : Instructing follower df4a2bbec58c4607bcd6bc90f24da6c9 to start an election
I20260709 13:00:22.640960   848 raft_consensus.cc:1081] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Signalling peer df4a2bbec58c4607bcd6bc90f24da6c9 to start an election
I20260709 13:00:22.642675   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
 from {username='slave'} at 127.0.0.1:54346
I20260709 13:00:22.643203   714 raft_consensus.cc:493] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:22.643504   714 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.648345   714 raft_consensus.cc:515] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:22.649977   714 leader_election.cc:290] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 3 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:22.651214   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:22.651255   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:22.651733   566 raft_consensus.cc:3055] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:22.651922   639 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.652081   566 raft_consensus.cc:740] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:22.652791   566 consensus_queue.cc:260] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:22.653631   566 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:22.657727   566 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 3.
I20260709 13:00:22.657771   639 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 3.
I20260709 13:00:22.659020   678 leader_election.cc:304] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:22.659914   779 raft_consensus.cc:2804] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:22.660494   779 raft_consensus.cc:697] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 LEADER]: Becoming Leader. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:22.661351   779 consensus_queue.cc:237] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:22.669373   460 catalog_manager.cc:5697] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 reported cstate change: term changed from 2 to 3, leader changed from 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193) to df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.046458   639 raft_consensus.cc:1275] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Refusing update from remote peer df4a2bbec58c4607bcd6bc90f24da6c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:23.048023   779 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:23.060423   566 raft_consensus.cc:1275] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Refusing update from remote peer df4a2bbec58c4607bcd6bc90f24da6c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:23.062331   853 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:23.095952   639 raft_consensus.cc:1275] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Refusing update from remote peer df4a2bbec58c4607bcd6bc90f24da6c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:23.097381   853 consensus_queue.cc:1048] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.108305   566 raft_consensus.cc:1275] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Refusing update from remote peer df4a2bbec58c4607bcd6bc90f24da6c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:23.109964   853 consensus_queue.cc:1048] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:23.475365   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:23.485780   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
mode: GRACEFUL
new_leader_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:54352
I20260709 13:00:23.486334   714 raft_consensus.cc:606] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 LEADER]: Received request to transfer leadership to TS 8c8221909dbb46d2a6f41f14a753c598
I20260709 13:00:23.491724   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "965be54504314193800a99ead8d7b03f"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
mode: GRACEFUL
new_leader_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:00:23.492364   566 raft_consensus.cc:606] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Received request to transfer leadership to TS 8c8221909dbb46d2a6f41f14a753c598
I20260709 13:00:23.498080   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
mode: GRACEFUL
new_leader_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:00:23.498788   566 raft_consensus.cc:606] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Received request to transfer leadership to TS 8c8221909dbb46d2a6f41f14a753c598
I20260709 13:00:23.504640   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
mode: GRACEFUL
new_leader_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:52554
I20260709 13:00:23.505368   566 raft_consensus.cc:606] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Received request to transfer leadership to TS 8c8221909dbb46d2a6f41f14a753c598
I20260709 13:00:23.519671   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0cfea1b8377642998710874f9f020f08"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
mode: GRACEFUL
new_leader_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:54352
I20260709 13:00:23.520298   714 raft_consensus.cc:606] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 LEADER]: Received request to transfer leadership to TS 8c8221909dbb46d2a6f41f14a753c598
I20260709 13:00:23.562472   779 raft_consensus.cc:993] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: : Instructing follower 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:23.562942   853 raft_consensus.cc:1081] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 LEADER]: Signalling peer 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:23.564739   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:36530
I20260709 13:00:23.565357   639 raft_consensus.cc:493] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.565693   639 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.570879   639 raft_consensus.cc:515] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:23.572662   639 leader_election.cc:290] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 4 election: Requested vote from peers df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863), 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427)
I20260709 13:00:23.573875   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:23.573915   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:23.574652   714 raft_consensus.cc:3055] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:23.574689   566 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.575178   714 raft_consensus.cc:740] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:23.576174   714 consensus_queue.cc:260] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:23.577453   714 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:23.582129   566 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 4.
I20260709 13:00:23.583568   604 leader_election.cc:304] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:23.584512   852 raft_consensus.cc:2804] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:23.584645   714 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 4.
I20260709 13:00:23.586217   852 raft_consensus.cc:697] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:23.587006   852 consensus_queue.cc:237] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:23.593173   460 catalog_manager.cc:5697] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 3 to 4, leader changed from df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195) to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:23.734555   862 raft_consensus.cc:993] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9: : Instructing follower 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:23.735061   853 raft_consensus.cc:1081] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 LEADER]: Signalling peer 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:23.736676   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0cfea1b8377642998710874f9f020f08"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:36530
I20260709 13:00:23.737280   639 raft_consensus.cc:493] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.737608   639 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.743376   639 raft_consensus.cc:515] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.746480   639 leader_election.cc:290] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 3 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:23.746552   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:23.746893   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0cfea1b8377642998710874f9f020f08" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:23.747373   566 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.747490   714 raft_consensus.cc:3055] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.747964   714 raft_consensus.cc:740] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:23.748808   714 consensus_queue.cc:260] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.749811   714 raft_consensus.cc:3060] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.752161   566 raft_consensus.cc:2468] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 3.
I20260709 13:00:23.753381   604 leader_election.cc:304] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:23.754261   852 raft_consensus.cc:2804] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:23.754700   852 raft_consensus.cc:697] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:23.755381   714 raft_consensus.cc:2468] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 3.
I20260709 13:00:23.755407   852 consensus_queue.cc:237] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.762251   460 catalog_manager.cc:5697] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 2 to 3, leader changed from df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195) to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.774402   848 raft_consensus.cc:993] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55: : Instructing follower 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:23.774864   848 raft_consensus.cc:1081] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Signalling peer 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:23.776434   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:36534
I20260709 13:00:23.776971   639 raft_consensus.cc:493] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.777242   639 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.783130   639 raft_consensus.cc:515] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.784828   639 leader_election.cc:290] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 3 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:23.785887   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:23.785868   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:23.786684   714 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.786687   566 raft_consensus.cc:3055] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.787247   566 raft_consensus.cc:740] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:23.787988   566 consensus_queue.cc:260] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.789093   566 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.792989   714 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 3.
I20260709 13:00:23.794196   607 leader_election.cc:304] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:23.794509   566 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 3.
I20260709 13:00:23.795080   852 raft_consensus.cc:2804] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:23.795603   852 raft_consensus.cc:697] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:23.796397   852 consensus_queue.cc:237] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.803750   460 catalog_manager.cc:5697] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 2 to 3, leader changed from 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193) to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.913113   872 raft_consensus.cc:993] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55: : Instructing follower 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:23.913640   848 raft_consensus.cc:1081] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Signalling peer 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:23.915271   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "965be54504314193800a99ead8d7b03f"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:36534
I20260709 13:00:23.915798   639 raft_consensus.cc:493] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:23.916162   639 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.920848   639 raft_consensus.cc:515] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.922433   639 leader_election.cc:290] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 3 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:23.923487   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965be54504314193800a99ead8d7b03f" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:23.923486   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965be54504314193800a99ead8d7b03f" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:23.924074   566 raft_consensus.cc:3055] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:23.924252   714 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.924355   566 raft_consensus.cc:740] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:23.925140   566 consensus_queue.cc:260] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.926034   566 raft_consensus.cc:3060] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:23.928548   714 raft_consensus.cc:2468] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 3.
I20260709 13:00:23.929565   607 leader_election.cc:304] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:23.930568   566 raft_consensus.cc:2468] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 3.
I20260709 13:00:23.930686   852 raft_consensus.cc:2804] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:23.931206   852 raft_consensus.cc:697] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:23.932152   852 consensus_queue.cc:237] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:23.938726   460 catalog_manager.cc:5697] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 2 to 3, leader changed from 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193) to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:23.983124   714 raft_consensus.cc:1275] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 4 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:23.984261   852 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:23.995297   566 raft_consensus.cc:1275] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 4 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:23.997186   852 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:24.095875   872 raft_consensus.cc:993] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55: : Instructing follower 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:24.096396   848 raft_consensus.cc:1081] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Signalling peer 8c8221909dbb46d2a6f41f14a753c598 to start an election
I20260709 13:00:24.097820   639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
 from {username='slave'} at 127.0.0.1:36534
I20260709 13:00:24.098555   639 raft_consensus.cc:493] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:24.098924   639 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.103708   639 raft_consensus.cc:515] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:24.105396   639 leader_election.cc:290] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 2 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:24.106611   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:24.106861   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e" candidate_uuid: "8c8221909dbb46d2a6f41f14a753c598" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:24.107127   566 raft_consensus.cc:3055] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:24.107528   714 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.107492   566 raft_consensus.cc:740] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:24.108570   566 consensus_queue.cc:260] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:24.109661   566 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:24.113826   714 raft_consensus.cc:2468] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 2.
I20260709 13:00:24.115139   566 raft_consensus.cc:2468] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c8221909dbb46d2a6f41f14a753c598 in term 2.
I20260709 13:00:24.115072   607 leader_election.cc:304] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:24.116248   852 raft_consensus.cc:2804] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:24.116760   852 raft_consensus.cc:697] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Becoming Leader. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:24.117578   852 consensus_queue.cc:237] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:24.125156   462 catalog_manager.cc:5697] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 reported cstate change: term changed from 1 to 2, leader changed from 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193) to 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "8c8221909dbb46d2a6f41f14a753c598" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:24.171974   714 raft_consensus.cc:1275] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.173808   852 consensus_queue.cc:1048] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.183287   566 raft_consensus.cc:1275] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.185182   881 consensus_queue.cc:1048] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:24.313402   714 raft_consensus.cc:1275] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.314970   881 consensus_queue.cc:1048] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.325043   566 raft_consensus.cc:1275] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.327916   877 consensus_queue.cc:1048] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.403960   566 raft_consensus.cc:1275] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.405655   852 consensus_queue.cc:1048] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:24.417557   714 raft_consensus.cc:1275] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:24.419195   852 consensus_queue.cc:1048] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:24.520939   714 raft_consensus.cc:1275] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:24.522329   852 consensus_queue.cc:1048] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:24.532675   566 raft_consensus.cc:1275] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Refusing update from remote peer 8c8221909dbb46d2a6f41f14a753c598: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:24.534281   852 consensus_queue.cc:1048] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:26.525790   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:26.534402   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
mode: GRACEFUL
new_leader_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:42044
I20260709 13:00:26.535179   639 raft_consensus.cc:606] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 LEADER]: Received request to transfer leadership to TS 99dcb9201d674f379f38b6b609a29f55
I20260709 13:00:26.538200   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "329a9841909f468280996643aacf35c4"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
mode: GRACEFUL
new_leader_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:42044
I20260709 13:00:26.539060   639 raft_consensus.cc:606] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Received request to transfer leadership to TS 99dcb9201d674f379f38b6b609a29f55
I20260709 13:00:26.542248   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
mode: GRACEFUL
new_leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
 from {username='slave'} at 127.0.0.1:42044
I20260709 13:00:26.542889   639 raft_consensus.cc:606] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Received request to transfer leadership to TS df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:26.546118   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
mode: GRACEFUL
new_leader_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:42044
I20260709 13:00:26.546654   639 raft_consensus.cc:606] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Received request to transfer leadership to TS 99dcb9201d674f379f38b6b609a29f55
I20260709 13:00:26.549486   639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887"
dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
mode: GRACEFUL
new_leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
 from {username='slave'} at 127.0.0.1:42044
I20260709 13:00:26.550132   639 raft_consensus.cc:606] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Received request to transfer leadership to TS df4a2bbec58c4607bcd6bc90f24da6c9
I20260709 13:00:26.551399   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:00:26.552654   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:26.564693   877 raft_consensus.cc:993] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598: : Instructing follower df4a2bbec58c4607bcd6bc90f24da6c9 to start an election
I20260709 13:00:26.565371   892 raft_consensus.cc:1081] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Signalling peer df4a2bbec58c4607bcd6bc90f24da6c9 to start an election
I20260709 13:00:26.568006   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
 from {username='slave'} at 127.0.0.1:54350
I20260709 13:00:26.568717   714 raft_consensus.cc:493] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:26.569171   714 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.640803   714 raft_consensus.cc:515] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.643148   714 leader_election.cc:290] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 3 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:26.644493   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:26.645511   565 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.644713   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57dee02a511d4ec69224adb44434a8a7" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:26.646759   639 raft_consensus.cc:3055] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.647143   639 raft_consensus.cc:740] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:26.648126   639 consensus_queue.cc:260] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.649174   639 raft_consensus.cc:3060] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.701351   893 raft_consensus.cc:993] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598: : Instructing follower 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:26.701977   892 raft_consensus.cc:1081] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Signalling peer 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:26.704298   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "329a9841909f468280996643aacf35c4"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:00:26.704957   566 raft_consensus.cc:493] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:26.705317   566 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.714150   893 raft_consensus.cc:993] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598: : Instructing follower 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:26.714632   892 raft_consensus.cc:1081] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Signalling peer 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:26.716471   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:00:26.716989   564 raft_consensus.cc:493] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:26.717341   564 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.741829   565 raft_consensus.cc:2468] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 3.
I20260709 13:00:26.741873   639 raft_consensus.cc:2468] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 3.
I20260709 13:00:26.743917   678 leader_election.cc:304] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:26.745347   891 raft_consensus.cc:2804] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.745854   891 raft_consensus.cc:697] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 LEADER]: Becoming Leader. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:26.746850   891 consensus_queue.cc:237] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.754561   462 catalog_manager.cc:5697] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 reported cstate change: term changed from 2 to 3, leader changed from 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194) to df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:26.838569   566 raft_consensus.cc:515] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.838649   564 raft_consensus.cc:515] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.841562   566 leader_election.cc:290] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 3 election: Requested vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:26.841578   564 leader_election.cc:290] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 3 election: Requested vote from peers 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545), df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863)
I20260709 13:00:26.843125   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:26.843847   639 raft_consensus.cc:3055] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.843158   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329a9841909f468280996643aacf35c4" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:26.843734   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:26.843734   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9de7ac0ccfc4e56aa9dcc6bb8cc609e" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:26.844626   639 raft_consensus.cc:740] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:26.844892   714 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.845005   715 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.845008   640 raft_consensus.cc:3055] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:26.845702   640 raft_consensus.cc:740] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:26.845594   639 consensus_queue.cc:260] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.847143   639 raft_consensus.cc:3060] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.846662   640 consensus_queue.cc:260] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.848527   640 raft_consensus.cc:3060] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:26.934659   639 raft_consensus.cc:2468] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 3.
I20260709 13:00:26.935065   715 raft_consensus.cc:2468] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 3.
I20260709 13:00:26.934661   714 raft_consensus.cc:2468] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 3.
I20260709 13:00:26.936565   531 leader_election.cc:304] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c8221909dbb46d2a6f41f14a753c598, 99dcb9201d674f379f38b6b609a29f55; no voters: 
I20260709 13:00:26.938040   640 raft_consensus.cc:2468] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 3.
I20260709 13:00:26.940466   899 raft_consensus.cc:2804] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.939515   532 leader_election.cc:304] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:26.942404   899 raft_consensus.cc:697] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 3 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:26.944285   901 raft_consensus.cc:2804] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:26.944535   899 consensus_queue.cc:237] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.945191   901 raft_consensus.cc:697] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 3 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:26.946616   901 consensus_queue.cc:237] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:26.959702   462 catalog_manager.cc:5697] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 2 to 3, leader changed from 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194) to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:26.961073   462 catalog_manager.cc:5697] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 2 to 3, leader changed from 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194) to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.000758   877 raft_consensus.cc:993] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598: : Instructing follower df4a2bbec58c4607bcd6bc90f24da6c9 to start an election
I20260709 13:00:27.001338   892 raft_consensus.cc:1081] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Signalling peer df4a2bbec58c4607bcd6bc90f24da6c9 to start an election
I20260709 13:00:27.003059   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887"
dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
 from {username='slave'} at 127.0.0.1:54350
I20260709 13:00:27.003609   715 raft_consensus.cc:493] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:27.003971   715 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.004273   877 raft_consensus.cc:993] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598: : Instructing follower 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:27.004827   892 raft_consensus.cc:1081] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 LEADER]: Signalling peer 99dcb9201d674f379f38b6b609a29f55 to start an election
I20260709 13:00:27.006600   564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1"
dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
 from {username='slave'} at 127.0.0.1:52548
I20260709 13:00:27.007154   564 raft_consensus.cc:493] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:27.007486   564 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.042138   564 raft_consensus.cc:515] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:27.042138   715 raft_consensus.cc:515] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:27.044965   564 leader_election.cc:290] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 5 election: Requested vote from peers df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195:40863), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:27.046155   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9"
I20260709 13:00:27.047260   714 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.047210   639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:27.049384   639 raft_consensus.cc:3055] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:00:27.049737   639 raft_consensus.cc:740] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:27.049701   564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09acacbb8b04b15adeec003aad88887" candidate_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "99dcb9201d674f379f38b6b609a29f55"
I20260709 13:00:27.049847   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c19b75e67f84497b4a6138358b330c1" candidate_uuid: "99dcb9201d674f379f38b6b609a29f55" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "8c8221909dbb46d2a6f41f14a753c598"
I20260709 13:00:27.046267   715 leader_election.cc:290] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 4 election: Requested vote from peers 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427), 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545)
I20260709 13:00:27.050742   640 raft_consensus.cc:3055] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:27.050686   639 consensus_queue.cc:260] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:27.051182   640 raft_consensus.cc:740] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c8221909dbb46d2a6f41f14a753c598, State: Running, Role: LEADER
I20260709 13:00:27.051882   639 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.052096   640 consensus_queue.cc:260] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:27.052538   564 raft_consensus.cc:3060] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:00:27.053296   640 raft_consensus.cc:3060] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:27.131911   566 raft_consensus.cc:1275] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Refusing update from remote peer df4a2bbec58c4607bcd6bc90f24da6c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.133620   891 consensus_queue.cc:1048] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:27.146278   641 raft_consensus.cc:1275] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Refusing update from remote peer df4a2bbec58c4607bcd6bc90f24da6c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.149469   564 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 4.
I20260709 13:00:27.150408   714 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 5.
I20260709 13:00:27.151800   532 leader_election.cc:304] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:27.152565   678 leader_election.cc:304] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99dcb9201d674f379f38b6b609a29f55, df4a2bbec58c4607bcd6bc90f24da6c9; no voters: 
I20260709 13:00:27.152805   901 raft_consensus.cc:2804] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:27.148665   891 consensus_queue.cc:1048] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:00:27.153604   907 raft_consensus.cc:2804] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:00:27.154044   639 raft_consensus.cc:2468] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4a2bbec58c4607bcd6bc90f24da6c9 in term 4.
I20260709 13:00:27.153672   901 raft_consensus.cc:697] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 5 LEADER]: Becoming Leader. State: Replica: 99dcb9201d674f379f38b6b609a29f55, State: Running, Role: LEADER
I20260709 13:00:27.155493   901 consensus_queue.cc:237] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } }
I20260709 13:00:27.156318   907 raft_consensus.cc:697] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 4 LEADER]: Becoming Leader. State: Replica: df4a2bbec58c4607bcd6bc90f24da6c9, State: Running, Role: LEADER
I20260709 13:00:27.157274   907 consensus_queue.cc:237] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } }
I20260709 13:00:27.176199   460 catalog_manager.cc:5697] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 reported cstate change: term changed from 4 to 5, leader changed from 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194) to 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "99dcb9201d674f379f38b6b609a29f55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:27.185501   462 catalog_manager.cc:5697] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 reported cstate change: term changed from 3 to 4, leader changed from 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194) to df4a2bbec58c4607bcd6bc90f24da6c9 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99dcb9201d674f379f38b6b609a29f55" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 37427 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:27.248237   640 raft_consensus.cc:2468] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99dcb9201d674f379f38b6b609a29f55 in term 5.
I20260709 13:00:27.340584   640 raft_consensus.cc:1275] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.342077   901 consensus_queue.cc:1048] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:27.353307   714 raft_consensus.cc:1275] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.354981   899 consensus_queue.cc:1048] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:27.481336   714 raft_consensus.cc:1275] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.483035   899 consensus_queue.cc:1048] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:27.494293   640 raft_consensus.cc:1275] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:27.496112   901 consensus_queue.cc:1048] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:27.553797   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:27.559044   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:00:27.587888   640 raft_consensus.cc:1275] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 5 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:00:27.589905   901 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:27.593768   640 raft_consensus.cc:1275] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 FOLLOWER]: Refusing update from remote peer df4a2bbec58c4607bcd6bc90f24da6c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:00:27.600422   907 consensus_queue.cc:1048] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c8221909dbb46d2a6f41f14a753c598" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41545 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:27.616595   714 raft_consensus.cc:1275] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 5 FOLLOWER]: Refusing update from remote peer 99dcb9201d674f379f38b6b609a29f55: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:00:27.617465   678 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:00:27.617592   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:27.619464   900 consensus_queue.cc:1048] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4a2bbec58c4607bcd6bc90f24da6c9" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:27.623396   431 tablet_replica.cc:333] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
I20260709 13:00:27.625955   431 raft_consensus.cc:2243] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.626986   431 raft_consensus.cc:2272] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 99dcb9201d674f379f38b6b609a29f55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.631430   431 tablet_replica.cc:333] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
I20260709 13:00:27.632397   431 raft_consensus.cc:2243] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:00:27.633142   678 consensus_peers.cc:597] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 -> Peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Couldn't send request to peer 99dcb9201d674f379f38b6b609a29f55. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:27.633531   431 raft_consensus.cc:2272] T 329a9841909f468280996643aacf35c4 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.636392   431 tablet_replica.cc:333] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
W20260709 13:00:27.637071   678 consensus_peers.cc:597] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 -> Peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Couldn't send request to peer 99dcb9201d674f379f38b6b609a29f55. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:27.637259   431 raft_consensus.cc:2243] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.637861   431 raft_consensus.cc:2272] T acc725db50024889bc0a60626d1fd6e5 P 99dcb9201d674f379f38b6b609a29f55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.640452   431 tablet_replica.cc:333] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
I20260709 13:00:27.641114   431 raft_consensus.cc:2243] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.641734   431 raft_consensus.cc:2272] T 57dee02a511d4ec69224adb44434a8a7 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.644003   431 tablet_replica.cc:333] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
I20260709 13:00:27.644730   431 raft_consensus.cc:2243] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.645408   431 raft_consensus.cc:2272] T 0cfea1b8377642998710874f9f020f08 P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.647845   431 tablet_replica.cc:333] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
I20260709 13:00:27.648517   431 raft_consensus.cc:2243] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:27.649291   431 raft_consensus.cc:2272] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.651890   431 tablet_replica.cc:333] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
I20260709 13:00:27.652565   431 raft_consensus.cc:2243] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.653060   431 raft_consensus.cc:2272] T f09acacbb8b04b15adeec003aad88887 P 99dcb9201d674f379f38b6b609a29f55 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.655157   431 tablet_replica.cc:333] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
I20260709 13:00:27.655681   431 raft_consensus.cc:2243] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:00:27.656595   431 raft_consensus.cc:2272] T 2c19b75e67f84497b4a6138358b330c1 P 99dcb9201d674f379f38b6b609a29f55 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.659206   431 tablet_replica.cc:333] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55: stopping tablet replica
I20260709 13:00:27.659713   431 raft_consensus.cc:2243] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.660203   431 raft_consensus.cc:2272] T 965be54504314193800a99ead8d7b03f P 99dcb9201d674f379f38b6b609a29f55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.785590   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:00:27.787879   678 consensus_peers.cc:597] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 -> Peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Couldn't send request to peer 99dcb9201d674f379f38b6b609a29f55. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:27.788071   604 consensus_peers.cc:597] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 -> Peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Couldn't send request to peer 99dcb9201d674f379f38b6b609a29f55. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:27.788673   604 consensus_peers.cc:597] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 -> Peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Couldn't send request to peer 99dcb9201d674f379f38b6b609a29f55. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:27.791663   604 consensus_peers.cc:597] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 -> Peer 99dcb9201d674f379f38b6b609a29f55 (127.0.107.193:37427): Couldn't send request to peer 99dcb9201d674f379f38b6b609a29f55. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:37427: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:27.808422   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:00:27.831851   680 consensus_peers.cc:597] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 -> Peer 8c8221909dbb46d2a6f41f14a753c598 (127.0.107.194:41545): Couldn't send request to peer 8c8221909dbb46d2a6f41f14a753c598. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:27.841638   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:27.842551   431 tablet_replica.cc:333] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.843330   431 raft_consensus.cc:2243] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.843904   431 raft_consensus.cc:2272] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P 8c8221909dbb46d2a6f41f14a753c598 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.845947   431 tablet_replica.cc:333] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.846493   431 raft_consensus.cc:2243] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.846927   431 raft_consensus.cc:2272] T 329a9841909f468280996643aacf35c4 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.849233   431 tablet_replica.cc:333] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.849802   431 raft_consensus.cc:2243] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:27.850557   431 raft_consensus.cc:2272] T 0cfea1b8377642998710874f9f020f08 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.852185   431 tablet_replica.cc:333] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.852738   431 raft_consensus.cc:2243] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:27.853494   431 raft_consensus.cc:2272] T acc725db50024889bc0a60626d1fd6e5 P 8c8221909dbb46d2a6f41f14a753c598 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.854996   431 tablet_replica.cc:333] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.855494   431 raft_consensus.cc:2243] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.855917   431 raft_consensus.cc:2272] T 57dee02a511d4ec69224adb44434a8a7 P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.858191   431 tablet_replica.cc:333] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.858667   431 raft_consensus.cc:2243] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.859053   431 raft_consensus.cc:2272] T 2c19b75e67f84497b4a6138358b330c1 P 8c8221909dbb46d2a6f41f14a753c598 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.861176   431 tablet_replica.cc:333] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.861713   431 raft_consensus.cc:2243] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.862114   431 raft_consensus.cc:2272] T f09acacbb8b04b15adeec003aad88887 P 8c8221909dbb46d2a6f41f14a753c598 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.864391   431 tablet_replica.cc:333] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.864885   431 raft_consensus.cc:2243] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.865283   431 raft_consensus.cc:2272] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.867357   431 tablet_replica.cc:333] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598: stopping tablet replica
I20260709 13:00:27.867839   431 raft_consensus.cc:2243] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:27.868652   431 raft_consensus.cc:2272] T 965be54504314193800a99ead8d7b03f P 8c8221909dbb46d2a6f41f14a753c598 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.897747   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:00:27.914685   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:00:27.952356   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:27.953090   431 tablet_replica.cc:333] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.953708   431 raft_consensus.cc:2243] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.954186   431 raft_consensus.cc:2272] T 0cfea1b8377642998710874f9f020f08 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.955853   431 tablet_replica.cc:333] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.956437   431 raft_consensus.cc:2243] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.956881   431 raft_consensus.cc:2272] T e9de7ac0ccfc4e56aa9dcc6bb8cc609e P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.959501   431 tablet_replica.cc:333] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.960003   431 raft_consensus.cc:2243] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:27.960788   431 raft_consensus.cc:2272] T 5f58d697b30c4a80aa5eb3a51c6e1fbd P df4a2bbec58c4607bcd6bc90f24da6c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.962293   431 tablet_replica.cc:333] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.962780   431 raft_consensus.cc:2243] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:00:27.963502   431 raft_consensus.cc:2272] T f09acacbb8b04b15adeec003aad88887 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.965502   431 tablet_replica.cc:333] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.966027   431 raft_consensus.cc:2243] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.966428   431 raft_consensus.cc:2272] T 2c19b75e67f84497b4a6138358b330c1 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.968386   431 tablet_replica.cc:333] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.968861   431 raft_consensus.cc:2243] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:27.969522   431 raft_consensus.cc:2272] T 57dee02a511d4ec69224adb44434a8a7 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.971262   431 tablet_replica.cc:333] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.971712   431 raft_consensus.cc:2243] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.972182   431 raft_consensus.cc:2272] T acc725db50024889bc0a60626d1fd6e5 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.973709   431 tablet_replica.cc:333] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.974146   431 raft_consensus.cc:2243] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.974526   431 raft_consensus.cc:2272] T 329a9841909f468280996643aacf35c4 P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:27.976679   431 tablet_replica.cc:333] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9: stopping tablet replica
I20260709 13:00:27.977118   431 raft_consensus.cc:2243] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:27.977515   431 raft_consensus.cc:2272] T 965be54504314193800a99ead8d7b03f P df4a2bbec58c4607bcd6bc90f24da6c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.004878   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:00:28.022778   431 master.cc:562] Master@127.0.107.254:37183 shutting down...
I20260709 13:00:28.235291   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:28.236078   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:28.236446   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 813fe3d24de34cf99ce8e633903e694c: stopping tablet replica
I20260709 13:00:28.258630   431 master.cc:584] Master@127.0.107.254:37183 shutdown complete.
8c8221909dbb46d2a6f41f14a753c598  4
99dcb9201d674f379f38b6b609a29f55  4
df4a2bbec58c4607bcd6bc90f24da6c9  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13519 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:00:28.306871   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43877
I20260709 13:00:28.308248   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:28.315620   925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:28.316840   926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:28.318224   928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:28.319324   431 server_base.cc:1061] running on GCE node
I20260709 13:00:28.320499   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:28.320713   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:28.320855   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602028320843 us; error 0 us; skew 500 ppm
I20260709 13:00:28.321424   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:28.324736   431 webserver.cc:533] Webserver started at http://127.0.107.254:34009/ using document root <none> and password file <none>
I20260709 13:00:28.325313   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:28.325517   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:28.325785   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:28.327359   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/master-0-root/instance:
uuid: "fccf684c8ea7400b97a21c14752e391b"
format_stamp: "Formatted at 2026-07-09 13:00:28 on dist-test-slave-smzk"
I20260709 13:00:28.333163   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:00:28.337283   933 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.338254   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:00:28.338605   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/master-0-root
uuid: "fccf684c8ea7400b97a21c14752e391b"
format_stamp: "Formatted at 2026-07-09 13:00:28 on dist-test-slave-smzk"
I20260709 13:00:28.338941   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:28.352367   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:28.353946   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:28.402755   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43877
I20260709 13:00:28.402859   984 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43877 every 8 connection(s)
I20260709 13:00:28.407353   985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:28.416899   985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b: Bootstrap starting.
I20260709 13:00:28.422439   985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:28.427270   985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b: No bootstrap required, opened a new log
I20260709 13:00:28.429557   985 raft_consensus.cc:359] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccf684c8ea7400b97a21c14752e391b" member_type: VOTER }
I20260709 13:00:28.429947   985 raft_consensus.cc:385] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:28.430400   985 raft_consensus.cc:740] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fccf684c8ea7400b97a21c14752e391b, State: Initialized, Role: FOLLOWER
I20260709 13:00:28.431241   985 consensus_queue.cc:260] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccf684c8ea7400b97a21c14752e391b" member_type: VOTER }
I20260709 13:00:28.431756   985 raft_consensus.cc:399] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:28.432003   985 raft_consensus.cc:493] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:28.432396   985 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:28.436781   985 raft_consensus.cc:515] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccf684c8ea7400b97a21c14752e391b" member_type: VOTER }
I20260709 13:00:28.437551   985 leader_election.cc:304] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fccf684c8ea7400b97a21c14752e391b; no voters: 
I20260709 13:00:28.438902   985 leader_election.cc:290] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:28.439456   988 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:28.441367   988 raft_consensus.cc:697] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 1 LEADER]: Becoming Leader. State: Replica: fccf684c8ea7400b97a21c14752e391b, State: Running, Role: LEADER
I20260709 13:00:28.442152   988 consensus_queue.cc:237] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccf684c8ea7400b97a21c14752e391b" member_type: VOTER }
I20260709 13:00:28.442402   985 sys_catalog.cc:565] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:28.447753   989 sys_catalog.cc:455] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fccf684c8ea7400b97a21c14752e391b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccf684c8ea7400b97a21c14752e391b" member_type: VOTER } }
I20260709 13:00:28.447525   990 sys_catalog.cc:455] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fccf684c8ea7400b97a21c14752e391b. Latest consensus state: current_term: 1 leader_uuid: "fccf684c8ea7400b97a21c14752e391b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fccf684c8ea7400b97a21c14752e391b" member_type: VOTER } }
I20260709 13:00:28.448470   989 sys_catalog.cc:458] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:28.448701   990 sys_catalog.cc:458] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:28.454100   997 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:28.461488   997 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:28.462553   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:28.472484   997 catalog_manager.cc:1383] Generated new cluster ID: 7d313589856e4b269fe0bcb67cc45f76
I20260709 13:00:28.472857   997 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:28.490401   997 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:28.492087   997 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:28.508279   997 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b: Generated new TSK 0
I20260709 13:00:28.509007   997 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:28.529798   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:28.536391  1006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:28.537650  1007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:28.539495  1009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:28.539779   431 server_base.cc:1061] running on GCE node
I20260709 13:00:28.540863   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:28.541057   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:28.541275   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602028541256 us; error 0 us; skew 500 ppm
I20260709 13:00:28.541783   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:28.544523   431 webserver.cc:533] Webserver started at http://127.0.107.193:34777/ using document root <none> and password file <none>
I20260709 13:00:28.545045   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:28.545218   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:28.545439   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:28.546531   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-0-root/instance:
uuid: "2fbda475cbb14c289719303c1a145430"
format_stamp: "Formatted at 2026-07-09 13:00:28 on dist-test-slave-smzk"
I20260709 13:00:28.551378   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:00:28.555202  1014 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.556337   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:00:28.556686   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "2fbda475cbb14c289719303c1a145430"
format_stamp: "Formatted at 2026-07-09 13:00:28 on dist-test-slave-smzk"
I20260709 13:00:28.556979   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:28.573017   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:28.574268   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:28.575848   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:28.578219   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:28.578450   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.578696   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:28.578891   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.623019   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:36033
I20260709 13:00:28.623195  1076 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:36033 every 8 connection(s)
I20260709 13:00:28.627971   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:28.635445  1081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:28.637290  1082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:28.641709   431 server_base.cc:1061] running on GCE node
W20260709 13:00:28.641732  1084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:28.643568   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:28.643841   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:28.644084   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602028644041 us; error 0 us; skew 500 ppm
I20260709 13:00:28.644671   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:28.648144   431 webserver.cc:533] Webserver started at http://127.0.107.194:39331/ using document root <none> and password file <none>
I20260709 13:00:28.648653   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:28.648837  1077 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43877
I20260709 13:00:28.648864   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:28.649389  1077 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:28.649434   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:28.650377  1077 heartbeater.cc:507] Master 127.0.107.254:43877 requested a full tablet report, sending...
I20260709 13:00:28.650869   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-1-root/instance:
uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
format_stamp: "Formatted at 2026-07-09 13:00:28 on dist-test-slave-smzk"
I20260709 13:00:28.652854   950 ts_manager.cc:194] Registered new tserver with Master: 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033)
I20260709 13:00:28.655606   950 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37756
I20260709 13:00:28.656152   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:00:28.659937  1089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.660882   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:00:28.661276   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-1-root
uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
format_stamp: "Formatted at 2026-07-09 13:00:28 on dist-test-slave-smzk"
I20260709 13:00:28.661583   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:28.674917   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:28.676224   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:28.677707   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:28.679862   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:28.680114   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:00:28.680365   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:28.680532   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.740448   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:42115
I20260709 13:00:28.740553  1151 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:42115 every 8 connection(s)
I20260709 13:00:28.745577   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:28.753824  1155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:28.754357  1156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:28.757867  1158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:28.758713   431 server_base.cc:1061] running on GCE node
I20260709 13:00:28.759838   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:28.760164   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:28.760432   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602028760396 us; error 0 us; skew 500 ppm
I20260709 13:00:28.761180   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:28.762971  1152 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43877
I20260709 13:00:28.763494  1152 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:28.764374   431 webserver.cc:533] Webserver started at http://127.0.107.195:43541/ using document root <none> and password file <none>
I20260709 13:00:28.764407  1152 heartbeater.cc:507] Master 127.0.107.254:43877 requested a full tablet report, sending...
I20260709 13:00:28.765045   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:28.765281   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:28.765642   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:28.766963   950 ts_manager.cc:194] Registered new tserver with Master: 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:28.766999   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-2-root/instance:
uuid: "c81db94744664de59acdc71a69f056b3"
format_stamp: "Formatted at 2026-07-09 13:00:28 on dist-test-slave-smzk"
I20260709 13:00:28.768798   950 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37766
I20260709 13:00:28.772205   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:00:28.775833  1163 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.776856   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:00:28.777220   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-2-root
uuid: "c81db94744664de59acdc71a69f056b3"
format_stamp: "Formatted at 2026-07-09 13:00:28 on dist-test-slave-smzk"
I20260709 13:00:28.777616   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602014598663-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:28.811542   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:28.812991   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:28.814699   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:28.817132   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:28.817370   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.817672   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:28.817863   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:28.869783   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:41389
I20260709 13:00:28.869900  1225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:41389 every 8 connection(s)
I20260709 13:00:28.885779  1226 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43877
I20260709 13:00:28.886183  1226 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:28.887004  1226 heartbeater.cc:507] Master 127.0.107.254:43877 requested a full tablet report, sending...
I20260709 13:00:28.889124   950 ts_manager.cc:194] Registered new tserver with Master: c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:28.889561   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016308478s
I20260709 13:00:28.890640   950 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37778
I20260709 13:00:28.919703   950 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:28.922922   950 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:29.006705  1115 tablet_service.cc:1511] Processing CreateTablet for tablet 35f807e59c6c4b2186b972fd4adbaa84 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:29.007328  1117 tablet_service.cc:1511] Processing CreateTablet for tablet 91a71bdf082c480b810fc03b5b095e00 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:29.008277  1115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f807e59c6c4b2186b972fd4adbaa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.009761  1116 tablet_service.cc:1511] Processing CreateTablet for tablet 9092a456dc574775a2bd8b9798acdea7 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:29.011170  1116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9092a456dc574775a2bd8b9798acdea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.014248  1114 tablet_service.cc:1511] Processing CreateTablet for tablet 19489b6ebc4f4c2cbfc864d14f0737be (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:29.015652  1114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19489b6ebc4f4c2cbfc864d14f0737be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.017818  1117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a71bdf082c480b810fc03b5b095e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.020936  1042 tablet_service.cc:1511] Processing CreateTablet for tablet 91a71bdf082c480b810fc03b5b095e00 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:29.022423  1042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a71bdf082c480b810fc03b5b095e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.025318  1041 tablet_service.cc:1511] Processing CreateTablet for tablet 9092a456dc574775a2bd8b9798acdea7 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:29.026810  1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9092a456dc574775a2bd8b9798acdea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.029210  1040 tablet_service.cc:1511] Processing CreateTablet for tablet 35f807e59c6c4b2186b972fd4adbaa84 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:29.033367  1038 tablet_service.cc:1511] Processing CreateTablet for tablet a25fdef429e74bdba745cb70b431b277 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:29.034963  1189 tablet_service.cc:1511] Processing CreateTablet for tablet 35f807e59c6c4b2186b972fd4adbaa84 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:00:29.036907  1189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f807e59c6c4b2186b972fd4adbaa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.036463  1188 tablet_service.cc:1511] Processing CreateTablet for tablet 19489b6ebc4f4c2cbfc864d14f0737be (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:29.037842  1036 tablet_service.cc:1511] Processing CreateTablet for tablet 72c4a7d30b0543299a291bdc7c5b55a3 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:29.034963  1191 tablet_service.cc:1511] Processing CreateTablet for tablet 91a71bdf082c480b810fc03b5b095e00 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:00:29.039177  1190 tablet_service.cc:1511] Processing CreateTablet for tablet 9092a456dc574775a2bd8b9798acdea7 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:00:29.040671  1035 tablet_service.cc:1511] Processing CreateTablet for tablet 65ef3056caec4e969589d5cceba470e1 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:29.040983  1187 tablet_service.cc:1511] Processing CreateTablet for tablet a25fdef429e74bdba745cb70b431b277 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:29.041533  1186 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd2ec4f198e4b5e86c4e3960ea0d11a (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:29.043362  1034 tablet_service.cc:1511] Processing CreateTablet for tablet f8c8bd07a5df4bfcb92eabe64bdac3b6 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:29.045681  1182 tablet_service.cc:1511] Processing CreateTablet for tablet 3953d04bf0d74ae093fdb93bf9d6463e (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:29.046249  1184 tablet_service.cc:1511] Processing CreateTablet for tablet 65ef3056caec4e969589d5cceba470e1 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:29.046927  1033 tablet_service.cc:1511] Processing CreateTablet for tablet 3953d04bf0d74ae093fdb93bf9d6463e (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:29.047946  1183 tablet_service.cc:1511] Processing CreateTablet for tablet f8c8bd07a5df4bfcb92eabe64bdac3b6 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:29.050447  1113 tablet_service.cc:1511] Processing CreateTablet for tablet a25fdef429e74bdba745cb70b431b277 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:00:29.053380  1112 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd2ec4f198e4b5e86c4e3960ea0d11a (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:29.035756  1037 tablet_service.cc:1511] Processing CreateTablet for tablet 8bd2ec4f198e4b5e86c4e3960ea0d11a (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:00:29.051931  1113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25fdef429e74bdba745cb70b431b277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.031688  1039 tablet_service.cc:1511] Processing CreateTablet for tablet 19489b6ebc4f4c2cbfc864d14f0737be (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:00:29.044523  1185 tablet_service.cc:1511] Processing CreateTablet for tablet 72c4a7d30b0543299a291bdc7c5b55a3 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:29.037873  1188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19489b6ebc4f4c2cbfc864d14f0737be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.064769  1112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd2ec4f198e4b5e86c4e3960ea0d11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.065255  1183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c8bd07a5df4bfcb92eabe64bdac3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.056411  1111 tablet_service.cc:1511] Processing CreateTablet for tablet 72c4a7d30b0543299a291bdc7c5b55a3 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:00:29.066121  1187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25fdef429e74bdba745cb70b431b277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.057230  1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f807e59c6c4b2186b972fd4adbaa84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.069200  1036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c4a7d30b0543299a291bdc7c5b55a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.069721  1184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ef3056caec4e969589d5cceba470e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.071383  1182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3953d04bf0d74ae093fdb93bf9d6463e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.070969  1109 tablet_service.cc:1511] Processing CreateTablet for tablet f8c8bd07a5df4bfcb92eabe64bdac3b6 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:00:29.071008  1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19489b6ebc4f4c2cbfc864d14f0737be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.073338  1110 tablet_service.cc:1511] Processing CreateTablet for tablet 65ef3056caec4e969589d5cceba470e1 (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:00:29.075853  1035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ef3056caec4e969589d5cceba470e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.077070  1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25fdef429e74bdba745cb70b431b277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.078310  1033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3953d04bf0d74ae093fdb93bf9d6463e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.079742  1034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c8bd07a5df4bfcb92eabe64bdac3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.081177  1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd2ec4f198e4b5e86c4e3960ea0d11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.082595  1191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91a71bdf082c480b810fc03b5b095e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.085364  1185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c4a7d30b0543299a291bdc7c5b55a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.086861  1190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9092a456dc574775a2bd8b9798acdea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.089154  1186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bd2ec4f198e4b5e86c4e3960ea0d11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.114418  1108 tablet_service.cc:1511] Processing CreateTablet for tablet 3953d04bf0d74ae093fdb93bf9d6463e (DEFAULT_TABLE table=test-workload [id=2dc30c932fea4fca9a0900b3ac01f54c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:00:29.130411  1241 tablet_bootstrap.cc:492] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.131651  1110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ef3056caec4e969589d5cceba470e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.134737  1111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c4a7d30b0543299a291bdc7c5b55a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.136437  1109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c8bd07a5df4bfcb92eabe64bdac3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.138119  1108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3953d04bf0d74ae093fdb93bf9d6463e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:29.180975  1243 tablet_bootstrap.cc:492] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:29.197237  1243 tablet_bootstrap.cc:654] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.219565  1241 tablet_bootstrap.cc:654] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.220335  1242 tablet_bootstrap.cc:492] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.250531  1243 tablet_bootstrap.cc:492] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:29.251127  1243 ts_tablet_manager.cc:1403] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.071s	user 0.005s	sys 0.028s
I20260709 13:00:29.257534  1243 raft_consensus.cc:359] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.259140  1243 raft_consensus.cc:385] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.259435  1243 raft_consensus.cc:740] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.260221  1243 consensus_queue.cc:260] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.267053  1242 tablet_bootstrap.cc:654] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.282105  1241 tablet_bootstrap.cc:492] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.282577  1241 ts_tablet_manager.cc:1403] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.012s
I20260709 13:00:29.285367  1241 raft_consensus.cc:359] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.286052  1241 raft_consensus.cc:385] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.286358  1241 raft_consensus.cc:740] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.287096  1241 consensus_queue.cc:260] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.291641  1226 heartbeater.cc:499] Master 127.0.107.254:43877 was elected leader, sending a full tablet report...
I20260709 13:00:29.291868  1243 ts_tablet_manager.cc:1434] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:00:29.292454  1152 heartbeater.cc:499] Master 127.0.107.254:43877 was elected leader, sending a full tablet report...
I20260709 13:00:29.292979  1241 ts_tablet_manager.cc:1434] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.001s
I20260709 13:00:29.294752  1243 tablet_bootstrap.cc:492] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:29.294910  1241 tablet_bootstrap.cc:492] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.301831  1241 tablet_bootstrap.cc:654] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.301930  1243 tablet_bootstrap.cc:654] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.293475  1242 tablet_bootstrap.cc:492] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:29.302714  1242 ts_tablet_manager.cc:1403] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.083s	user 0.013s	sys 0.015s
I20260709 13:00:29.306025  1242 raft_consensus.cc:359] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:29.306800  1242 raft_consensus.cc:385] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.307123  1242 raft_consensus.cc:740] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.308203  1242 consensus_queue.cc:260] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:29.313742  1077 heartbeater.cc:499] Master 127.0.107.254:43877 was elected leader, sending a full tablet report...
I20260709 13:00:29.316124  1241 tablet_bootstrap.cc:492] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.317836  1241 ts_tablet_manager.cc:1403] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.010s
I20260709 13:00:29.320878  1241 raft_consensus.cc:359] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:29.321738  1241 raft_consensus.cc:385] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.322078  1241 raft_consensus.cc:740] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.322913  1241 consensus_queue.cc:260] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:29.313688  1242 ts_tablet_manager.cc:1434] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:29.326203  1241 ts_tablet_manager.cc:1434] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:29.326998  1242 tablet_bootstrap.cc:492] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.327337  1241 tablet_bootstrap.cc:492] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.338397  1242 tablet_bootstrap.cc:654] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.339164  1243 tablet_bootstrap.cc:492] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:29.339764  1243 ts_tablet_manager.cc:1403] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.016s
I20260709 13:00:29.340447  1241 tablet_bootstrap.cc:654] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.343698  1243 raft_consensus.cc:359] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.344828  1243 raft_consensus.cc:385] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.345223  1243 raft_consensus.cc:740] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.346522  1243 consensus_queue.cc:260] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.349120  1243 ts_tablet_manager.cc:1434] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:00:29.350152  1243 tablet_bootstrap.cc:492] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:29.357012  1242 tablet_bootstrap.cc:492] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:29.357460  1243 tablet_bootstrap.cc:654] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.357694  1242 ts_tablet_manager.cc:1403] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.002s
I20260709 13:00:29.363976  1242 raft_consensus.cc:359] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.364779  1242 raft_consensus.cc:385] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.365105  1242 raft_consensus.cc:740] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.366026  1242 consensus_queue.cc:260] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.366600  1243 tablet_bootstrap.cc:492] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:29.367165  1243 ts_tablet_manager.cc:1403] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 13:00:29.368674  1242 ts_tablet_manager.cc:1434] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:00:29.369028  1241 tablet_bootstrap.cc:492] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.369451  1241 ts_tablet_manager.cc:1403] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.042s	user 0.027s	sys 0.002s
I20260709 13:00:29.369660  1242 tablet_bootstrap.cc:492] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.370375  1243 raft_consensus.cc:359] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.371158  1243 raft_consensus.cc:385] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.371449  1243 raft_consensus.cc:740] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.372416  1241 raft_consensus.cc:359] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.372434  1243 consensus_queue.cc:260] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.373503  1241 raft_consensus.cc:385] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.373869  1241 raft_consensus.cc:740] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.374634  1241 consensus_queue.cc:260] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.376356  1243 ts_tablet_manager.cc:1434] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.006s
I20260709 13:00:29.376838  1241 ts_tablet_manager.cc:1434] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:00:29.377817  1241 tablet_bootstrap.cc:492] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.378862  1243 tablet_bootstrap.cc:492] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:29.384738  1241 tablet_bootstrap.cc:654] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.386361  1243 tablet_bootstrap.cc:654] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.386889  1242 tablet_bootstrap.cc:654] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.392127  1248 raft_consensus.cc:493] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.392844  1248 raft_consensus.cc:515] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.396402  1241 tablet_bootstrap.cc:492] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.396907  1241 ts_tablet_manager.cc:1403] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:00:29.397782  1242 tablet_bootstrap.cc:492] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:29.398327  1242 ts_tablet_manager.cc:1403] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.029s	user 0.002s	sys 0.012s
I20260709 13:00:29.399956  1241 raft_consensus.cc:359] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.400897  1241 raft_consensus.cc:385] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.401304  1241 raft_consensus.cc:740] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.401499  1242 raft_consensus.cc:359] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.402338  1241 consensus_queue.cc:260] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.403683  1248 leader_election.cc:290] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:29.404892  1241 ts_tablet_manager.cc:1434] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:00:29.414059  1241 tablet_bootstrap.cc:492] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.403048  1242 raft_consensus.cc:385] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.420914  1242 raft_consensus.cc:740] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.422132  1242 consensus_queue.cc:260] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.424819  1242 ts_tablet_manager.cc:1434] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 13:00:29.425863  1242 tablet_bootstrap.cc:492] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.435132  1242 tablet_bootstrap.cc:654] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.437676  1241 tablet_bootstrap.cc:654] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.455386  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
W20260709 13:00:29.455664   998 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:29.456445  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
W20260709 13:00:29.457116  1167 leader_election.cc:343] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.457217  1052 raft_consensus.cc:2468] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 0.
I20260709 13:00:29.459648  1164 leader_election.cc:304] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 1364f58c0f5b4485bc819bfd3ecb3962
I20260709 13:00:29.460420  1248 raft_consensus.cc:2804] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.460788  1248 raft_consensus.cc:493] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.461138  1248 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.461236  1241 tablet_bootstrap.cc:492] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.461248  1243 tablet_bootstrap.cc:492] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:29.461654  1242 tablet_bootstrap.cc:492] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:29.462214  1241 ts_tablet_manager.cc:1403] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.000s
I20260709 13:00:29.462347  1242 ts_tablet_manager.cc:1403] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.015s
I20260709 13:00:29.462256  1243 ts_tablet_manager.cc:1403] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.085s	user 0.037s	sys 0.035s
I20260709 13:00:29.466005  1242 raft_consensus.cc:359] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.466799  1242 raft_consensus.cc:385] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.466348  1241 raft_consensus.cc:359] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.466464  1243 raft_consensus.cc:359] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.467166  1242 raft_consensus.cc:740] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.467317  1241 raft_consensus.cc:385] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.467382  1243 raft_consensus.cc:385] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.467813  1241 raft_consensus.cc:740] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.467861  1243 raft_consensus.cc:740] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.468461  1248 raft_consensus.cc:515] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.468128  1242 consensus_queue.cc:260] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.468847  1243 consensus_queue.cc:260] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.470597  1248 leader_election.cc:290] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:29.472906  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:29.473881  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430"
W20260709 13:00:29.474273  1167 leader_election.cc:343] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.474718  1052 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.476261  1242 ts_tablet_manager.cc:1434] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:00:29.477288  1242 tablet_bootstrap.cc:492] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.468887  1241 consensus_queue.cc:260] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.483958  1242 tablet_bootstrap.cc:654] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.484808  1241 ts_tablet_manager.cc:1434] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:00:29.485891  1241 tablet_bootstrap.cc:492] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.490435  1247 raft_consensus.cc:493] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.490324  1052 raft_consensus.cc:2468] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 1.
I20260709 13:00:29.491138  1247 raft_consensus.cc:515] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.492432  1164 leader_election.cc:304] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 1364f58c0f5b4485bc819bfd3ecb3962
I20260709 13:00:29.495188  1241 tablet_bootstrap.cc:654] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.498895  1262 raft_consensus.cc:2804] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.499486  1262 raft_consensus.cc:697] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Becoming Leader. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:29.500548  1243 ts_tablet_manager.cc:1434] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.037s	user 0.028s	sys 0.004s
I20260709 13:00:29.500766  1247 leader_election.cc:290] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.500373  1262 consensus_queue.cc:237] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.504256  1243 tablet_bootstrap.cc:492] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:29.512377  1251 raft_consensus.cc:493] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.513113  1251 raft_consensus.cc:515] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.517717   949 catalog_manager.cc:5697] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c81db94744664de59acdc71a69f056b3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c81db94744664de59acdc71a69f056b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.518610  1251 leader_election.cc:290] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.526741  1243 tablet_bootstrap.cc:654] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.528630  1242 tablet_bootstrap.cc:492] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:29.537184  1242 ts_tablet_manager.cc:1403] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.060s	user 0.014s	sys 0.004s
I20260709 13:00:29.542426  1241 tablet_bootstrap.cc:492] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.543195  1241 ts_tablet_manager.cc:1403] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.058s	user 0.026s	sys 0.010s
I20260709 13:00:29.544785  1262 raft_consensus.cc:493] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.545383  1262 raft_consensus.cc:515] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.542028  1242 raft_consensus.cc:359] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.554494  1242 raft_consensus.cc:385] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.555071  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.556071  1052 raft_consensus.cc:2468] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 0.
I20260709 13:00:29.557410  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.558342  1201 raft_consensus.cc:2468] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 0.
I20260709 13:00:29.560341  1164 leader_election.cc:304] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:29.560611  1093 leader_election.cc:304] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:29.561406  1248 raft_consensus.cc:2804] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.561825  1248 raft_consensus.cc:493] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.555119  1242 raft_consensus.cc:740] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.562261  1248 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.562723  1242 consensus_queue.cc:260] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.565069  1242 ts_tablet_manager.cc:1434] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:00:29.562106  1247 raft_consensus.cc:2804] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.566268  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:29.566954  1247 raft_consensus.cc:493] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.561432  1262 leader_election.cc:290] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:29.567319  1247 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.568658  1241 raft_consensus.cc:359] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.569481  1241 raft_consensus.cc:385] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.576020  1248 raft_consensus.cc:515] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.578840  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:29.579026  1247 raft_consensus.cc:515] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.579449  1052 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.580191  1127 raft_consensus.cc:2393] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c81db94744664de59acdc71a69f056b3 in current term 1: Already voted for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in this term.
I20260709 13:00:29.589757  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:29.590198  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:29.590920  1201 raft_consensus.cc:2393] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1364f58c0f5b4485bc819bfd3ecb3962 in current term 1: Already voted for candidate c81db94744664de59acdc71a69f056b3 in this term.
I20260709 13:00:29.591439  1127 raft_consensus.cc:2393] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c81db94744664de59acdc71a69f056b3 in current term 1: Already voted for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in this term.
I20260709 13:00:29.569761  1241 raft_consensus.cc:740] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.593447  1241 consensus_queue.cc:260] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.594309  1247 leader_election.cc:290] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.594700  1248 leader_election.cc:290] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:29.601727  1052 raft_consensus.cc:2468] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 1.
I20260709 13:00:29.599670  1242 tablet_bootstrap.cc:492] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.603528  1164 leader_election.cc:304] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 1364f58c0f5b4485bc819bfd3ecb3962
I20260709 13:00:29.606236  1243 tablet_bootstrap.cc:492] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:29.606812  1243 ts_tablet_manager.cc:1403] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.103s	user 0.028s	sys 0.024s
I20260709 13:00:29.609730  1248 raft_consensus.cc:2804] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.609876  1251 raft_consensus.cc:493] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.610713  1248 raft_consensus.cc:697] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Becoming Leader. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:29.610519  1251 raft_consensus.cc:515] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:29.611377  1242 tablet_bootstrap.cc:654] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.612903  1251 leader_election.cc:290] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.612957  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.613821  1052 raft_consensus.cc:2393] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364f58c0f5b4485bc819bfd3ecb3962 in current term 1: Already voted for candidate c81db94744664de59acdc71a69f056b3 in this term.
I20260709 13:00:29.614081  1248 consensus_queue.cc:237] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.614522  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:29.609826  1243 raft_consensus.cc:359] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.615214  1243 raft_consensus.cc:385] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.615468  1051 raft_consensus.cc:2393] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1364f58c0f5b4485bc819bfd3ecb3962 in current term 1: Already voted for candidate c81db94744664de59acdc71a69f056b3 in this term.
I20260709 13:00:29.615562  1243 raft_consensus.cc:740] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.616422  1243 consensus_queue.cc:260] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.619014  1243 ts_tablet_manager.cc:1434] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:00:29.620112  1243 tablet_bootstrap.cc:492] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:29.624554  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:29.625532  1127 raft_consensus.cc:2393] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbda475cbb14c289719303c1a145430 in current term 1: Already voted for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in this term.
I20260709 13:00:29.627827  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.628319  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.629541  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:29.623602  1090 leader_election.cc:304] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962; no voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3
I20260709 13:00:29.630229  1127 raft_consensus.cc:2468] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 0.
I20260709 13:00:29.630976  1247 raft_consensus.cc:2749] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:29.629689  1243 tablet_bootstrap.cc:654] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.630188  1018 leader_election.cc:304] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbda475cbb14c289719303c1a145430; no voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3
W20260709 13:00:29.634575  1018 leader_election.cc:343] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.634724  1251 raft_consensus.cc:2749] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:29.635367  1018 leader_election.cc:304] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: c81db94744664de59acdc71a69f056b3
I20260709 13:00:29.637749  1241 ts_tablet_manager.cc:1434] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.094s	user 0.011s	sys 0.001s
I20260709 13:00:29.638540  1251 raft_consensus.cc:2804] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.639147  1251 raft_consensus.cc:493] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.641268  1251 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.638767  1241 tablet_bootstrap.cc:492] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.645059   948 catalog_manager.cc:5697] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c81db94744664de59acdc71a69f056b3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c81db94744664de59acdc71a69f056b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.647626  1241 tablet_bootstrap.cc:654] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.652001  1242 tablet_bootstrap.cc:492] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:29.652559  1242 ts_tablet_manager.cc:1403] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.001s
I20260709 13:00:29.654716  1251 raft_consensus.cc:515] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:29.657270  1243 tablet_bootstrap.cc:492] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:29.658546  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:29.659027  1243 ts_tablet_manager.cc:1403] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.004s
I20260709 13:00:29.659370  1127 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.660346  1242 raft_consensus.cc:359] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.661170  1242 raft_consensus.cc:385] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.661509  1242 raft_consensus.cc:740] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.662249  1242 consensus_queue.cc:260] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.662865  1241 tablet_bootstrap.cc:492] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.664479  1241 ts_tablet_manager.cc:1403] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 13:00:29.665271  1243 raft_consensus.cc:359] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.666246  1243 raft_consensus.cc:385] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.666615  1243 raft_consensus.cc:740] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.667328  1127 raft_consensus.cc:2468] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 1.
I20260709 13:00:29.667625  1241 raft_consensus.cc:359] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.668406  1241 raft_consensus.cc:385] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.667790  1243 consensus_queue.cc:260] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.668743  1241 raft_consensus.cc:740] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.668830  1018 leader_election.cc:304] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:29.669730  1241 consensus_queue.cc:260] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.670430  1251 leader_election.cc:290] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.671238  1251 raft_consensus.cc:2804] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.671675  1251 raft_consensus.cc:697] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:29.672487  1251 consensus_queue.cc:237] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:29.677330  1241 ts_tablet_manager.cc:1434] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:00:29.678330  1241 tablet_bootstrap.cc:492] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.678400  1248 raft_consensus.cc:493] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.679126  1248 raft_consensus.cc:515] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.682150  1242 ts_tablet_manager.cc:1434] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.015s
I20260709 13:00:29.683455  1242 tablet_bootstrap.cc:492] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.684010  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c8bd07a5df4bfcb92eabe64bdac3b6" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.684301  1248 leader_election.cc:290] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:29.686427  1243 ts_tablet_manager.cc:1434] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 13:00:29.687400  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c8bd07a5df4bfcb92eabe64bdac3b6" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:29.687696  1241 tablet_bootstrap.cc:654] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:29.689474  1167 leader_election.cc:343] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:29.690407  1164 leader_election.cc:343] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.690959  1164 leader_election.cc:304] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c81db94744664de59acdc71a69f056b3; no voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430
I20260709 13:00:29.691979  1242 tablet_bootstrap.cc:654] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.693092  1248 raft_consensus.cc:2749] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:29.695591  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:29.699851  1241 tablet_bootstrap.cc:492] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.700399  1241 ts_tablet_manager.cc:1403] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:00:29.703174  1241 raft_consensus.cc:359] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.703845  1241 raft_consensus.cc:385] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.704145  1241 raft_consensus.cc:740] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.705086  1241 consensus_queue.cc:260] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.706759  1243 tablet_bootstrap.cc:492] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
W20260709 13:00:29.707257  1018 leader_election.cc:343] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.712956  1274 raft_consensus.cc:493] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.713472  1274 raft_consensus.cc:515] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.715996  1274 leader_election.cc:290] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.716921  1243 tablet_bootstrap.cc:654] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.716894  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.717222  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.717908  1051 raft_consensus.cc:2468] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 0.
W20260709 13:00:29.718916  1093 leader_election.cc:343] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.726343  1090 leader_election.cc:304] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: c81db94744664de59acdc71a69f056b3
I20260709 13:00:29.726956  1274 raft_consensus.cc:493] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.727386  1247 raft_consensus.cc:2804] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.727406  1274 raft_consensus.cc:515] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.728257  1247 raft_consensus.cc:493] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.728881  1247 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.728195  1241 ts_tablet_manager.cc:1434] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:00:29.730675  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
W20260709 13:00:29.732164  1090 leader_election.cc:343] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.733135  1274 leader_election.cc:290] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.734570  1241 tablet_bootstrap.cc:492] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.734371  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.735033  1200 raft_consensus.cc:2468] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 0.
I20260709 13:00:29.736325  1093 leader_election.cc:304] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 2fbda475cbb14c289719303c1a145430
I20260709 13:00:29.737444  1274 raft_consensus.cc:2804] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.737854  1274 raft_consensus.cc:493] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.738195  1274 raft_consensus.cc:3060] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.739121  1281 raft_consensus.cc:493] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.739638  1281 raft_consensus.cc:515] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.742058  1281 leader_election.cc:290] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.743903  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.744638  1200 raft_consensus.cc:2468] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 0.
I20260709 13:00:29.745882  1248 raft_consensus.cc:493] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.746508  1248 raft_consensus.cc:515] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.747428   949 catalog_manager.cc:5697] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.748695  1248 leader_election.cc:290] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:29.751327  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3953d04bf0d74ae093fdb93bf9d6463e" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:29.751641  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3953d04bf0d74ae093fdb93bf9d6463e" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.751742  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:29.752125  1127 raft_consensus.cc:2468] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 0.
I20260709 13:00:29.752612  1247 raft_consensus.cc:515] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
W20260709 13:00:29.753159  1164 leader_election.cc:343] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.754242  1167 leader_election.cc:304] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 2fbda475cbb14c289719303c1a145430
I20260709 13:00:29.754657  1241 tablet_bootstrap.cc:654] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.755422  1248 raft_consensus.cc:2804] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.755834  1248 raft_consensus.cc:493] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.756206  1248 raft_consensus.cc:3060] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.758160  1247 leader_election.cc:290] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.758780  1247 raft_consensus.cc:493] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.759377  1247 raft_consensus.cc:515] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.759873  1243 tablet_bootstrap.cc:492] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:29.745764  1242 tablet_bootstrap.cc:492] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
W20260709 13:00:29.760579  1018 leader_election.cc:343] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.761559  1018 leader_election.cc:304] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 1364f58c0f5b4485bc819bfd3ecb3962
I20260709 13:00:29.762945  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:29.767603  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.768438  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:29.763883  1051 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:29.770160  1093 leader_election.cc:343] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:29.771159  1093 leader_election.cc:343] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.771957  1247 leader_election.cc:290] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.772246  1281 raft_consensus.cc:2804] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.773434  1281 raft_consensus.cc:493] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.773844  1281 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.775480  1241 tablet_bootstrap.cc:492] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.776268  1241 ts_tablet_manager.cc:1403] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.000s
I20260709 13:00:29.779418  1274 raft_consensus.cc:515] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.780491  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.781339  1052 raft_consensus.cc:2468] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 0.
I20260709 13:00:29.760541  1242 ts_tablet_manager.cc:1403] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.011s
I20260709 13:00:29.781376  1241 raft_consensus.cc:359] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.783291  1241 raft_consensus.cc:385] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.783660  1241 raft_consensus.cc:740] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.784010  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:29.784489  1090 leader_election.cc:304] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: c81db94744664de59acdc71a69f056b3
I20260709 13:00:29.784713  1200 raft_consensus.cc:3060] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.784651  1241 consensus_queue.cc:260] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.786167  1247 raft_consensus.cc:2804] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.786062  1242 raft_consensus.cc:359] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.786405  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:29.786679  1247 raft_consensus.cc:493] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.787019  1242 raft_consensus.cc:385] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.787285  1247 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.787432  1242 raft_consensus.cc:740] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
W20260709 13:00:29.788931  1090 leader_election.cc:343] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.788703  1242 consensus_queue.cc:260] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.791776  1248 raft_consensus.cc:515] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.760538  1243 ts_tablet_manager.cc:1403] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.008s
I20260709 13:00:29.795058  1242 ts_tablet_manager.cc:1434] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:00:29.796440  1242 tablet_bootstrap.cc:492] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.797138  1241 ts_tablet_manager.cc:1434] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:00:29.797222  1243 raft_consensus.cc:359] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.798072  1243 raft_consensus.cc:385] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.798424  1241 tablet_bootstrap.cc:492] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962: Bootstrap starting.
I20260709 13:00:29.800989  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3953d04bf0d74ae093fdb93bf9d6463e" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:29.801573  1052 raft_consensus.cc:3060] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.803112  1247 raft_consensus.cc:515] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.800347  1274 leader_election.cc:290] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.805008  1200 raft_consensus.cc:2468] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 1.
I20260709 13:00:29.805966  1247 leader_election.cc:290] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.806121  1093 leader_election.cc:304] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 2fbda475cbb14c289719303c1a145430
I20260709 13:00:29.808297  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:29.808962  1052 raft_consensus.cc:2468] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 1.
I20260709 13:00:29.808272  1247 raft_consensus.cc:2804] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.809850  1247 raft_consensus.cc:697] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Becoming Leader. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:29.810024  1286 raft_consensus.cc:493] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.810916  1242 tablet_bootstrap.cc:654] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.810575  1286 raft_consensus.cc:515] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.810770  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:29.811105  1247 consensus_queue.cc:237] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.813760  1281 raft_consensus.cc:515] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.810031  1164 leader_election.cc:304] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:29.815145  1262 raft_consensus.cc:2804] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.815593  1050 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.816514  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
W20260709 13:00:29.818495  1018 leader_election.cc:343] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.821203  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3953d04bf0d74ae093fdb93bf9d6463e" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:29.822158  1127 raft_consensus.cc:3060] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.828119  1286 leader_election.cc:290] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.829023  1127 raft_consensus.cc:2468] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 1.
I20260709 13:00:29.829437  1200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c8bd07a5df4bfcb92eabe64bdac3b6" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.830066  1200 raft_consensus.cc:2468] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 0.
I20260709 13:00:29.830605  1052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c8bd07a5df4bfcb92eabe64bdac3b6" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.831130  1093 leader_election.cc:304] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 
W20260709 13:00:29.831771  1090 leader_election.cc:343] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.831960  1286 raft_consensus.cc:2804] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:29.832398  1286 raft_consensus.cc:493] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.832744  1286 raft_consensus.cc:3060] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.831894  1241 tablet_bootstrap.cc:654] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.834903  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:29.835804  1199 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.798362  1243 raft_consensus.cc:740] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.834472  1262 raft_consensus.cc:697] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Becoming Leader. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:29.833518  1050 raft_consensus.cc:2468] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 1.
I20260709 13:00:29.841202  1262 consensus_queue.cc:237] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.844682  1090 leader_election.cc:304] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:29.847486  1274 raft_consensus.cc:2804] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.832849  1248 leader_election.cc:290] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:29.833405  1281 leader_election.cc:290] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.853276  1243 consensus_queue.cc:260] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.854281  1201 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.856092  1243 ts_tablet_manager.cc:1434] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.001s
I20260709 13:00:29.811951  1051 raft_consensus.cc:2468] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 1.
I20260709 13:00:29.848254  1199 raft_consensus.cc:2468] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 1.
I20260709 13:00:29.860687  1274 raft_consensus.cc:697] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Becoming Leader. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:29.858567  1243 tablet_bootstrap.cc:492] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:29.864328  1018 leader_election.cc:304] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 1364f58c0f5b4485bc819bfd3ecb3962
I20260709 13:00:29.864919  1090 leader_election.cc:304] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: c81db94744664de59acdc71a69f056b3
I20260709 13:00:29.867262  1241 tablet_bootstrap.cc:492] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962: No bootstrap required, opened a new log
I20260709 13:00:29.867750  1241 ts_tablet_manager.cc:1403] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.003s
I20260709 13:00:29.866060  1281 raft_consensus.cc:2804] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.872459  1242 tablet_bootstrap.cc:492] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:29.873036  1242 ts_tablet_manager.cc:1403] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.077s	user 0.031s	sys 0.013s
I20260709 13:00:29.872866  1281 raft_consensus.cc:697] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:29.872685  1286 raft_consensus.cc:515] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.864967  1274 consensus_queue.cc:237] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.875005  1292 raft_consensus.cc:2804] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.876581  1292 raft_consensus.cc:697] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Becoming Leader. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:29.871409   949 catalog_manager.cc:5697] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:29.877547  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c8bd07a5df4bfcb92eabe64bdac3b6" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:29.883162  1242 raft_consensus.cc:359] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.883944  1242 raft_consensus.cc:385] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.884354  1242 raft_consensus.cc:740] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
W20260709 13:00:29.884660  1090 leader_election.cc:343] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.884016  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c8bd07a5df4bfcb92eabe64bdac3b6" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:29.885207  1242 consensus_queue.cc:260] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.885052   948 catalog_manager.cc:5697] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 reported cstate change: term changed from 0 to 1, leader changed from <none> to c81db94744664de59acdc71a69f056b3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c81db94744664de59acdc71a69f056b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.886040  1201 raft_consensus.cc:2468] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 1.
I20260709 13:00:29.886368  1286 leader_election.cc:290] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.885900  1199 raft_consensus.cc:3060] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.874295  1281 consensus_queue.cc:237] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.888315  1242 ts_tablet_manager.cc:1434] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:00:29.890538  1242 tablet_bootstrap.cc:492] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:29.877547  1292 consensus_queue.cc:237] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.899302  1241 raft_consensus.cc:359] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.900374  1241 raft_consensus.cc:385] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.900718  1241 raft_consensus.cc:740] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.901839  1286 raft_consensus.cc:493] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.902355  1286 raft_consensus.cc:515] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.903604  1241 consensus_queue.cc:260] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.905586  1286 leader_election.cc:290] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.906152  1241 ts_tablet_manager.cc:1434] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:00:29.909013  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.909329  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
W20260709 13:00:29.910648  1090 leader_election.cc:343] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:29.911302  1093 leader_election.cc:343] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:29.911952  1093 leader_election.cc:304] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962; no voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3
I20260709 13:00:29.913527  1274 raft_consensus.cc:2749] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:29.914175  1242 tablet_bootstrap.cc:654] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.917454  1243 tablet_bootstrap.cc:654] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.936009  1199 raft_consensus.cc:2468] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 1.
I20260709 13:00:29.936257   948 catalog_manager.cc:5697] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:29.942791  1093 leader_election.cc:304] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 2fbda475cbb14c289719303c1a145430
I20260709 13:00:29.945485  1292 raft_consensus.cc:2804] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:29.946098  1292 raft_consensus.cc:697] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Becoming Leader. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:29.947000  1292 consensus_queue.cc:237] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.943662   948 catalog_manager.cc:5697] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:29.945178  1281 raft_consensus.cc:493] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.948606  1281 raft_consensus.cc:515] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.950757  1281 leader_election.cc:290] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.954682  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.955829  1199 raft_consensus.cc:2393] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbda475cbb14c289719303c1a145430 in current term 1: Already voted for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in this term.
I20260709 13:00:29.957221  1262 consensus_queue.cc:1048] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:29.964085  1243 tablet_bootstrap.cc:492] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:29.963828  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:29.965230  1243 ts_tablet_manager.cc:1403] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.016s
I20260709 13:00:29.965627  1018 leader_election.cc:304] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbda475cbb14c289719303c1a145430; no voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3
I20260709 13:00:29.966838  1242 tablet_bootstrap.cc:492] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:29.966904  1281 raft_consensus.cc:3060] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.967645  1242 ts_tablet_manager.cc:1403] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.018s
I20260709 13:00:29.968101  1243 raft_consensus.cc:359] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.969173  1243 raft_consensus.cc:385] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.968097   949 catalog_manager.cc:5697] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:29.969424  1243 raft_consensus.cc:740] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.970257  1243 consensus_queue.cc:260] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.972177  1292 raft_consensus.cc:493] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.972383  1243 ts_tablet_manager.cc:1434] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:00:29.972782  1292 raft_consensus.cc:515] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.973469  1243 tablet_bootstrap.cc:492] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:29.975682  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:29.975165  1281 raft_consensus.cc:2749] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:29.978461  1292 leader_election.cc:290] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:29.979902  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:29.980357  1242 raft_consensus.cc:359] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.980754  1199 raft_consensus.cc:2393] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1364f58c0f5b4485bc819bfd3ecb3962 in current term 1: Already voted for candidate 2fbda475cbb14c289719303c1a145430 in this term.
I20260709 13:00:29.981164  1243 tablet_bootstrap.cc:654] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:29.982286  1093 leader_election.cc:304] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962; no voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3
I20260709 13:00:29.983234  1292 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.981094  1242 raft_consensus.cc:385] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:29.988360  1242 raft_consensus.cc:740] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
I20260709 13:00:29.989861  1242 consensus_queue.cc:260] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.991565  1281 raft_consensus.cc:493] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:29.992472  1127 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:29.992205  1281 raft_consensus.cc:515] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:29.993956   946 catalog_manager.cc:5697] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.000216  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c8bd07a5df4bfcb92eabe64bdac3b6" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:30.000367  1281 leader_election.cc:290] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:30.001278  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c8bd07a5df4bfcb92eabe64bdac3b6" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:30.002018  1199 raft_consensus.cc:2393] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2fbda475cbb14c289719303c1a145430 in current term 1: Already voted for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in this term.
I20260709 13:00:30.002537  1242 ts_tablet_manager.cc:1434] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:00:30.002668  1262 consensus_queue.cc:1048] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:30.003589  1242 tablet_bootstrap.cc:492] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430: Bootstrap starting.
I20260709 13:00:30.007651  1018 leader_election.cc:304] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2fbda475cbb14c289719303c1a145430; no voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3
I20260709 13:00:30.009999  1251 raft_consensus.cc:3060] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:30.012480  1292 raft_consensus.cc:2749] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:30.018352  1243 tablet_bootstrap.cc:492] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:30.018855  1243 ts_tablet_manager.cc:1403] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.014s
I20260709 13:00:30.023298  1251 raft_consensus.cc:2749] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:30.021656  1243 raft_consensus.cc:359] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.027639  1243 raft_consensus.cc:385] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:30.028105  1243 raft_consensus.cc:740] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:30.030617  1243 consensus_queue.cc:260] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.039497  1242 tablet_bootstrap.cc:654] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:30.040930  1243 ts_tablet_manager.cc:1434] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 13:00:30.044697  1243 tablet_bootstrap.cc:492] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3: Bootstrap starting.
I20260709 13:00:30.056620  1248 consensus_queue.cc:1048] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.065605  1243 tablet_bootstrap.cc:654] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:30.088928  1242 tablet_bootstrap.cc:492] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430: No bootstrap required, opened a new log
I20260709 13:00:30.089459  1242 ts_tablet_manager.cc:1403] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.007s
I20260709 13:00:30.091823  1262 consensus_queue.cc:1048] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:30.092347  1242 raft_consensus.cc:359] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.093029  1242 raft_consensus.cc:385] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:30.093288  1242 raft_consensus.cc:740] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Initialized, Role: FOLLOWER
I20260709 13:00:30.093613  1243 tablet_bootstrap.cc:492] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3: No bootstrap required, opened a new log
I20260709 13:00:30.094094  1243 ts_tablet_manager.cc:1403] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.016s
I20260709 13:00:30.093961  1242 consensus_queue.cc:260] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.096822  1242 ts_tablet_manager.cc:1434] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:00:30.096858  1243 raft_consensus.cc:359] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:30.097832  1243 raft_consensus.cc:385] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:30.098172  1243 raft_consensus.cc:740] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Initialized, Role: FOLLOWER
I20260709 13:00:30.098847  1243 consensus_queue.cc:260] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:30.100828  1243 ts_tablet_manager.cc:1434] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:00:30.201975  1199 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:30.208709  1251 consensus_queue.cc:1048] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:30.220937  1311 consensus_queue.cc:1048] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.226161  1311 raft_consensus.cc:493] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.226727  1311 raft_consensus.cc:515] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.229727  1311 leader_election.cc:290] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:30.230504  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:30.230763  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3" is_pre_election: true
I20260709 13:00:30.231256  1126 raft_consensus.cc:2468] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 0.
I20260709 13:00:30.231449  1199 raft_consensus.cc:2468] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 0.
I20260709 13:00:30.232501  1018 leader_election.cc:304] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:30.233275  1311 raft_consensus.cc:2804] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:30.233707  1311 raft_consensus.cc:493] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.234040  1311 raft_consensus.cc:3060] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:30.239428  1311 raft_consensus.cc:515] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.241531  1311 leader_election.cc:290] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:30.242471  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:30.243042  1126 raft_consensus.cc:3060] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:30.242844  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:30.243831  1199 raft_consensus.cc:3060] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:30.248426  1126 raft_consensus.cc:2468] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 1.
I20260709 13:00:30.249346  1199 raft_consensus.cc:2468] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 1.
I20260709 13:00:30.249625  1018 leader_election.cc:304] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:30.250488  1311 raft_consensus.cc:2804] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:30.250977  1311 raft_consensus.cc:697] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:30.251682  1311 consensus_queue.cc:237] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.258248  1262 consensus_queue.cc:1048] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:30.260744   948 catalog_manager.cc:5697] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.263777  1292 consensus_queue.cc:1048] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.274829  1289 consensus_queue.cc:1048] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.287919  1247 consensus_queue.cc:1048] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.341089  1248 raft_consensus.cc:493] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.340886  1247 consensus_queue.cc:1048] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.341756  1248 raft_consensus.cc:515] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.344161  1248 leader_election.cc:290] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:30.344959  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2fbda475cbb14c289719303c1a145430" is_pre_election: true
I20260709 13:00:30.345479  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" is_pre_election: true
I20260709 13:00:30.347318  1167 leader_election.cc:304] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c81db94744664de59acdc71a69f056b3; no voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430
I20260709 13:00:30.348217  1248 raft_consensus.cc:2749] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:30.353143  1199 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:30.361457  1247 consensus_queue.cc:1048] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.373437  1247 consensus_queue.cc:1048] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.388939  1286 consensus_queue.cc:1048] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.390836  1286 consensus_queue.cc:1048] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:30.408550  1247 consensus_queue.cc:1048] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.441212  1199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7"
dest_uuid: "c81db94744664de59acdc71a69f056b3"
mode: GRACEFUL
new_leader_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:47092
I20260709 13:00:30.442081  1199 raft_consensus.cc:606] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Received request to transfer leadership to TS 2fbda475cbb14c289719303c1a145430
I20260709 13:00:30.451799  1311 consensus_queue.cc:1048] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:30.464689  1126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84"
dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
mode: GRACEFUL
new_leader_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:60180
I20260709 13:00:30.465303  1126 raft_consensus.cc:606] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Received request to transfer leadership to TS 2fbda475cbb14c289719303c1a145430
I20260709 13:00:30.472075  1251 consensus_queue.cc:1048] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.494098  1199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1"
dest_uuid: "c81db94744664de59acdc71a69f056b3"
mode: GRACEFUL
new_leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
 from {username='slave'} at 127.0.0.1:47092
I20260709 13:00:30.494797  1199 raft_consensus.cc:606] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Received request to transfer leadership to TS 1364f58c0f5b4485bc819bfd3ecb3962
I20260709 13:00:30.593338  1289 raft_consensus.cc:993] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3: : Instructing follower 1364f58c0f5b4485bc819bfd3ecb3962 to start an election
I20260709 13:00:30.593933  1248 raft_consensus.cc:1081] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Signalling peer 1364f58c0f5b4485bc819bfd3ecb3962 to start an election
I20260709 13:00:30.595464  1126 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1"
dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
 from {username='slave'} at 127.0.0.1:52662
I20260709 13:00:30.595882  1126 raft_consensus.cc:493] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:30.596221  1126 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.601593  1126 raft_consensus.cc:515] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.603585  1126 leader_election.cc:290] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 2 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:30.604528  1050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:30.604745  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:30.605225  1050 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.605386  1199 raft_consensus.cc:3055] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:30.605814  1199 raft_consensus.cc:740] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:30.606580  1199 consensus_queue.cc:260] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.607443  1199 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.610785  1050 raft_consensus.cc:2468] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 2.
I20260709 13:00:30.611970  1090 leader_election.cc:304] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:30.612125  1199 raft_consensus.cc:2468] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 2.
I20260709 13:00:30.612970  1247 raft_consensus.cc:2804] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.613526  1247 raft_consensus.cc:697] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 LEADER]: Becoming Leader. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:30.614321  1247 consensus_queue.cc:237] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.622123  1289 raft_consensus.cc:993] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3: : Instructing follower 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:30.621501   946 catalog_manager.cc:5697] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 reported cstate change: term changed from 1 to 2, leader changed from c81db94744664de59acdc71a69f056b3 (127.0.107.195) to 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.622584  1248 raft_consensus.cc:1081] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Signalling peer 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:30.624238  1050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:34180
I20260709 13:00:30.624805  1050 raft_consensus.cc:493] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:30.625257  1050 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.631390  1050 raft_consensus.cc:515] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.633244  1050 leader_election.cc:290] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 2 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:30.634104  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:30.634333  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:30.634697  1126 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.634945  1199 raft_consensus.cc:3055] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:30.635311  1199 raft_consensus.cc:740] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:30.635963  1199 consensus_queue.cc:260] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.636986  1199 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.641655  1126 raft_consensus.cc:2468] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 2.
I20260709 13:00:30.641669  1199 raft_consensus.cc:2468] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 2.
I20260709 13:00:30.642926  1018 leader_election.cc:304] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:30.643684  1311 raft_consensus.cc:2804] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.644261  1311 raft_consensus.cc:697] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:30.645113  1311 consensus_queue.cc:237] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.651784   946 catalog_manager.cc:5697] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 1 to 2, leader changed from c81db94744664de59acdc71a69f056b3 (127.0.107.195) to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.716615  1311 consensus_queue.cc:1048] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.730654  1251 consensus_queue.cc:1048] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:30.792695  1286 raft_consensus.cc:993] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962: : Instructing follower 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:30.793181  1274 raft_consensus.cc:1081] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Signalling peer 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:30.795634  1050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:34188
I20260709 13:00:30.796250  1050 raft_consensus.cc:493] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:30.796584  1050 raft_consensus.cc:3060] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.802057  1050 raft_consensus.cc:515] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.804082  1050 leader_election.cc:290] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 2 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:30.805327  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:30.805459  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f807e59c6c4b2186b972fd4adbaa84" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:30.805907  1126 raft_consensus.cc:3055] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:30.806114  1199 raft_consensus.cc:3060] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.806268  1126 raft_consensus.cc:740] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:30.807075  1126 consensus_queue.cc:260] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.808024  1126 raft_consensus.cc:3060] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:30.812562  1199 raft_consensus.cc:2468] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 2.
I20260709 13:00:30.812806  1126 raft_consensus.cc:2468] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 2.
I20260709 13:00:30.814291  1018 leader_election.cc:304] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:30.815131  1251 raft_consensus.cc:2804] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:30.815749  1251 raft_consensus.cc:697] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:30.816581  1251 consensus_queue.cc:237] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:30.826285   946 catalog_manager.cc:5697] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 1 to 2, leader changed from 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194) to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:31.029348  1199 raft_consensus.cc:1275] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Refusing update from remote peer 1364f58c0f5b4485bc819bfd3ecb3962: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.029596  1050 raft_consensus.cc:1275] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Refusing update from remote peer 1364f58c0f5b4485bc819bfd3ecb3962: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.031200  1286 consensus_queue.cc:1048] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.031893  1274 consensus_queue.cc:1048] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.082131  1126 raft_consensus.cc:1275] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.083587  1251 consensus_queue.cc:1048] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.092792  1199 raft_consensus.cc:1275] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.095068  1251 consensus_queue.cc:1048] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.235519  1199 raft_consensus.cc:1275] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.237676  1251 consensus_queue.cc:1048] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:31.245272  1127 raft_consensus.cc:1275] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:31.248255  1311 consensus_queue.cc:1048] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:33.539418   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:00:33.540313   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:33.558673  1051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
mode: GRACEFUL
new_leader_uuid: "c81db94744664de59acdc71a69f056b3"
 from {username='slave'} at 127.0.0.1:57088
I20260709 13:00:33.559276  1051 raft_consensus.cc:606] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Received request to transfer leadership to TS c81db94744664de59acdc71a69f056b3
I20260709 13:00:33.562184  1051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
mode: GRACEFUL
new_leader_uuid: "c81db94744664de59acdc71a69f056b3"
 from {username='slave'} at 127.0.0.1:57088
I20260709 13:00:33.562889  1051 raft_consensus.cc:606] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Received request to transfer leadership to TS c81db94744664de59acdc71a69f056b3
I20260709 13:00:33.564483   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:00:33.565059   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:33.675433  1336 raft_consensus.cc:993] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430: : Instructing follower c81db94744664de59acdc71a69f056b3 to start an election
I20260709 13:00:33.675958  1336 raft_consensus.cc:1081] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Signalling peer c81db94744664de59acdc71a69f056b3 to start an election
I20260709 13:00:33.677609  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00"
dest_uuid: "c81db94744664de59acdc71a69f056b3"
 from {username='slave'} at 127.0.0.1:47086
I20260709 13:00:33.678115  1199 raft_consensus.cc:493] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:33.678395  1199 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.683210  1199 raft_consensus.cc:515] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:33.684742  1199 leader_election.cc:290] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 2 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033)
I20260709 13:00:33.685957  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:33.685910  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:33.686903  1126 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.686903  1051 raft_consensus.cc:3055] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:33.687537  1051 raft_consensus.cc:740] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:33.688421  1051 consensus_queue.cc:260] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:33.689636  1051 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.694698  1126 raft_consensus.cc:2468] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 2.
I20260709 13:00:33.696281  1167 leader_election.cc:304] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:33.696565  1051 raft_consensus.cc:2468] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 2.
I20260709 13:00:33.697155  1335 raft_consensus.cc:2804] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:33.698524  1335 raft_consensus.cc:697] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Becoming Leader. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:33.699652  1335 consensus_queue.cc:237] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:33.709112   946 catalog_manager.cc:5697] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 reported cstate change: term changed from 1 to 2, leader changed from 2fbda475cbb14c289719303c1a145430 (127.0.107.193) to c81db94744664de59acdc71a69f056b3 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c81db94744664de59acdc71a69f056b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:33.873149  1341 raft_consensus.cc:993] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430: : Instructing follower c81db94744664de59acdc71a69f056b3 to start an election
I20260709 13:00:33.873857  1336 raft_consensus.cc:1081] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Signalling peer c81db94744664de59acdc71a69f056b3 to start an election
I20260709 13:00:33.875320  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277"
dest_uuid: "c81db94744664de59acdc71a69f056b3"
 from {username='slave'} at 127.0.0.1:47086
I20260709 13:00:33.875805  1199 raft_consensus.cc:493] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:33.876103  1199 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.881179  1199 raft_consensus.cc:515] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:33.882896  1199 leader_election.cc:290] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 2 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:33.883868  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:33.884277  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:33.884573  1051 raft_consensus.cc:3055] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:33.884883  1126 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.885015  1051 raft_consensus.cc:740] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:33.885952  1051 consensus_queue.cc:260] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:33.886891  1051 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:33.890731  1126 raft_consensus.cc:2468] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 2.
I20260709 13:00:33.891753  1051 raft_consensus.cc:2468] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 2.
I20260709 13:00:33.892383  1167 leader_election.cc:304] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:33.893263  1335 raft_consensus.cc:2804] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:33.893774  1335 raft_consensus.cc:697] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Becoming Leader. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:33.894503  1335 consensus_queue.cc:237] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:33.905081   946 catalog_manager.cc:5697] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 reported cstate change: term changed from 1 to 2, leader changed from 2fbda475cbb14c289719303c1a145430 (127.0.107.193) to c81db94744664de59acdc71a69f056b3 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c81db94744664de59acdc71a69f056b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:34.122958  1051 raft_consensus.cc:1275] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Refusing update from remote peer c81db94744664de59acdc71a69f056b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:34.124466  1335 consensus_queue.cc:1048] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:34.135581  1127 raft_consensus.cc:1275] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Refusing update from remote peer c81db94744664de59acdc71a69f056b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:34.138353  1342 consensus_queue.cc:1048] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:34.387979  1051 raft_consensus.cc:1275] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Refusing update from remote peer c81db94744664de59acdc71a69f056b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:34.389514  1342 consensus_queue.cc:1048] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:34.399653  1126 raft_consensus.cc:1275] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Refusing update from remote peer c81db94744664de59acdc71a69f056b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:34.401999  1357 consensus_queue.cc:1048] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:34.565945   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:34.578446  1199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00"
dest_uuid: "c81db94744664de59acdc71a69f056b3"
mode: GRACEFUL
new_leader_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:47092
I20260709 13:00:34.579110  1199 raft_consensus.cc:606] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Received request to transfer leadership to TS 2fbda475cbb14c289719303c1a145430
I20260709 13:00:34.596621  1199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277"
dest_uuid: "c81db94744664de59acdc71a69f056b3"
mode: GRACEFUL
new_leader_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:47092
I20260709 13:00:34.597227  1199 raft_consensus.cc:606] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Received request to transfer leadership to TS 2fbda475cbb14c289719303c1a145430
I20260709 13:00:34.602752  1126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a"
dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
mode: GRACEFUL
new_leader_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:60180
I20260709 13:00:34.603400  1126 raft_consensus.cc:606] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Received request to transfer leadership to TS 2fbda475cbb14c289719303c1a145430
I20260709 13:00:34.609369  1126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3"
dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
mode: GRACEFUL
new_leader_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:60180
I20260709 13:00:34.610014  1126 raft_consensus.cc:606] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Received request to transfer leadership to TS 2fbda475cbb14c289719303c1a145430
I20260709 13:00:34.616541  1126 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1"
dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
mode: GRACEFUL
new_leader_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:60180
I20260709 13:00:34.617211  1126 raft_consensus.cc:606] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 LEADER]: Received request to transfer leadership to TS 2fbda475cbb14c289719303c1a145430
I20260709 13:00:34.632853  1359 raft_consensus.cc:993] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962: : Instructing follower 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:34.633687  1359 raft_consensus.cc:1081] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 LEADER]: Signalling peer 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:34.635272  1051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:34188
I20260709 13:00:34.635732  1051 raft_consensus.cc:493] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.636023  1051 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.641031  1051 raft_consensus.cc:515] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:34.642633  1051 leader_election.cc:290] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 3 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:34.643983  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:34.644157  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ef3056caec4e969589d5cceba470e1" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:34.644723  1199 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.644737  1126 raft_consensus.cc:3055] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:34.645246  1126 raft_consensus.cc:740] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:34.646040  1126 consensus_queue.cc:260] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:34.647275  1126 raft_consensus.cc:3060] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.649340  1199 raft_consensus.cc:2468] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 3.
I20260709 13:00:34.650708  1018 leader_election.cc:304] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:34.651779  1341 raft_consensus.cc:2804] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:34.653260  1341 raft_consensus.cc:697] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 3 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:34.654167  1341 consensus_queue.cc:237] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:34.655805  1126 raft_consensus.cc:2468] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 3.
I20260709 13:00:34.661420   946 catalog_manager.cc:5697] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 2 to 3, leader changed from 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194) to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.752492  1352 raft_consensus.cc:993] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3: : Instructing follower 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:34.753083  1335 raft_consensus.cc:1081] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Signalling peer 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:34.754657  1051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:34180
I20260709 13:00:34.755172  1051 raft_consensus.cc:493] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.755488  1051 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.760951  1051 raft_consensus.cc:515] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:34.764124  1051 leader_election.cc:290] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 3 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:34.764920  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:34.765143  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91a71bdf082c480b810fc03b5b095e00" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:34.765595  1126 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.765754  1199 raft_consensus.cc:3055] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:34.766108  1199 raft_consensus.cc:740] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:34.766778  1199 consensus_queue.cc:260] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:34.767586  1199 raft_consensus.cc:3060] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.771320  1126 raft_consensus.cc:2468] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 3.
I20260709 13:00:34.771543  1199 raft_consensus.cc:2468] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 3.
I20260709 13:00:34.772614  1018 leader_election.cc:304] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:34.773317  1341 raft_consensus.cc:2804] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:34.773772  1341 raft_consensus.cc:697] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 3 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:34.774592  1341 consensus_queue.cc:237] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } }
I20260709 13:00:34.782044   946 catalog_manager.cc:5697] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 2 to 3, leader changed from c81db94744664de59acdc71a69f056b3 (127.0.107.195) to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:34.793429  1338 raft_consensus.cc:993] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962: : Instructing follower 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:34.793955  1338 raft_consensus.cc:1081] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Signalling peer 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:34.795444  1051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:34188
I20260709 13:00:34.795879  1051 raft_consensus.cc:493] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.796221  1051 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.801620  1051 raft_consensus.cc:515] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:34.803638  1051 leader_election.cc:290] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 2 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:34.804733  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:34.804852  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:34.805249  1199 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.805600  1126 raft_consensus.cc:3055] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:34.805933  1126 raft_consensus.cc:740] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:34.806738  1126 consensus_queue.cc:260] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:34.807771  1126 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:34.809751  1199 raft_consensus.cc:2468] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 2.
I20260709 13:00:34.810906  1018 leader_election.cc:304] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:34.812098  1341 raft_consensus.cc:2804] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:34.812592  1341 raft_consensus.cc:697] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:34.813344  1341 consensus_queue.cc:237] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:34.815174  1126 raft_consensus.cc:2468] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 2.
I20260709 13:00:34.822618   946 catalog_manager.cc:5697] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 1 to 2, leader changed from 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194) to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:34.978614  1352 raft_consensus.cc:993] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3: : Instructing follower 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:34.979579  1352 raft_consensus.cc:1081] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Signalling peer 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:34.981825  1051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:34180
I20260709 13:00:34.982625  1051 raft_consensus.cc:493] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:34.983035  1051 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.991958  1051 raft_consensus.cc:515] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:34.994889  1051 leader_election.cc:290] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 3 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:34.996215  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:34.997257  1127 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:34.997534  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a25fdef429e74bdba745cb70b431b277" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:34.998075  1199 raft_consensus.cc:3055] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:34.998312  1199 raft_consensus.cc:740] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:34.999286  1199 consensus_queue.cc:260] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:35.000633  1199 raft_consensus.cc:3060] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:35.004351  1127 raft_consensus.cc:2468] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 3.
I20260709 13:00:35.005769  1018 leader_election.cc:304] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:35.006623  1199 raft_consensus.cc:2468] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 3.
I20260709 13:00:35.006662  1341 raft_consensus.cc:2804] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:35.007378  1341 raft_consensus.cc:697] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 3 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:35.008749  1341 consensus_queue.cc:237] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:35.017688   946 catalog_manager.cc:5697] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 2 to 3, leader changed from c81db94744664de59acdc71a69f056b3 (127.0.107.195) to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.064918  1127 raft_consensus.cc:1275] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.065793  1359 raft_consensus.cc:993] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962: : Instructing follower 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:35.066555  1338 raft_consensus.cc:1081] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Signalling peer 2fbda475cbb14c289719303c1a145430 to start an election
I20260709 13:00:35.066510  1341 consensus_queue.cc:1048] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:35.069519  1051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
 from {username='slave'} at 127.0.0.1:34188
I20260709 13:00:35.070245  1051 raft_consensus.cc:493] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.070713  1051 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.081709  1051 raft_consensus.cc:515] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:35.085964  1126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:35.086648  1126 raft_consensus.cc:3055] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:35.086993  1126 raft_consensus.cc:740] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:35.088102  1199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a" candidate_uuid: "2fbda475cbb14c289719303c1a145430" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:35.087972  1126 consensus_queue.cc:260] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:35.088758  1199 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.089761  1126 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:35.093076  1201 raft_consensus.cc:1275] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.095026  1341 consensus_queue.cc:1048] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:35.098949  1126 raft_consensus.cc:2468] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 2.
I20260709 13:00:35.100171  1018 leader_election.cc:304] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:35.101037  1341 raft_consensus.cc:2804] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:35.101529  1341 raft_consensus.cc:697] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Becoming Leader. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:35.102495  1341 consensus_queue.cc:237] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:35.108608  1051 leader_election.cc:290] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [CANDIDATE]: Term 2 election: Requested vote from peers 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:35.114157  1199 raft_consensus.cc:2468] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2fbda475cbb14c289719303c1a145430 in term 2.
I20260709 13:00:35.120642   948 catalog_manager.cc:5697] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 reported cstate change: term changed from 1 to 2, leader changed from 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194) to 2fbda475cbb14c289719303c1a145430 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "2fbda475cbb14c289719303c1a145430" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:35.264110  1201 raft_consensus.cc:1275] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.265662  1370 consensus_queue.cc:1048] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:35.276850  1127 raft_consensus.cc:1275] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.278801  1126 raft_consensus.cc:1275] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:35.280658  1375 consensus_queue.cc:1048] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:35.280789  1341 consensus_queue.cc:1048] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:35.299981  1201 raft_consensus.cc:1275] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:35.302742  1370 consensus_queue.cc:1048] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:35.501940  1127 raft_consensus.cc:1275] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:35.503639  1341 consensus_queue.cc:1048] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:35.514124  1201 raft_consensus.cc:1275] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:35.515851  1370 consensus_queue.cc:1048] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:35.588840  1201 raft_consensus.cc:1275] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.590530  1370 consensus_queue.cc:1048] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:35.603434  1127 raft_consensus.cc:1275] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Refusing update from remote peer 2fbda475cbb14c289719303c1a145430: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:35.604840  1375 consensus_queue.cc:1048] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:37.627116   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:37.635578  1051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
mode: GRACEFUL
new_leader_uuid: "c81db94744664de59acdc71a69f056b3"
 from {username='slave'} at 127.0.0.1:57088
I20260709 13:00:37.636188  1051 raft_consensus.cc:606] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Received request to transfer leadership to TS c81db94744664de59acdc71a69f056b3
I20260709 13:00:37.639000  1051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
mode: GRACEFUL
new_leader_uuid: "c81db94744664de59acdc71a69f056b3"
 from {username='slave'} at 127.0.0.1:57088
I20260709 13:00:37.639408  1051 raft_consensus.cc:606] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Received request to transfer leadership to TS c81db94744664de59acdc71a69f056b3
I20260709 13:00:37.641973  1051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
mode: GRACEFUL
new_leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
 from {username='slave'} at 127.0.0.1:57088
I20260709 13:00:37.642714  1051 raft_consensus.cc:606] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Received request to transfer leadership to TS 1364f58c0f5b4485bc819bfd3ecb3962
I20260709 13:00:37.645768  1051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7"
dest_uuid: "2fbda475cbb14c289719303c1a145430"
mode: GRACEFUL
new_leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
 from {username='slave'} at 127.0.0.1:57088
I20260709 13:00:37.648233  1051 raft_consensus.cc:606] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Received request to transfer leadership to TS 1364f58c0f5b4485bc819bfd3ecb3962
I20260709 13:00:37.646822  1341 raft_consensus.cc:993] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430: : Instructing follower 1364f58c0f5b4485bc819bfd3ecb3962 to start an election
I20260709 13:00:37.649055  1383 raft_consensus.cc:1081] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Signalling peer 1364f58c0f5b4485bc819bfd3ecb3962 to start an election
I20260709 13:00:37.650039   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:00:37.650652   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:37.650820  1127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a"
dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
 from {username='slave'} at 127.0.0.1:60178
I20260709 13:00:37.651446  1127 raft_consensus.cc:493] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.651767  1127 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.657065  1127 raft_consensus.cc:515] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.658659  1127 leader_election.cc:290] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 3 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:37.659921  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:37.659983  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bd2ec4f198e4b5e86c4e3960ea0d11a" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:37.660527  1051 raft_consensus.cc:3055] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:37.660614  1201 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.660853  1051 raft_consensus.cc:740] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:37.661687  1051 consensus_queue.cc:260] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.662575  1051 raft_consensus.cc:3060] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.666249  1201 raft_consensus.cc:2468] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 3.
I20260709 13:00:37.667244  1051 raft_consensus.cc:2468] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 3.
I20260709 13:00:37.667685  1093 leader_election.cc:304] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:37.668583  1359 raft_consensus.cc:2804] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.669570  1359 raft_consensus.cc:697] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 LEADER]: Becoming Leader. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:37.670269  1359 consensus_queue.cc:237] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.678010   948 catalog_manager.cc:5697] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 reported cstate change: term changed from 2 to 3, leader changed from 2fbda475cbb14c289719303c1a145430 (127.0.107.193) to 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.774034  1384 raft_consensus.cc:993] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430: : Instructing follower 1364f58c0f5b4485bc819bfd3ecb3962 to start an election
I20260709 13:00:37.774524  1384 raft_consensus.cc:1081] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Signalling peer 1364f58c0f5b4485bc819bfd3ecb3962 to start an election
I20260709 13:00:37.776400  1127 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7"
dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
 from {username='slave'} at 127.0.0.1:60178
I20260709 13:00:37.776984  1127 raft_consensus.cc:493] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.777310  1127 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.785049  1127 raft_consensus.cc:515] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.786587  1127 leader_election.cc:290] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 3 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), c81db94744664de59acdc71a69f056b3 (127.0.107.195:41389)
I20260709 13:00:37.787596  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:37.787678  1201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9092a456dc574775a2bd8b9798acdea7" candidate_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c81db94744664de59acdc71a69f056b3"
I20260709 13:00:37.788117  1051 raft_consensus.cc:3055] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:37.788378  1201 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.788482  1051 raft_consensus.cc:740] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:37.789299  1051 consensus_queue.cc:260] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.790315  1051 raft_consensus.cc:3060] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.792922  1383 raft_consensus.cc:993] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430: : Instructing follower c81db94744664de59acdc71a69f056b3 to start an election
I20260709 13:00:37.793520  1384 raft_consensus.cc:1081] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Signalling peer c81db94744664de59acdc71a69f056b3 to start an election
I20260709 13:00:37.795437  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be"
dest_uuid: "c81db94744664de59acdc71a69f056b3"
 from {username='slave'} at 127.0.0.1:47086
I20260709 13:00:37.795966  1199 raft_consensus.cc:493] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.796326  1199 raft_consensus.cc:3060] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.800571  1051 raft_consensus.cc:2468] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 3.
I20260709 13:00:37.800619  1201 raft_consensus.cc:2468] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1364f58c0f5b4485bc819bfd3ecb3962 in term 3.
I20260709 13:00:37.802219  1090 leader_election.cc:304] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, 2fbda475cbb14c289719303c1a145430; no voters: 
I20260709 13:00:37.803082  1359 raft_consensus.cc:2804] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:37.803597  1359 raft_consensus.cc:697] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 LEADER]: Becoming Leader. State: Replica: 1364f58c0f5b4485bc819bfd3ecb3962, State: Running, Role: LEADER
I20260709 13:00:37.804474  1359 consensus_queue.cc:237] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.812840   948 catalog_manager.cc:5697] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 reported cstate change: term changed from 2 to 3, leader changed from 2fbda475cbb14c289719303c1a145430 (127.0.107.193) to 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:37.816169  1199 raft_consensus.cc:515] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.818100  1199 leader_election.cc:290] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 2 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:37.819285  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:37.819249  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19489b6ebc4f4c2cbfc864d14f0737be" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:37.819993  1127 raft_consensus.cc:3060] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.820101  1051 raft_consensus.cc:3055] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:37.820497  1051 raft_consensus.cc:740] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:37.823525  1051 consensus_queue.cc:260] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.824824  1051 raft_consensus.cc:3060] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:37.828297  1127 raft_consensus.cc:2468] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 2.
I20260709 13:00:37.829718  1167 leader_election.cc:304] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1364f58c0f5b4485bc819bfd3ecb3962, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:37.830521  1352 raft_consensus.cc:2804] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:00:37.831631  1352 raft_consensus.cc:697] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Becoming Leader. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:37.832509  1352 consensus_queue.cc:237] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.839463   948 catalog_manager.cc:5697] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 reported cstate change: term changed from 1 to 2, leader changed from 2fbda475cbb14c289719303c1a145430 (127.0.107.193) to c81db94744664de59acdc71a69f056b3 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "c81db94744664de59acdc71a69f056b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.840561  1051 raft_consensus.cc:2468] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 2.
I20260709 13:00:37.980275  1383 raft_consensus.cc:993] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430: : Instructing follower c81db94744664de59acdc71a69f056b3 to start an election
I20260709 13:00:37.980834  1384 raft_consensus.cc:1081] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Signalling peer c81db94744664de59acdc71a69f056b3 to start an election
I20260709 13:00:37.983361  1199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3"
dest_uuid: "c81db94744664de59acdc71a69f056b3"
 from {username='slave'} at 127.0.0.1:47086
I20260709 13:00:37.983786  1199 raft_consensus.cc:493] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:37.984099  1199 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:37.997341  1199 raft_consensus.cc:515] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:37.999140  1199 leader_election.cc:290] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 3 election: Requested vote from peers 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033), 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115)
I20260709 13:00:38.000003  1051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2fbda475cbb14c289719303c1a145430"
I20260709 13:00:38.000629  1051 raft_consensus.cc:3055] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:00:38.000938  1051 raft_consensus.cc:740] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2fbda475cbb14c289719303c1a145430, State: Running, Role: LEADER
I20260709 13:00:38.001214  1127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c4a7d30b0543299a291bdc7c5b55a3" candidate_uuid: "c81db94744664de59acdc71a69f056b3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1364f58c0f5b4485bc819bfd3ecb3962"
I20260709 13:00:38.002110  1127 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.001791  1051 consensus_queue.cc:260] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:38.003237  1051 raft_consensus.cc:3060] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:38.047724  1051 raft_consensus.cc:2468] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 3.
I20260709 13:00:38.047706  1127 raft_consensus.cc:2468] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c81db94744664de59acdc71a69f056b3 in term 3.
I20260709 13:00:38.049299  1164 leader_election.cc:304] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2fbda475cbb14c289719303c1a145430, c81db94744664de59acdc71a69f056b3; no voters: 
I20260709 13:00:38.050323  1352 raft_consensus.cc:2804] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:38.050968  1352 raft_consensus.cc:697] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 3 LEADER]: Becoming Leader. State: Replica: c81db94744664de59acdc71a69f056b3, State: Running, Role: LEADER
I20260709 13:00:38.052022  1352 consensus_queue.cc:237] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } }
I20260709 13:00:38.061350   948 catalog_manager.cc:5697] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 reported cstate change: term changed from 2 to 3, leader changed from 2fbda475cbb14c289719303c1a145430 (127.0.107.193) to c81db94744664de59acdc71a69f056b3 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c81db94744664de59acdc71a69f056b3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.084230  1199 raft_consensus.cc:1275] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Refusing update from remote peer 1364f58c0f5b4485bc819bfd3ecb3962: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.085731  1359 consensus_queue.cc:1048] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.098083  1051 raft_consensus.cc:1275] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Refusing update from remote peer 1364f58c0f5b4485bc819bfd3ecb3962: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.100260  1385 consensus_queue.cc:1048] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.238688  1051 raft_consensus.cc:1275] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Refusing update from remote peer c81db94744664de59acdc71a69f056b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.240170  1352 consensus_queue.cc:1048] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:38.251605  1127 raft_consensus.cc:1275] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Refusing update from remote peer c81db94744664de59acdc71a69f056b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:00:38.253635  1402 consensus_queue.cc:1048] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:38.263154  1199 raft_consensus.cc:1275] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Refusing update from remote peer 1364f58c0f5b4485bc819bfd3ecb3962: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.264779  1385 consensus_queue.cc:1048] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c81db94744664de59acdc71a69f056b3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 41389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.279788  1051 raft_consensus.cc:1275] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Refusing update from remote peer 1364f58c0f5b4485bc819bfd3ecb3962: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.281600  1398 consensus_queue.cc:1048] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:38.502820  1051 raft_consensus.cc:1275] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Refusing update from remote peer c81db94744664de59acdc71a69f056b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.504771  1402 consensus_queue.cc:1048] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2fbda475cbb14c289719303c1a145430" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 36033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:38.515069  1127 raft_consensus.cc:1275] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Refusing update from remote peer c81db94744664de59acdc71a69f056b3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:00:38.517124  1408 consensus_queue.cc:1048] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1364f58c0f5b4485bc819bfd3ecb3962" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:00:38.652383   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:38.658972   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:00:38.696249   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:38.697160   431 tablet_replica.cc:333] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.698252   431 raft_consensus.cc:2243] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.699422   431 raft_consensus.cc:2272] T 35f807e59c6c4b2186b972fd4adbaa84 P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.702344   431 tablet_replica.cc:333] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.703198   431 raft_consensus.cc:2243] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.703698   431 raft_consensus.cc:2272] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.705643   431 tablet_replica.cc:333] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.706157   431 raft_consensus.cc:2243] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.706530   431 raft_consensus.cc:2272] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.709792   431 tablet_replica.cc:333] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.710707   431 raft_consensus.cc:2243] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.711243   431 raft_consensus.cc:2272] T 72c4a7d30b0543299a291bdc7c5b55a3 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.714931   431 tablet_replica.cc:333] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.715802   431 raft_consensus.cc:2243] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.717684   431 raft_consensus.cc:2272] T 65ef3056caec4e969589d5cceba470e1 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.719767   431 tablet_replica.cc:333] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.720492   431 raft_consensus.cc:2243] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.720943   431 raft_consensus.cc:2272] T 19489b6ebc4f4c2cbfc864d14f0737be P 2fbda475cbb14c289719303c1a145430 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.723740   431 tablet_replica.cc:333] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.724412   431 raft_consensus.cc:2243] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.724934   431 raft_consensus.cc:2272] T 3953d04bf0d74ae093fdb93bf9d6463e P 2fbda475cbb14c289719303c1a145430 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.726971   431 tablet_replica.cc:333] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.727526   431 raft_consensus.cc:2243] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.727969   431 raft_consensus.cc:2272] T 9092a456dc574775a2bd8b9798acdea7 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.730602   431 tablet_replica.cc:333] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.731150   431 raft_consensus.cc:2243] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.732076   431 raft_consensus.cc:2272] T a25fdef429e74bdba745cb70b431b277 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.734392   431 tablet_replica.cc:333] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430: stopping tablet replica
I20260709 13:00:38.735014   431 raft_consensus.cc:2243] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.736081   431 raft_consensus.cc:2272] T 91a71bdf082c480b810fc03b5b095e00 P 2fbda475cbb14c289719303c1a145430 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.771639   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:00:38.775302  1164 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36033: connect: Connection refused (error 111) [suppressed 6 similar messages]
W20260709 13:00:38.782691  1090 consensus_peers.cc:597] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 -> Peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Couldn't send request to peer 2fbda475cbb14c289719303c1a145430. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:38.782851  1164 consensus_peers.cc:597] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 -> Peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Couldn't send request to peer 2fbda475cbb14c289719303c1a145430. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:38.798226   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:00:38.831708   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:38.832494   431 tablet_replica.cc:333] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.833133   431 raft_consensus.cc:2243] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.833612   431 raft_consensus.cc:2272] T 65ef3056caec4e969589d5cceba470e1 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.835264   431 tablet_replica.cc:333] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.835843   431 raft_consensus.cc:2243] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.836304   431 raft_consensus.cc:2272] T a25fdef429e74bdba745cb70b431b277 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.837944   431 tablet_replica.cc:333] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.838470   431 raft_consensus.cc:2243] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.838891   431 raft_consensus.cc:2272] T 91a71bdf082c480b810fc03b5b095e00 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.840759   431 tablet_replica.cc:333] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.841354   431 raft_consensus.cc:2243] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.841766   431 raft_consensus.cc:2272] T 3953d04bf0d74ae093fdb93bf9d6463e P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.843508   431 tablet_replica.cc:333] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.844187   431 raft_consensus.cc:2243] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.844599   431 raft_consensus.cc:2272] T 19489b6ebc4f4c2cbfc864d14f0737be P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.846930   431 tablet_replica.cc:333] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.847496   431 raft_consensus.cc:2243] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.848352   431 raft_consensus.cc:2272] T 9092a456dc574775a2bd8b9798acdea7 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.850456   431 tablet_replica.cc:333] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.850986   431 raft_consensus.cc:2243] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.851771   431 raft_consensus.cc:2272] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.853664   431 tablet_replica.cc:333] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.854149   431 raft_consensus.cc:2243] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.854578   431 raft_consensus.cc:2272] T 72c4a7d30b0543299a291bdc7c5b55a3 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.857335   431 tablet_replica.cc:333] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.857864   431 raft_consensus.cc:2243] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.858585   431 raft_consensus.cc:2272] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P 1364f58c0f5b4485bc819bfd3ecb3962 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.861991   431 tablet_replica.cc:333] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962: stopping tablet replica
I20260709 13:00:38.862528   431 raft_consensus.cc:2243] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.863027   431 raft_consensus.cc:2272] T 35f807e59c6c4b2186b972fd4adbaa84 P 1364f58c0f5b4485bc819bfd3ecb3962 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.894028   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:00:38.917955   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:00:38.921010  1167 consensus_peers.cc:597] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 -> Peer 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115): Couldn't send request to peer 1364f58c0f5b4485bc819bfd3ecb3962. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:42115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:38.960175  1167 consensus_peers.cc:597] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 -> Peer 1364f58c0f5b4485bc819bfd3ecb3962 (127.0.107.194:42115): Couldn't send request to peer 1364f58c0f5b4485bc819bfd3ecb3962. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:42115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:38.963856   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:00:38.964975   431 tablet_replica.cc:333] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.965909   431 raft_consensus.cc:2243] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.966563   431 raft_consensus.cc:2272] T 91a71bdf082c480b810fc03b5b095e00 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:00:38.967108  1164 consensus_peers.cc:597] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 -> Peer 2fbda475cbb14c289719303c1a145430 (127.0.107.193:36033): Couldn't send request to peer 2fbda475cbb14c289719303c1a145430. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:36033: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:38.968745   431 tablet_replica.cc:333] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.969363   431 raft_consensus.cc:2243] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.969816   431 raft_consensus.cc:2272] T a25fdef429e74bdba745cb70b431b277 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.971611   431 tablet_replica.cc:333] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.972215   431 raft_consensus.cc:2243] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.972999   431 raft_consensus.cc:2272] T 72c4a7d30b0543299a291bdc7c5b55a3 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.975184   431 tablet_replica.cc:333] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.975747   431 raft_consensus.cc:2243] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.976212   431 raft_consensus.cc:2272] T 8bd2ec4f198e4b5e86c4e3960ea0d11a P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.979101   431 tablet_replica.cc:333] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.979743   431 raft_consensus.cc:2243] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.980299   431 raft_consensus.cc:2272] T f8c8bd07a5df4bfcb92eabe64bdac3b6 P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.982060   431 tablet_replica.cc:333] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.982646   431 raft_consensus.cc:2243] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.983119   431 raft_consensus.cc:2272] T 35f807e59c6c4b2186b972fd4adbaa84 P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.985000   431 tablet_replica.cc:333] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.985664   431 raft_consensus.cc:2243] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.986377   431 raft_consensus.cc:2272] T 19489b6ebc4f4c2cbfc864d14f0737be P c81db94744664de59acdc71a69f056b3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.988540   431 tablet_replica.cc:333] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.989015   431 raft_consensus.cc:2243] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:38.989756   431 raft_consensus.cc:2272] T 3953d04bf0d74ae093fdb93bf9d6463e P c81db94744664de59acdc71a69f056b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.991636   431 tablet_replica.cc:333] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.992282   431 raft_consensus.cc:2243] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.992750   431 raft_consensus.cc:2272] T 9092a456dc574775a2bd8b9798acdea7 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:38.995230   431 tablet_replica.cc:333] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3: stopping tablet replica
I20260709 13:00:38.995770   431 raft_consensus.cc:2243] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:00:38.996331   431 raft_consensus.cc:2272] T 65ef3056caec4e969589d5cceba470e1 P c81db94744664de59acdc71a69f056b3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.029197   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:00:39.052783   431 master.cc:562] Master@127.0.107.254:43877 shutting down...
I20260709 13:00:39.081367   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:00:39.082064   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:00:39.082461   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P fccf684c8ea7400b97a21c14752e391b: stopping tablet replica
I20260709 13:00:39.105546   431 master.cc:584] Master@127.0.107.254:43877 shutdown complete.
1364f58c0f5b4485bc819bfd3ecb3962  4
2fbda475cbb14c289719303c1a145430  5
c81db94744664de59acdc71a69f056b3  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10844 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:00:39.151221   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33773
I20260709 13:00:39.152566   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:39.158658  1414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:39.160086  1415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:39.161850   431 server_base.cc:1061] running on GCE node
W20260709 13:00:39.162992  1418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:39.164170   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:39.164408   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:39.164669   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602039164623 us; error 0 us; skew 500 ppm
I20260709 13:00:39.165400   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:39.168697   431 webserver.cc:533] Webserver started at http://127.0.107.254:38787/ using document root <none> and password file <none>
I20260709 13:00:39.169337   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:39.169586   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:39.169960   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:39.171361   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/master-0-root/instance:
uuid: "bd598697ff644162909af62351a1ef0b"
format_stamp: "Formatted at 2026-07-09 13:00:39 on dist-test-slave-smzk"
I20260709 13:00:39.176928   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:00:39.181260  1422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.182189   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:00:39.182606   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/master-0-root
uuid: "bd598697ff644162909af62351a1ef0b"
format_stamp: "Formatted at 2026-07-09 13:00:39 on dist-test-slave-smzk"
I20260709 13:00:39.182932   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:39.200982   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:39.202580   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:39.250733   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33773
I20260709 13:00:39.250809  1473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33773 every 8 connection(s)
I20260709 13:00:39.255251  1474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:39.265425  1474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Bootstrap starting.
I20260709 13:00:39.270061  1474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:39.274717  1474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: No bootstrap required, opened a new log
I20260709 13:00:39.276813  1474 raft_consensus.cc:359] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd598697ff644162909af62351a1ef0b" member_type: VOTER }
I20260709 13:00:39.277189  1474 raft_consensus.cc:385] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:39.277462  1474 raft_consensus.cc:740] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd598697ff644162909af62351a1ef0b, State: Initialized, Role: FOLLOWER
I20260709 13:00:39.278146  1474 consensus_queue.cc:260] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd598697ff644162909af62351a1ef0b" member_type: VOTER }
I20260709 13:00:39.278553  1474 raft_consensus.cc:399] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:00:39.278812  1474 raft_consensus.cc:493] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:00:39.279347  1474 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:39.360728  1474 raft_consensus.cc:515] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd598697ff644162909af62351a1ef0b" member_type: VOTER }
I20260709 13:00:39.361443  1474 leader_election.cc:304] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bd598697ff644162909af62351a1ef0b; no voters: 
I20260709 13:00:39.363019  1474 leader_election.cc:290] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:00:39.363727  1477 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:39.366098  1477 raft_consensus.cc:697] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 1 LEADER]: Becoming Leader. State: Replica: bd598697ff644162909af62351a1ef0b, State: Running, Role: LEADER
I20260709 13:00:39.366896  1474 sys_catalog.cc:565] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:00:39.366799  1477 consensus_queue.cc:237] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd598697ff644162909af62351a1ef0b" member_type: VOTER }
I20260709 13:00:39.372097  1478 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bd598697ff644162909af62351a1ef0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd598697ff644162909af62351a1ef0b" member_type: VOTER } }
I20260709 13:00:39.372790  1478 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:39.373060  1479 sys_catalog.cc:455] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bd598697ff644162909af62351a1ef0b. Latest consensus state: current_term: 1 leader_uuid: "bd598697ff644162909af62351a1ef0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bd598697ff644162909af62351a1ef0b" member_type: VOTER } }
I20260709 13:00:39.373660  1479 sys_catalog.cc:458] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [sys.catalog]: This master's current role is: LEADER
I20260709 13:00:39.379599  1484 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:00:39.385671  1484 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:00:39.392632   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:00:39.396669  1484 catalog_manager.cc:1383] Generated new cluster ID: 6f5ccf5051ee483c9583f9c87def9c61
I20260709 13:00:39.397011  1484 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:00:39.435956  1484 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:00:39.437273  1484 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:00:39.450510  1484 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Generated new TSK 0
I20260709 13:00:39.451310  1484 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:00:39.460986   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:39.468429  1495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:39.469841  1496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:39.472625  1498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:39.473038   431 server_base.cc:1061] running on GCE node
I20260709 13:00:39.474037   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:00:39.474385   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:39.474597   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602039474569 us; error 0 us; skew 500 ppm
I20260709 13:00:39.475162   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:39.477808   431 webserver.cc:533] Webserver started at http://127.0.107.193:37031/ using document root <none> and password file <none>
I20260709 13:00:39.478245   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:39.478433   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:39.478652   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:39.479673   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/instance:
uuid: "c98c328741aa493d87abafbf08f04944"
format_stamp: "Formatted at 2026-07-09 13:00:39 on dist-test-slave-smzk"
I20260709 13:00:39.485656   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:00:39.490022  1503 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.491099   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:00:39.491495   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "c98c328741aa493d87abafbf08f04944"
format_stamp: "Formatted at 2026-07-09 13:00:39 on dist-test-slave-smzk"
I20260709 13:00:39.491844   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:39.528833   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:39.530423   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:39.532222   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:39.534759   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:39.534996   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.535264   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:39.535459   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.591240   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35051
I20260709 13:00:39.591351  1565 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35051 every 8 connection(s)
I20260709 13:00:39.597714   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:39.606055  1570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:39.607981  1571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:39.611593  1573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:39.612376   431 server_base.cc:1061] running on GCE node
I20260709 13:00:39.613579   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:39.613780  1566 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33773
W20260709 13:00:39.613873   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:39.614166   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602039614145 us; error 0 us; skew 500 ppm
I20260709 13:00:39.614259  1566 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:39.614957   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:39.615272  1566 heartbeater.cc:507] Master 127.0.107.254:33773 requested a full tablet report, sending...
I20260709 13:00:39.618115   431 webserver.cc:533] Webserver started at http://127.0.107.194:42603/ using document root <none> and password file <none>
I20260709 13:00:39.618662   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:39.618867   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:39.619170   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:39.619632  1439 ts_manager.cc:194] Registered new tserver with Master: c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:00:39.620548   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/instance:
uuid: "e8eefefed88a4903b423e9f487c4805a"
format_stamp: "Formatted at 2026-07-09 13:00:39 on dist-test-slave-smzk"
I20260709 13:00:39.622053  1439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48032
I20260709 13:00:39.625996   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:00:39.630043  1578 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.631214   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:00:39.631620   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root
uuid: "e8eefefed88a4903b423e9f487c4805a"
format_stamp: "Formatted at 2026-07-09 13:00:39 on dist-test-slave-smzk"
I20260709 13:00:39.631959   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:39.644697   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:39.646042   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:39.647586   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:39.650090   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:39.650352   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.650614   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:39.650791   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.715432   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43963
I20260709 13:00:39.715626  1640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43963 every 8 connection(s)
I20260709 13:00:39.721028   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:39.727950  1644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:00:39.730257  1645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:39.735597  1641 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33773
I20260709 13:00:39.736276  1641 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:39.737268  1641 heartbeater.cc:507] Master 127.0.107.254:33773 requested a full tablet report, sending...
I20260709 13:00:39.738601   431 server_base.cc:1061] running on GCE node
I20260709 13:00:39.739979  1439 ts_manager.cc:194] Registered new tserver with Master: e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:00:39.740828  1647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:39.742218   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:39.742260  1439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48034
W20260709 13:00:39.742825   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:39.743180   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602039743150 us; error 0 us; skew 500 ppm
I20260709 13:00:39.744194   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:39.747265   431 webserver.cc:533] Webserver started at http://127.0.107.195:41765/ using document root <none> and password file <none>
I20260709 13:00:39.747840   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:39.748113   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:39.748391   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:39.749884   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/instance:
uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
format_stamp: "Formatted at 2026-07-09 13:00:39 on dist-test-slave-smzk"
I20260709 13:00:39.756150   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:00:39.760396  1652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.761420   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:00:39.761799   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root
uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
format_stamp: "Formatted at 2026-07-09 13:00:39 on dist-test-slave-smzk"
I20260709 13:00:39.762099   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:39.798913   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:39.800419   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:39.801946   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:39.804582   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:39.804781   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.805168   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:39.805409   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:39.853016   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:38063
I20260709 13:00:39.853179  1714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:38063 every 8 connection(s)
I20260709 13:00:39.869701  1715 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33773
I20260709 13:00:39.870162  1715 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:39.871081  1715 heartbeater.cc:507] Master 127.0.107.254:33773 requested a full tablet report, sending...
I20260709 13:00:39.873535  1439 ts_manager.cc:194] Registered new tserver with Master: f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:39.873958   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017678113s
I20260709 13:00:39.875651  1439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48036
I20260709 13:00:39.906350  1439 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48042:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:00:39.913044  1439 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:00:40.118510  1606 tablet_service.cc:1511] Processing CreateTablet for tablet b07448991374497e87b5636471d14890 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:40.121121  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 90b90f8e722a4f1ebab12217cf2171e1 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:40.123265  1602 tablet_service.cc:1511] Processing CreateTablet for tablet f38d50e761f346b8b9b49b532d70e057 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:40.125662  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 469f8c03f4924f809435141a09c976fa (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:40.127856  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 752aab0c230943e5a7d35d3d2ff9e555 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:40.129879  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 752aab0c230943e5a7d35d3d2ff9e555 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:40.131518  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752aab0c230943e5a7d35d3d2ff9e555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.131208  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 90b90f8e722a4f1ebab12217cf2171e1 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:40.132687  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b90f8e722a4f1ebab12217cf2171e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.132926  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 5853661a3b2948fbb9b9483e9e4176a3 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:40.133365  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 469f8c03f4924f809435141a09c976fa (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:40.131093  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 68971e7ff2b548529978ee5a5d55a724 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:40.135062  1527 tablet_service.cc:1511] Processing CreateTablet for tablet f38d50e761f346b8b9b49b532d70e057 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:40.135784  1531 tablet_service.cc:1511] Processing CreateTablet for tablet b07448991374497e87b5636471d14890 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:40.119982  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07448991374497e87b5636471d14890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.137487  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 68971e7ff2b548529978ee5a5d55a724 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:40.139046  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752aab0c230943e5a7d35d3d2ff9e555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.141379  1680 tablet_service.cc:1511] Processing CreateTablet for tablet b07448991374497e87b5636471d14890 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:00:40.142798  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07448991374497e87b5636471d14890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.143316  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38d50e761f346b8b9b49b532d70e057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.144500  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b90f8e722a4f1ebab12217cf2171e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.145138  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5853661a3b2948fbb9b9483e9e4176a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.146885  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 5853661a3b2948fbb9b9483e9e4176a3 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:40.148591  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469f8c03f4924f809435141a09c976fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.149884  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:40.152585  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68971e7ff2b548529978ee5a5d55a724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.152737  1523 tablet_service.cc:1511] Processing CreateTablet for tablet ab24966f65364407bb1fe4072a40c0df (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:40.155455  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 788938c376a646979b8eee973560dc65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:40.156461  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:40.157806  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.161249  1598 tablet_service.cc:1511] Processing CreateTablet for tablet ab24966f65364407bb1fe4072a40c0df (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:40.162372  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469f8c03f4924f809435141a09c976fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.162655  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab24966f65364407bb1fe4072a40c0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.163946  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788938c376a646979b8eee973560dc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.165083  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 788938c376a646979b8eee973560dc65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:40.166414  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788938c376a646979b8eee973560dc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.168512  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07448991374497e87b5636471d14890. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.171178  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab24966f65364407bb1fe4072a40c0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.172545  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.175637  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68971e7ff2b548529978ee5a5d55a724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.176538  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5853661a3b2948fbb9b9483e9e4176a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.179183  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38d50e761f346b8b9b49b532d70e057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.210563  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 469f8c03f4924f809435141a09c976fa (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:00:40.213210  1674 tablet_service.cc:1511] Processing CreateTablet for tablet 5853661a3b2948fbb9b9483e9e4176a3 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:00:40.213471  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 752aab0c230943e5a7d35d3d2ff9e555 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:00:40.214329  1676 tablet_service.cc:1511] Processing CreateTablet for tablet f38d50e761f346b8b9b49b532d70e057 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:00:40.217226  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:00:40.218508  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 90b90f8e722a4f1ebab12217cf2171e1 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:00:40.234404  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469f8c03f4924f809435141a09c976fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.233912  1672 tablet_service.cc:1511] Processing CreateTablet for tablet ab24966f65364407bb1fe4072a40c0df (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:00:40.234184  1597 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff3d30394041dd91e5470bfd077bab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:40.236177  1730 tablet_bootstrap.cc:492] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:40.217231  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 68971e7ff2b548529978ee5a5d55a724 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:00:40.264663  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.264882  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff3d30394041dd91e5470bfd077bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.266606  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 0843e83eb535425fa9bfac75ce544e73 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:40.268203  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0843e83eb535425fa9bfac75ce544e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.270197  1680 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff3d30394041dd91e5470bfd077bab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:40.270330  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 788938c376a646979b8eee973560dc65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:00:40.271632  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff3d30394041dd91e5470bfd077bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.281038  1524 tablet_service.cc:1511] Processing CreateTablet for tablet a8ff3d30394041dd91e5470bfd077bab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:00:40.282444  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff3d30394041dd91e5470bfd077bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.290473  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 0843e83eb535425fa9bfac75ce544e73 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:40.294648  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0843e83eb535425fa9bfac75ce544e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.312216  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5853661a3b2948fbb9b9483e9e4176a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.313181  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 788938c376a646979b8eee973560dc65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.316675  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab24966f65364407bb1fe4072a40c0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.324635  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68971e7ff2b548529978ee5a5d55a724. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.328661  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38d50e761f346b8b9b49b532d70e057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.332681  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90b90f8e722a4f1ebab12217cf2171e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.333076  1601 tablet_service.cc:1511] Processing CreateTablet for tablet f2157e4514164aedb7c5dc22acfb5ca6 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:40.334565  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2157e4514164aedb7c5dc22acfb5ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.336609  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752aab0c230943e5a7d35d3d2ff9e555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.343897  1526 tablet_service.cc:1511] Processing CreateTablet for tablet f2157e4514164aedb7c5dc22acfb5ca6 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:40.354360  1603 tablet_service.cc:1511] Processing CreateTablet for tablet c2ec497bce574477bc2b2cc694aa0637 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:40.354911  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 7137e5b424304fc6a6513886dd9dc135 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:40.355931  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ec497bce574477bc2b2cc694aa0637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.311765  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 7137e5b424304fc6a6513886dd9dc135 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:40.362739  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 2e50d062d07e4a4eac4206ea9ec136cd (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:40.365710  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 2e50d062d07e4a4eac4206ea9ec136cd (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:40.373611  1731 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:40.381188  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7137e5b424304fc6a6513886dd9dc135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.383257  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd446bc21be451c86d30ee76d6e6137 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:40.384001  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 71514c8580924feb8600dfd3daef60d8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:40.385028  1732 tablet_bootstrap.cc:492] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:40.387176  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd446bc21be451c86d30ee76d6e6137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.376902  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7137e5b424304fc6a6513886dd9dc135. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:40.388057  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:40.389249  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2157e4514164aedb7c5dc22acfb5ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.388346  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71514c8580924feb8600dfd3daef60d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.392450  1730 tablet_bootstrap.cc:654] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.371248  1530 tablet_service.cc:1511] Processing CreateTablet for tablet c2ec497bce574477bc2b2cc694aa0637 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:40.405100  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd446bc21be451c86d30ee76d6e6137 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:40.406984  1602 tablet_service.cc:1511] Processing CreateTablet for tablet fbf20d67081f4a66af2b6a3bb0145baf (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:40.408339  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf20d67081f4a66af2b6a3bb0145baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.403914  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e50d062d07e4a4eac4206ea9ec136cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.415220  1523 tablet_service.cc:1511] Processing CreateTablet for tablet fbf20d67081f4a66af2b6a3bb0145baf (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:40.423759  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e50d062d07e4a4eac4206ea9ec136cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.430172  1731 tablet_bootstrap.cc:654] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.445358  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 84c11953e2154a45af2433ff69b8c3ca (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:40.446823  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c11953e2154a45af2433ff69b8c3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.453624  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 0843e83eb535425fa9bfac75ce544e73 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:00:40.455545  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0843e83eb535425fa9bfac75ce544e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.432238  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 145197b092764852a509770daae94107 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:40.456928  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145197b092764852a509770daae94107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.456845  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 71514c8580924feb8600dfd3daef60d8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:40.465082  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ec497bce574477bc2b2cc694aa0637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.418762  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 151c008abeca49c386849be63d874dca (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:40.469807  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151c008abeca49c386849be63d874dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.473206  1732 tablet_bootstrap.cc:654] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.477849  1677 tablet_service.cc:1511] Processing CreateTablet for tablet f2157e4514164aedb7c5dc22acfb5ca6 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:00:40.485740  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 145197b092764852a509770daae94107 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:40.486502  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd446bc21be451c86d30ee76d6e6137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.487293  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145197b092764852a509770daae94107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.488234  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf20d67081f4a66af2b6a3bb0145baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.485740  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 151c008abeca49c386849be63d874dca (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:40.490518  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151c008abeca49c386849be63d874dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.498064  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2157e4514164aedb7c5dc22acfb5ca6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.500361  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 7137e5b424304fc6a6513886dd9dc135 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:00:40.501802  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7137e5b424304fc6a6513886dd9dc135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.505792  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71514c8580924feb8600dfd3daef60d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.515338  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 71514c8580924feb8600dfd3daef60d8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:00:40.516891  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71514c8580924feb8600dfd3daef60d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.524777  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 2e50d062d07e4a4eac4206ea9ec136cd (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:00:40.519629  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 4fd446bc21be451c86d30ee76d6e6137 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:00:40.526381  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e50d062d07e4a4eac4206ea9ec136cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.527217  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd446bc21be451c86d30ee76d6e6137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.529435  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 84c11953e2154a45af2433ff69b8c3ca (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:40.530862  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c11953e2154a45af2433ff69b8c3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.532186  1675 tablet_service.cc:1511] Processing CreateTablet for tablet fbf20d67081f4a66af2b6a3bb0145baf (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:00:40.533843  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf20d67081f4a66af2b6a3bb0145baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.535406  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 266184feaae1425bb1318e53e4b7d584 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:40.537185  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266184feaae1425bb1318e53e4b7d584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.545149  1674 tablet_service.cc:1511] Processing CreateTablet for tablet c2ec497bce574477bc2b2cc694aa0637 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:00:40.546728  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2ec497bce574477bc2b2cc694aa0637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.558040  1731 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:40.558658  1731 ts_tablet_manager.cc:1403] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.188s	user 0.008s	sys 0.014s
I20260709 13:00:40.561340  1732 tablet_bootstrap.cc:492] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:40.561831  1732 ts_tablet_manager.cc:1403] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.184s	user 0.012s	sys 0.004s
I20260709 13:00:40.568277  1731 raft_consensus.cc:359] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.569197  1731 raft_consensus.cc:385] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.569538  1731 raft_consensus.cc:740] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.570578  1731 consensus_queue.cc:260] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.573930  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 151c008abeca49c386849be63d874dca (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:00:40.575266  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151c008abeca49c386849be63d874dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.577414  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 145197b092764852a509770daae94107 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:00:40.597944  1732 raft_consensus.cc:359] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.599123  1732 raft_consensus.cc:385] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.599491  1732 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.600376  1732 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.571674  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 336b1cd3c29f40b094a733c275aecd2d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:40.591259  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145197b092764852a509770daae94107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.606717  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 336b1cd3c29f40b094a733c275aecd2d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:40.608219  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336b1cd3c29f40b094a733c275aecd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.608425  1730 tablet_bootstrap.cc:492] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:40.608968  1730 ts_tablet_manager.cc:1403] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.380s	user 0.010s	sys 0.018s
I20260709 13:00:40.612550  1730 raft_consensus.cc:359] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.613479  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 8967fd754a1f427d8138f7d6380b06c0 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:40.614943  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8967fd754a1f427d8138f7d6380b06c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.616688  1730 raft_consensus.cc:385] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.613237  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 23137a56fb91492eb22faa7c97ee9aec (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:40.630430  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 8967fd754a1f427d8138f7d6380b06c0 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:40.632025  1566 heartbeater.cc:499] Master 127.0.107.254:33773 was elected leader, sending a full tablet report...
I20260709 13:00:40.595602  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 84c11953e2154a45af2433ff69b8c3ca (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:00:40.624014  1730 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.643481  1730 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.645746  1731 ts_tablet_manager.cc:1434] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.087s	user 0.014s	sys 0.014s
I20260709 13:00:40.645670  1598 tablet_service.cc:1511] Processing CreateTablet for tablet 12cfcd1acccf48648cff7c74ca7f4964 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:40.646641  1641 heartbeater.cc:499] Master 127.0.107.254:33773 was elected leader, sending a full tablet report...
I20260709 13:00:40.647104  1731 tablet_bootstrap.cc:492] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:40.647347  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cfcd1acccf48648cff7c74ca7f4964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.661859  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84c11953e2154a45af2433ff69b8c3ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.663414  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 266184feaae1425bb1318e53e4b7d584 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:40.669381  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266184feaae1425bb1318e53e4b7d584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.669184  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 266184feaae1425bb1318e53e4b7d584 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:00:40.671418  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266184feaae1425bb1318e53e4b7d584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.676625  1599 tablet_service.cc:1511] Processing CreateTablet for tablet 71e3bb6ac3eb408ba9c57b48de886d65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:40.678134  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e3bb6ac3eb408ba9c57b48de886d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.639436  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336b1cd3c29f40b094a733c275aecd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.692369  1736 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.692996  1736 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.695978  1736 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:40.706754  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 336b1cd3c29f40b094a733c275aecd2d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:00:40.713493  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336b1cd3c29f40b094a733c275aecd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.720243  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23137a56fb91492eb22faa7c97ee9aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.730322  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 12cfcd1acccf48648cff7c74ca7f4964 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:40.733755  1524 tablet_service.cc:1511] Processing CreateTablet for tablet 71e3bb6ac3eb408ba9c57b48de886d65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:40.708567  1731 tablet_bootstrap.cc:654] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.772332  1715 heartbeater.cc:499] Master 127.0.107.254:33773 was elected leader, sending a full tablet report...
I20260709 13:00:40.773353  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:40.775271  1580 leader_election.cc:343] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.777177  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 16ec23ffe82f42bfad9cca928a92d9ab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:40.778198  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cfcd1acccf48648cff7c74ca7f4964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.781409  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 16ec23ffe82f42bfad9cca928a92d9ab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:40.782783  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ec23ffe82f42bfad9cca928a92d9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.794535  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 5c75c8e4f95149fba99bb9728c2f21d8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:40.719791  1528 tablet_service.cc:1511] Processing CreateTablet for tablet 23137a56fb91492eb22faa7c97ee9aec (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:40.801043  1730 ts_tablet_manager.cc:1434] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.192s	user 0.010s	sys 0.011s
I20260709 13:00:40.802268  1730 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:40.803494  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 8967fd754a1f427d8138f7d6380b06c0 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:00:40.807050  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8967fd754a1f427d8138f7d6380b06c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.813701  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8967fd754a1f427d8138f7d6380b06c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.818691  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 23137a56fb91492eb22faa7c97ee9aec (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:00:40.827495  1732 ts_tablet_manager.cc:1434] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.265s	user 0.020s	sys 0.047s
I20260709 13:00:40.820472  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 71e3bb6ac3eb408ba9c57b48de886d65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:00:40.832809  1732 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:40.827025  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 5c75c8e4f95149fba99bb9728c2f21d8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:40.831388  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 16ec23ffe82f42bfad9cca928a92d9ab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:00:40.838672  1730 tablet_bootstrap.cc:654] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.827343  1731 tablet_bootstrap.cc:492] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:40.840759  1731 ts_tablet_manager.cc:1403] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.194s	user 0.010s	sys 0.010s
I20260709 13:00:40.849972  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c75c8e4f95149fba99bb9728c2f21d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.853017  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23137a56fb91492eb22faa7c97ee9aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.855275  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ec23ffe82f42bfad9cca928a92d9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.820858  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23137a56fb91492eb22faa7c97ee9aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.860307  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 94b39a427ff64e86af918d4b96740100 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:40.861320  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e3bb6ac3eb408ba9c57b48de886d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.864207  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c75c8e4f95149fba99bb9728c2f21d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.856632  1731 raft_consensus.cc:359] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.865115  1731 raft_consensus.cc:385] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.846740  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 5c75c8e4f95149fba99bb9728c2f21d8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:00:40.857409  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 94b39a427ff64e86af918d4b96740100 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:40.865110  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ec23ffe82f42bfad9cca928a92d9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.868944  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b39a427ff64e86af918d4b96740100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.865595  1731 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:40.873301  1731 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.874171  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:40.876392  1579 leader_election.cc:343] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:40.877038  1579 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:40.878245  1736 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:40.882182  1732 tablet_bootstrap.cc:654] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.819377  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 12cfcd1acccf48648cff7c74ca7f4964 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:00:40.888222  1731 ts_tablet_manager.cc:1434] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.001s
I20260709 13:00:40.889247  1731 tablet_bootstrap.cc:492] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:40.891702  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e3bb6ac3eb408ba9c57b48de886d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.894426  1525 tablet_service.cc:1511] Processing CreateTablet for tablet f13a8325fe104b2582f097044dcef93c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:40.898823  1531 tablet_service.cc:1511] Processing CreateTablet for tablet e0015d06d436447fb3ebe76172dc1798 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:40.902822  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 94b39a427ff64e86af918d4b96740100 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:00:40.905684  1602 tablet_service.cc:1511] Processing CreateTablet for tablet f13a8325fe104b2582f097044dcef93c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:40.907270  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13a8325fe104b2582f097044dcef93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.911921  1606 tablet_service.cc:1511] Processing CreateTablet for tablet e0015d06d436447fb3ebe76172dc1798 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:40.919551  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b39a427ff64e86af918d4b96740100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.920323  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0015d06d436447fb3ebe76172dc1798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.921851  1731 tablet_bootstrap.cc:654] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:40.925045  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b39a427ff64e86af918d4b96740100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.925203  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13a8325fe104b2582f097044dcef93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.929867  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cfcd1acccf48648cff7c74ca7f4964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.930136  1730 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:40.930740  1730 ts_tablet_manager.cc:1403] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.000s
I20260709 13:00:40.933003  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c75c8e4f95149fba99bb9728c2f21d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.939261  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0015d06d436447fb3ebe76172dc1798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.930172  1674 tablet_service.cc:1511] Processing CreateTablet for tablet f13a8325fe104b2582f097044dcef93c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:00:40.946519  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f13a8325fe104b2582f097044dcef93c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.965821  1679 tablet_service.cc:1511] Processing CreateTablet for tablet e0015d06d436447fb3ebe76172dc1798 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:00:40.967394  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0015d06d436447fb3ebe76172dc1798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:40.995352  1730 raft_consensus.cc:359] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:40.996285  1730 raft_consensus.cc:385] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:40.996611  1730 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.000418  1736 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.000998  1736 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.003564  1736 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:41.004987  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:41.005739  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:41.006681  1579 leader_election.cc:343] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:41.007405  1580 leader_election.cc:343] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.007890  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:41.009243  1736 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.010469  1528 tablet_service.cc:1511] Processing CreateTablet for tablet a93cfc3bb7634fb1b78c60f120616d9d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:41.011454  1604 tablet_service.cc:1511] Processing CreateTablet for tablet a93cfc3bb7634fb1b78c60f120616d9d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:41.012815  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93cfc3bb7634fb1b78c60f120616d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.021173  1677 tablet_service.cc:1511] Processing CreateTablet for tablet a93cfc3bb7634fb1b78c60f120616d9d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:00:41.022676  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93cfc3bb7634fb1b78c60f120616d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.026690  1731 tablet_bootstrap.cc:492] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:41.027488  1731 ts_tablet_manager.cc:1403] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.003s
I20260709 13:00:41.028980  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93cfc3bb7634fb1b78c60f120616d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.039885  1737 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.040851  1737 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.067842  1732 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:41.077803  1732 ts_tablet_manager.cc:1403] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.245s	user 0.017s	sys 0.012s
W20260709 13:00:41.079502  1424 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46752.4us
I20260709 13:00:41.081873  1732 raft_consensus.cc:359] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.083410  1732 raft_consensus.cc:385] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.084424  1738 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.083776  1529 tablet_service.cc:1511] Processing CreateTablet for tablet d3d04d35de654d5a8be688548f244d88 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:40.997453  1730 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.084991  1738 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.085700  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d04d35de654d5a8be688548f244d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.083940  1731 raft_consensus.cc:359] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.092288  1680 tablet_service.cc:1511] Processing CreateTablet for tablet d3d04d35de654d5a8be688548f244d88 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:41.093999  1737 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:41.083768  1732 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.089658  1731 raft_consensus.cc:385] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.130105  1730 ts_tablet_manager.cc:1434] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.199s	user 0.020s	sys 0.008s
I20260709 13:00:41.133283  1732 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.134418  1601 tablet_service.cc:1511] Processing CreateTablet for tablet d3d04d35de654d5a8be688548f244d88 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:00:41.137061  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d04d35de654d5a8be688548f244d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.140237  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d04d35de654d5a8be688548f244d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.132413  1730 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:41.151181  1730 tablet_bootstrap.cc:654] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.114348  1731 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.151938  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 08378fd70b734734992a8174ab0ecfc8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:41.153452  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08378fd70b734734992a8174ab0ecfc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.152902  1731 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.159797  1731 ts_tablet_manager.cc:1434] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.132s	user 0.014s	sys 0.000s
I20260709 13:00:41.161219  1731 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:41.175568  1600 tablet_service.cc:1511] Processing CreateTablet for tablet e0872608ab1d42e5b8f77cd6552348b3 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:41.177275  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0872608ab1d42e5b8f77cd6552348b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.175568  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 67e293fa644844dd93fd078b7ba39692 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:41.181658  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e293fa644844dd93fd078b7ba39692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.185489  1672 tablet_service.cc:1511] Processing CreateTablet for tablet e0872608ab1d42e5b8f77cd6552348b3 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:41.187333  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0872608ab1d42e5b8f77cd6552348b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.189244  1738 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:00:41.244735  1678 tablet_service.cc:1511] Processing CreateTablet for tablet 423e376b43454bf396ca57e6aad172f5 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:41.251268  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 08378fd70b734734992a8174ab0ecfc8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:41.271045  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08378fd70b734734992a8174ab0ecfc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.252369  1732 ts_tablet_manager.cc:1434] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.174s	user 0.009s	sys 0.002s
I20260709 13:00:41.198201  1675 tablet_service.cc:1511] Processing CreateTablet for tablet 67e293fa644844dd93fd078b7ba39692 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:41.255231  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 08378fd70b734734992a8174ab0ecfc8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:00:41.259106  1731 tablet_bootstrap.cc:654] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.260788  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 67e293fa644844dd93fd078b7ba39692 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:00:41.265617  1678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423e376b43454bf396ca57e6aad172f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.286100  1730 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:41.288437  1730 ts_tablet_manager.cc:1403] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.157s	user 0.020s	sys 0.008s
I20260709 13:00:41.291816  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 7c93bc5462474ec6bb7155abd2e93aac (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:41.296275  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe4d60be9064db2abedb55cb715c172 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:41.297565  1730 raft_consensus.cc:359] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.298573  1730 raft_consensus.cc:385] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.299036  1730 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.299238  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 423e376b43454bf396ca57e6aad172f5 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:41.300309  1730 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.301119  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e293fa644844dd93fd078b7ba39692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.300846  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 91dad730840e45b68065507815614a40 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:41.303511  1730 ts_tablet_manager.cc:1434] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.008s
I20260709 13:00:41.305882  1732 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:41.266273  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 72c7a933e3e84bcfb3f8de277043f0ab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:41.272419  1527 tablet_service.cc:1511] Processing CreateTablet for tablet 72c7a933e3e84bcfb3f8de277043f0ab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:41.307542  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c7a933e3e84bcfb3f8de277043f0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.284868  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67e293fa644844dd93fd078b7ba39692. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.311636  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08378fd70b734734992a8174ab0ecfc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.271938  1524 tablet_service.cc:1511] Processing CreateTablet for tablet e0872608ab1d42e5b8f77cd6552348b3 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:00:41.313036  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423e376b43454bf396ca57e6aad172f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.315521  1527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c7a933e3e84bcfb3f8de277043f0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.316608  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91dad730840e45b68065507815614a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.319521  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe4d60be9064db2abedb55cb715c172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.321795  1671 tablet_service.cc:1511] Processing CreateTablet for tablet 7c93bc5462474ec6bb7155abd2e93aac (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:41.339890  1680 tablet_service.cc:1511] Processing CreateTablet for tablet 91dad730840e45b68065507815614a40 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:41.349157  1524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0872608ab1d42e5b8f77cd6552348b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.352331  1671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c93bc5462474ec6bb7155abd2e93aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.355777  1732 tablet_bootstrap.cc:654] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.356451  1680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91dad730840e45b68065507815614a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.370568  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:41.376387  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:41.378612  1505 leader_election.cc:343] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.385993  1673 tablet_service.cc:1511] Processing CreateTablet for tablet dbc0065dafc14741989730fd503966f0 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:41.387241  1677 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe4d60be9064db2abedb55cb715c172 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:41.388300  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc0065dafc14741989730fd503966f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.389045  1531 tablet_service.cc:1511] Processing CreateTablet for tablet d4fad2168ccb42729f2409fbb0a88116 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:00:41.396344  1424 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 57761.8us
I20260709 13:00:41.400388  1674 tablet_service.cc:1511] Processing CreateTablet for tablet d4fad2168ccb42729f2409fbb0a88116 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:41.401861  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4fad2168ccb42729f2409fbb0a88116. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:41.455111  1423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52725.8us
W20260709 13:00:41.457603  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:41.460210  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe4d60be9064db2abedb55cb715c172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.463989  1672 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8196c0532243f8ba687a00d2857d80 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:41.466053  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8196c0532243f8ba687a00d2857d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.467789  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 423e376b43454bf396ca57e6aad172f5 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:00:41.464401  1528 tablet_service.cc:1511] Processing CreateTablet for tablet dbc0065dafc14741989730fd503966f0 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:41.469300  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423e376b43454bf396ca57e6aad172f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.470445  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 91dad730840e45b68065507815614a40 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:00:41.467687  1599 tablet_service.cc:1511] Processing CreateTablet for tablet dbc0065dafc14741989730fd503966f0 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:00:41.471997  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91dad730840e45b68065507815614a40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.473241  1606 tablet_service.cc:1511] Processing CreateTablet for tablet 72c7a933e3e84bcfb3f8de277043f0ab (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:00:41.483227  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c7a933e3e84bcfb3f8de277043f0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.474725  1598 tablet_service.cc:1511] Processing CreateTablet for tablet d4fad2168ccb42729f2409fbb0a88116 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:00:41.485882  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4fad2168ccb42729f2409fbb0a88116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.469323  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe4d60be9064db2abedb55cb715c172 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:00:41.489818  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe4d60be9064db2abedb55cb715c172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.490360  1675 tablet_service.cc:1511] Processing CreateTablet for tablet ba63305badaf4879aab6ec160417462c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:41.491734  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba63305badaf4879aab6ec160417462c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.475206  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4fad2168ccb42729f2409fbb0a88116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.476971  1737 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.478143  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 03ff5e9bb5cd4c7590aecf8720904921 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:41.451921  1730 tablet_bootstrap.cc:492] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:41.469323  1602 tablet_service.cc:1511] Processing CreateTablet for tablet 7c93bc5462474ec6bb7155abd2e93aac (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:00:41.473902  1736 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.498648  1737 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.499094  1736 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.501121  1737 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:41.501609  1736 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:41.502720  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc0065dafc14741989730fd503966f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.503824  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:41.503822  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:41.506368  1579 leader_election.cc:343] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:41.509313  1504 leader_election.cc:343] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.509939  1504 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:41.513357  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:41.514184  1424 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 54684.1us
I20260709 13:00:41.515208  1737 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.522244  1603 tablet_service.cc:1511] Processing CreateTablet for tablet ba63305badaf4879aab6ec160417462c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:41.524320  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c93bc5462474ec6bb7155abd2e93aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.522356  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8196c0532243f8ba687a00d2857d80 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:41.507630  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:41.532423  1738 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.535480  1738 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.536476  1600 tablet_service.cc:1511] Processing CreateTablet for tablet 03ff5e9bb5cd4c7590aecf8720904921 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:41.538506  1738 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:00:41.507632  1505 leader_election.cc:343] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:41.540337  1580 leader_election.cc:343] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.540819  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:41.541975  1736 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.546018  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8196c0532243f8ba687a00d2857d80 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:00:41.547683  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8196c0532243f8ba687a00d2857d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.554072  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:41.556447  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:41.557545  1504 leader_election.cc:343] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.558045  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:41.558722  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ff5e9bb5cd4c7590aecf8720904921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.558516  1529 tablet_service.cc:1511] Processing CreateTablet for tablet 932266aa19544648a426ac5605e04ff8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:41.559840  1525 tablet_service.cc:1511] Processing CreateTablet for tablet 03ff5e9bb5cd4c7590aecf8720904921 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:00:41.563463  1526 tablet_service.cc:1511] Processing CreateTablet for tablet ba63305badaf4879aab6ec160417462c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:00:41.564543  1738 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.565143  1738 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.567461  1738 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:41.534068  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbc0065dafc14741989730fd503966f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.569640  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ff5e9bb5cd4c7590aecf8720904921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.572448  1602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c93bc5462474ec6bb7155abd2e93aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.573344  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba63305badaf4879aab6ec160417462c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.579062  1737 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.575222  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 932266aa19544648a426ac5605e04ff8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:41.581115  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8196c0532243f8ba687a00d2857d80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.581636  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932266aa19544648a426ac5605e04ff8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:00:41.561803  1654 leader_election.cc:343] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.586366  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932266aa19544648a426ac5605e04ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.587512  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03ff5e9bb5cd4c7590aecf8720904921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.588856  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba63305badaf4879aab6ec160417462c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.599752  1730 tablet_bootstrap.cc:654] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:41.584352  1654 leader_election.cc:343] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.608393  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 932266aa19544648a426ac5605e04ff8 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:00:41.609953  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:41.616266  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932266aa19544648a426ac5605e04ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.610994  1732 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:41.611055  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:41.612617  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:41.613265  1731 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:41.621882  1731 ts_tablet_manager.cc:1403] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.461s	user 0.013s	sys 0.022s
I20260709 13:00:41.622148  1523 tablet_service.cc:1511] Processing CreateTablet for tablet f8464531709643ab8a8fd947089037ef (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:41.613571  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:41.623999  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8464531709643ab8a8fd947089037ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.627900  1732 ts_tablet_manager.cc:1403] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.322s	user 0.017s	sys 0.004s
W20260709 13:00:41.624473  1654 leader_election.cc:343] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:41.629884  1654 leader_election.cc:343] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.630318  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:41.631337  1738 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.650549  1731 raft_consensus.cc:359] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.651445  1731 raft_consensus.cc:385] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.651747  1731 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
W20260709 13:00:41.652930  1654 leader_election.cc:343] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.653443  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:41.656184  1738 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.657084  1732 raft_consensus.cc:359] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.658020  1732 raft_consensus.cc:385] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:41.658397  1654 leader_election.cc:343] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.658869  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:41.659595  1738 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:41.662860  1677 tablet_service.cc:1511] Processing CreateTablet for tablet f8464531709643ab8a8fd947089037ef (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:41.664594  1677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8464531709643ab8a8fd947089037ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.664368  1731 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.674439  1528 tablet_service.cc:1511] Processing CreateTablet for tablet f09947f1336f47c4b5bffef2326f83ee (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:41.675810  1528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09947f1336f47c4b5bffef2326f83ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.676505  1730 tablet_bootstrap.cc:492] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:41.677187  1730 ts_tablet_manager.cc:1403] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.312s	user 0.010s	sys 0.006s
I20260709 13:00:41.689743  1731 ts_tablet_manager.cc:1434] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.067s	user 0.012s	sys 0.002s
I20260709 13:00:41.658368  1732 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.699373  1732 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.710845  1672 tablet_service.cc:1511] Processing CreateTablet for tablet f09947f1336f47c4b5bffef2326f83ee (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:41.712016  1732 ts_tablet_manager.cc:1434] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 13:00:41.712579  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09947f1336f47c4b5bffef2326f83ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.725929  1732 tablet_bootstrap.cc:492] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:41.720685  1730 raft_consensus.cc:359] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.732813  1730 raft_consensus.cc:385] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.733242  1730 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.735067  1730 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.738330  1673 tablet_service.cc:1511] Processing CreateTablet for tablet d48f4ba9b7ac4684ba28c86536416e65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:41.742372  1599 tablet_service.cc:1511] Processing CreateTablet for tablet f8464531709643ab8a8fd947089037ef (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:00:41.742501  1598 tablet_service.cc:1511] Processing CreateTablet for tablet f09947f1336f47c4b5bffef2326f83ee (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:00:41.744176  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09947f1336f47c4b5bffef2326f83ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.745123  1529 tablet_service.cc:1511] Processing CreateTablet for tablet d48f4ba9b7ac4684ba28c86536416e65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:41.745787  1600 tablet_service.cc:1511] Processing CreateTablet for tablet d48f4ba9b7ac4684ba28c86536416e65 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:00:41.746634  1529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48f4ba9b7ac4684ba28c86536416e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.747018  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48f4ba9b7ac4684ba28c86536416e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.747080  1600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48f4ba9b7ac4684ba28c86536416e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.739804  1530 tablet_service.cc:1511] Processing CreateTablet for tablet b3ead97901a6414b8541e2d33f5078ac (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:41.749469  1604 tablet_service.cc:1511] Processing CreateTablet for tablet b3ead97901a6414b8541e2d33f5078ac (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:41.750288  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ead97901a6414b8541e2d33f5078ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.751310  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ead97901a6414b8541e2d33f5078ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.754535  1731 tablet_bootstrap.cc:492] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:41.767649  1730 ts_tablet_manager.cc:1434] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.000s
I20260709 13:00:41.769245  1730 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:41.788373  1732 tablet_bootstrap.cc:654] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.789436  1679 tablet_service.cc:1511] Processing CreateTablet for tablet b3ead97901a6414b8541e2d33f5078ac (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:00:41.791018  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ead97901a6414b8541e2d33f5078ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.796609  1599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8464531709643ab8a8fd947089037ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.806659  1523 tablet_service.cc:1511] Processing CreateTablet for tablet a8b7091c66f14b4ba944785e7c8873b9 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:41.813531  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b7091c66f14b4ba944785e7c8873b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.821270  1676 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2543ffd0824f7ca2b1399af5f3b78d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:41.821751  1526 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2543ffd0824f7ca2b1399af5f3b78d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:41.822995  1676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2543ffd0824f7ca2b1399af5f3b78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.823186  1526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2543ffd0824f7ca2b1399af5f3b78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.825840  1730 tablet_bootstrap.cc:654] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.827335  1601 tablet_service.cc:1511] Processing CreateTablet for tablet a8b7091c66f14b4ba944785e7c8873b9 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:41.829290  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b7091c66f14b4ba944785e7c8873b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.834180  1675 tablet_service.cc:1511] Processing CreateTablet for tablet a8b7091c66f14b4ba944785e7c8873b9 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:00:41.836516  1675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8b7091c66f14b4ba944785e7c8873b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.836755  1731 tablet_bootstrap.cc:654] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.842962  1603 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2543ffd0824f7ca2b1399af5f3b78d (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:00:41.844414  1603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2543ffd0824f7ca2b1399af5f3b78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.858822  1525 tablet_service.cc:1511] Processing CreateTablet for tablet c22d7a035bc946478a44cde26ad56efa (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:41.860280  1525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22d7a035bc946478a44cde26ad56efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.876654  1732 tablet_bootstrap.cc:492] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:41.877264  1732 ts_tablet_manager.cc:1403] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.152s	user 0.023s	sys 0.027s
I20260709 13:00:41.882578  1672 tablet_service.cc:1511] Processing CreateTablet for tablet c22d7a035bc946478a44cde26ad56efa (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:41.888569  1672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22d7a035bc946478a44cde26ad56efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.892516  1732 raft_consensus.cc:359] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.893440  1732 raft_consensus.cc:385] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.893810  1732 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.905465  1598 tablet_service.cc:1511] Processing CreateTablet for tablet c22d7a035bc946478a44cde26ad56efa (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:00:41.906951  1598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c22d7a035bc946478a44cde26ad56efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.907254  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 70e893ad27ae41db934ba22b14642022 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:41.907459  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 70e893ad27ae41db934ba22b14642022 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:41.908556  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e893ad27ae41db934ba22b14642022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.908958  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e893ad27ae41db934ba22b14642022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.909265  1730 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:41.909791  1730 ts_tablet_manager.cc:1403] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.141s	user 0.011s	sys 0.006s
I20260709 13:00:41.910989  1604 tablet_service.cc:1511] Processing CreateTablet for tablet 23c94fd76da84decac35ba61e1d5cb3c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:41.912338  1604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c94fd76da84decac35ba61e1d5cb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.903103  1732 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.915138  1732 ts_tablet_manager.cc:1434] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.038s	user 0.000s	sys 0.007s
I20260709 13:00:41.917155  1523 tablet_service.cc:1511] Processing CreateTablet for tablet 23c94fd76da84decac35ba61e1d5cb3c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:41.923378  1673 tablet_service.cc:1511] Processing CreateTablet for tablet 23c94fd76da84decac35ba61e1d5cb3c (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:00:41.925222  1673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c94fd76da84decac35ba61e1d5cb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.933094  1522 tablet_service.cc:1511] Processing CreateTablet for tablet 012a311e17a142298db5d9aa2a92c2f5 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:41.937788  1597 tablet_service.cc:1511] Processing CreateTablet for tablet 012a311e17a142298db5d9aa2a92c2f5 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:41.939061  1597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012a311e17a142298db5d9aa2a92c2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.939754  1679 tablet_service.cc:1511] Processing CreateTablet for tablet 012a311e17a142298db5d9aa2a92c2f5 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:00:41.940932  1679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012a311e17a142298db5d9aa2a92c2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.941823  1731 tablet_bootstrap.cc:492] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:41.942410  1731 ts_tablet_manager.cc:1403] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.188s	user 0.029s	sys 0.025s
I20260709 13:00:41.943222  1601 tablet_service.cc:1511] Processing CreateTablet for tablet 70e893ad27ae41db934ba22b14642022 (DEFAULT_TABLE table=test-workload [id=79c221387fd84597bd6c33ed2faa32ec]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:00:41.944521  1601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e893ad27ae41db934ba22b14642022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.949076  1730 raft_consensus.cc:359] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.949892  1730 raft_consensus.cc:385] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.950196  1730 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.951017  1730 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.953450  1730 ts_tablet_manager.cc:1434] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:00:41.954618  1730 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:41.957743  1731 raft_consensus.cc:359] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.958190  1737 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.958684  1737 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:41.959889  1523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23c94fd76da84decac35ba61e1d5cb3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.960625  1732 tablet_bootstrap.cc:492] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:41.962484  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:41.963192  1690 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:41.963775  1737 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:41.964502  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:41.966300  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:00:41.967181  1505 leader_election.cc:343] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:41.969527  1737 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:41.970063  1737 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.970474  1737 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:41.975373  1522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 012a311e17a142298db5d9aa2a92c2f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:00:41.975534  1732 tablet_bootstrap.cc:654] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:41.983543  1731 raft_consensus.cc:385] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:41.983942  1731 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:41.984761  1731 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.012152  1737 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.016601  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:00:42.018342  1505 leader_election.cc:343] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.020764  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:42.021376  1690 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.025313  1731 ts_tablet_manager.cc:1434] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.083s	user 0.010s	sys 0.000s
I20260709 13:00:42.026914  1731 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:42.030658  1690 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:42.032680  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:42.031261  1737 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.034106  1737 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.034605  1737 raft_consensus.cc:697] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:42.035488  1737 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.061581  1731 tablet_bootstrap.cc:654] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.064579  1730 tablet_bootstrap.cc:654] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.065039  1737 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.065246  1732 tablet_bootstrap.cc:492] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.065853  1732 ts_tablet_manager.cc:1403] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.106s	user 0.043s	sys 0.043s
I20260709 13:00:42.065699  1737 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.067986  1438 catalog_manager.cc:5697] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.069865  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:42.070519  1616 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:42.070461  1732 raft_consensus.cc:359] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.071269  1732 raft_consensus.cc:385] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.071611  1732 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.072178  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:42.072381  1732 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.075278  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:42.077981  1504 leader_election.cc:343] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.079380  1762 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.079974  1737 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.080657  1762 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.081283  1762 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.082661  1731 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:42.083168  1732 ts_tablet_manager.cc:1434] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:00:42.083294  1731 ts_tablet_manager.cc:1403] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.007s
I20260709 13:00:42.084424  1732 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.092749  1732 tablet_bootstrap.cc:654] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.092949  1762 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.098089  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:42.098958  1616 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.098980  1730 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:42.093149  1731 raft_consensus.cc:359] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.100736  1730 ts_tablet_manager.cc:1403] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.146s	user 0.027s	sys 0.012s
I20260709 13:00:42.101750  1731 raft_consensus.cc:385] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.102222  1732 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.102787  1732 ts_tablet_manager.cc:1403] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:00:42.103479  1762 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.102216  1731 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.104912  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:42.105537  1730 raft_consensus.cc:359] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.105409  1731 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.106266  1730 raft_consensus.cc:385] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.105940  1732 raft_consensus.cc:359] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:42.106527  1504 leader_election.cc:343] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.106709  1732 raft_consensus.cc:385] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.106597  1730 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.107256  1732 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.107836  1730 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.108065  1732 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.111267  1732 ts_tablet_manager.cc:1434] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:42.112569  1731 ts_tablet_manager.cc:1434] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.005s
I20260709 13:00:42.113916  1616 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:42.115206  1731 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:42.115334  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:42.112650  1732 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.116928  1762 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.117746  1762 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:42.118604  1762 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.125725  1732 tablet_bootstrap.cc:654] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.127921  1766 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.128484  1766 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.129139  1730 ts_tablet_manager.cc:1434] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 13:00:42.130170  1730 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:42.131770  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:42.132859  1690 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:42.134698  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:42.136215  1504 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:42.137094  1737 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.137470  1737 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.137827  1737 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.139107  1731 tablet_bootstrap.cc:654] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:42.141022  1505 leader_election.cc:343] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.141675  1766 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.142670  1730 tablet_bootstrap.cc:654] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.144578  1736 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.145224  1736 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.150243  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.151405  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:42.152496  1580 leader_election.cc:343] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.152936  1736 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:00:42.153504  1579 leader_election.cc:343] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.154048  1579 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:42.156250  1736 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.158093  1732 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.158958  1732 ts_tablet_manager.cc:1403] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.016s
I20260709 13:00:42.158829  1738 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.159796  1738 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.162528  1737 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.164892  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.165544  1539 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:42.165946  1738 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.169698  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:42.166401  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:42.171254  1616 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:42.167284  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:42.172798  1732 raft_consensus.cc:359] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.173862  1732 raft_consensus.cc:385] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.174322  1732 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
W20260709 13:00:42.174541  1505 leader_election.cc:343] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.175534  1738 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.176156  1738 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.176641  1738 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.175660  1732 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.184127  1732 ts_tablet_manager.cc:1434] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 13:00:42.185809  1732 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.191232  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:42.192155  1690 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.195376  1732 tablet_bootstrap.cc:654] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.202731  1690 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:42.187745  1738 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.211297  1732 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.211956  1732 ts_tablet_manager.cc:1403] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.005s
I20260709 13:00:42.211297  1731 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:42.207159  1737 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.214516  1504 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:42.214519  1731 ts_tablet_manager.cc:1403] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.100s	user 0.031s	sys 0.045s
I20260709 13:00:42.216005  1730 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:42.216614  1730 ts_tablet_manager.cc:1403] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.087s	user 0.020s	sys 0.050s
I20260709 13:00:42.219231  1731 raft_consensus.cc:359] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.219798  1737 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.220129  1731 raft_consensus.cc:385] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.220402  1737 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:42.220602  1731 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.220832  1732 raft_consensus.cc:359] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.221531  1732 raft_consensus.cc:385] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.222142  1732 raft_consensus.cc:740] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.221326  1737 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.221663  1731 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.222843  1732 consensus_queue.cc:260] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.223480  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:42.224102  1539 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.224628  1731 ts_tablet_manager.cc:1434] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:00:42.225466  1732 ts_tablet_manager.cc:1434] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:00:42.225828  1731 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:42.226408  1732 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.226655  1730 raft_consensus.cc:359] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.227375  1730 raft_consensus.cc:385] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.227669  1730 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.228428  1730 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.235589  1731 tablet_bootstrap.cc:654] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.237250  1738 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.239181  1539 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:42.239123  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:42.239923  1616 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.240831  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:42.242051  1738 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.242548  1738 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:42.243346  1738 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.251971  1732 tablet_bootstrap.cc:654] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.254756  1439 catalog_manager.cc:5697] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.256557  1439 catalog_manager.cc:5697] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.257253  1616 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:42.300587  1738 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.301618  1732 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.301234  1738 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.302126  1732 ts_tablet_manager.cc:1403] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.022s
I20260709 13:00:42.303980  1738 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.305451  1732 raft_consensus.cc:359] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.306154  1732 raft_consensus.cc:385] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.306414  1732 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.307093  1732 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.307772  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.306988  1730 ts_tablet_manager.cc:1434] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.090s	user 0.023s	sys 0.028s
I20260709 13:00:42.308885  1539 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:42.309581  1730 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:42.307744  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:42.310192  1731 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:42.311020  1731 ts_tablet_manager.cc:1403] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.022s
I20260709 13:00:42.310400  1439 catalog_manager.cc:5697] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.310316  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:00:42.312342  1654 leader_election.cc:343] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.313467  1780 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.313936  1780 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.314296  1780 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.314719  1731 raft_consensus.cc:359] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.315917  1731 raft_consensus.cc:385] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.316264  1731 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.316998  1731 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.337841  1731 ts_tablet_manager.cc:1434] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.019s
I20260709 13:00:42.338675  1730 tablet_bootstrap.cc:654] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.340060  1732 ts_tablet_manager.cc:1434] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.010s
I20260709 13:00:42.341043  1732 tablet_bootstrap.cc:492] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.342506  1731 tablet_bootstrap.cc:492] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:42.348285  1736 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.348829  1736 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.351063  1732 tablet_bootstrap.cc:654] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.350955  1736 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.351933  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.352494  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:42.353776  1690 raft_consensus.cc:2393] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:42.355300  1731 tablet_bootstrap.cc:654] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.355113  1579 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:42.356235  1736 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.360350  1730 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:42.360848  1730 ts_tablet_manager.cc:1403] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.009s
I20260709 13:00:42.362622  1780 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.363579  1730 raft_consensus.cc:359] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.364289  1730 raft_consensus.cc:385] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.364670  1730 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.364898  1736 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.365309  1730 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.366452  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:42.367089  1539 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.367307  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:00:42.368857  1654 leader_election.cc:343] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.369443  1780 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.371023  1780 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.371573  1780 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.372699  1731 tablet_bootstrap.cc:492] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:42.374040  1731 ts_tablet_manager.cc:1403] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.002s
I20260709 13:00:42.374840  1780 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.376387  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.376783  1539 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:42.377173  1540 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:42.377363  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:42.378139  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:42.379062  1780 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:00:42.379416  1654 leader_election.cc:343] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.380120  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:42.380429  1780 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:42.381148  1732 tablet_bootstrap.cc:492] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.381552  1732 ts_tablet_manager.cc:1403] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.041s	user 0.004s	sys 0.007s
I20260709 13:00:42.381981  1782 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.382467  1782 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.382185  1731 raft_consensus.cc:359] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.382261  1780 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.382938  1782 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.383136  1731 raft_consensus.cc:385] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.383517  1731 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.384269  1731 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.384668  1732 raft_consensus.cc:359] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.385607  1732 raft_consensus.cc:385] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.385917  1732 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.386662  1731 ts_tablet_manager.cc:1434] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:00:42.386756  1732 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.371881  1730 ts_tablet_manager.cc:1434] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:42.391078  1736 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.391618  1736 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.392513  1732 ts_tablet_manager.cc:1434] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:00:42.393507  1732 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.394646  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.395280  1540 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:42.396381  1580 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:42.401021  1732 tablet_bootstrap.cc:654] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.401890  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:42.405469  1730 tablet_bootstrap.cc:492] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:42.406333  1690 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:42.407191  1731 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:42.402890  1736 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.408835  1736 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.409530  1736 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.410040  1782 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.413529  1736 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.412837  1438 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.415637  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:42.416221  1539 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.419199  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:00:42.422729  1654 leader_election.cc:343] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.423512  1782 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.426684  1730 tablet_bootstrap.cc:654] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.431945  1736 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.439814  1730 tablet_bootstrap.cc:492] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:42.440404  1730 ts_tablet_manager.cc:1403] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.005s
I20260709 13:00:42.440994  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:42.441799  1540 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.443320  1730 raft_consensus.cc:359] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.444118  1730 raft_consensus.cc:385] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.444393  1730 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.445061  1730 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.447467  1730 ts_tablet_manager.cc:1434] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:42.445924  1731 tablet_bootstrap.cc:654] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.434037  1539 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:42.449955  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:42.451514  1782 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.452208  1782 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:42.453672  1782 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.455850  1732 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.464210  1732 ts_tablet_manager.cc:1403] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.011s
I20260709 13:00:42.456617  1730 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:42.458230  1787 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.464991  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:42.465637  1690 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.465093  1787 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.465756  1540 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:42.467895  1732 raft_consensus.cc:359] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.469373  1732 raft_consensus.cc:385] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.469691  1732 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.463562  1736 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.469560  1580 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:00:42.462466  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:42.471889  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:42.470634  1787 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.470343  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:42.473382  1579 leader_election.cc:343] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.473646  1539 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:42.474318  1731 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:42.472822  1732 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.474936  1731 ts_tablet_manager.cc:1403] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.015s
I20260709 13:00:42.474859  1580 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:42.475869  1736 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.472801  1787 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.476281  1736 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.476667  1736 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.479837  1732 ts_tablet_manager.cc:1434] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:00:42.480947  1732 tablet_bootstrap.cc:492] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.481248  1787 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:42.481688  1690 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:42.482264  1787 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.488796  1732 tablet_bootstrap.cc:654] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.488438  1731 raft_consensus.cc:359] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.491266  1731 raft_consensus.cc:385] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.491698  1731 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.493634  1731 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.500937  1792 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.501672  1792 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.508216  1792 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.509940  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.491799  1736 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.514465  1731 ts_tablet_manager.cc:1434] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:00:42.517349  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:42.517946  1539 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.519714  1731 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:42.511615  1437 catalog_manager.cc:5697] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.522421  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:42.523370  1690 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:42.519436  1737 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:00:42.525893  1579 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:42.525171  1438 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.527944  1794 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.531311  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:42.535795  1730 tablet_bootstrap.cc:654] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.534899  1736 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.541011  1782 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.541971  1782 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:42.542703  1579 leader_election.cc:343] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.545512  1794 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.551719  1782 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.552348  1539 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:42.554737  1580 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:42.555378  1732 tablet_bootstrap.cc:492] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.553447  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.556901  1540 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:42.557257  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:42.558148  1616 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:42.556165  1732 ts_tablet_manager.cc:1403] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.000s
I20260709 13:00:42.558818  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:42.561451  1782 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.562005  1782 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.562433  1782 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.563112  1732 raft_consensus.cc:359] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.564157  1732 raft_consensus.cc:385] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.564924  1732 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.565968  1794 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.566303  1732 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.569621  1732 ts_tablet_manager.cc:1434] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:00:42.570931  1732 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.567443  1794 raft_consensus.cc:697] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:42.573791  1737 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:42.574532  1794 consensus_queue.cc:237] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.575634  1782 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.578788  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:42.579864  1540 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.581391  1731 tablet_bootstrap.cc:654] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.584184  1730 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:42.584815  1730 ts_tablet_manager.cc:1403] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.129s	user 0.018s	sys 0.011s
I20260709 13:00:42.587524  1732 tablet_bootstrap.cc:654] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.605167  1737 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.617063  1736 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.617810  1736 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.631592  1782 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.633589  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:42.635521  1614 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.634690  1766 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:42.644261  1736 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.645277  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:42.646353  1689 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:42.647696  1614 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:42.648255  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:42.649214  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:42.650157  1782 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.651262  1540 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:42.651932  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.652892  1539 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:42.654078  1782 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:42.661417  1689 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.669428  1736 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.670786  1736 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.671454  1736 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.655856  1782 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.682487  1439 catalog_manager.cc:5697] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:42.689769  1730 raft_consensus.cc:359] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.690829  1730 raft_consensus.cc:385] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.691326  1730 raft_consensus.cc:740] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.697692  1730 consensus_queue.cc:260] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.699820  1730 ts_tablet_manager.cc:1434] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.115s	user 0.004s	sys 0.013s
I20260709 13:00:42.701609  1766 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:42.704818  1730 tablet_bootstrap.cc:492] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:42.707806  1736 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.723676  1731 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:42.722090  1766 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.772666  1731 ts_tablet_manager.cc:1403] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.253s	user 0.021s	sys 0.005s
I20260709 13:00:42.776346  1439 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:42.768522  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:42.783092  1688 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.787398  1737 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.790349  1780 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:42.754885  1782 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.794911  1782 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.798921  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.799190  1782 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:42.752825  1762 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.749486  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:42.753291  1736 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.802954  1732 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:42.803633  1732 ts_tablet_manager.cc:1403] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.233s	user 0.054s	sys 0.064s
I20260709 13:00:42.804700  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:42.804898  1654 leader_election.cc:343] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:42.808184  1654 leader_election.cc:343] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.808753  1654 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:42.811300  1539 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.815459  1732 raft_consensus.cc:359] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.817211  1732 raft_consensus.cc:385] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.817469  1732 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.819125  1688 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:42.773356  1766 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.820437  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:42.821321  1736 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:42.822081  1766 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.822558  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:42.823180  1736 raft_consensus.cc:697] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:42.823395  1615 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:42.823580  1782 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.824679  1732 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.833853  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:42.835021  1737 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:42.835397  1737 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:42.835721  1737 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.818336  1762 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.843125  1732 ts_tablet_manager.cc:1434] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.003s
I20260709 13:00:42.824545  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:42.849470  1504 leader_election.cc:343] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.853845  1539 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:42.862715  1732 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:42.824286  1736 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.851698  1737 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.865411  1794 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.867517  1794 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.875936  1731 raft_consensus.cc:359] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.876540  1731 raft_consensus.cc:385] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.876716  1731 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.877281  1731 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.872593  1794 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.883574  1615 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.883942  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:42.884848  1541 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:00:42.884675  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:42.889782  1579 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:42.891273  1780 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.892974  1780 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:42.896442  1731 ts_tablet_manager.cc:1434] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.123s	user 0.006s	sys 0.001s
I20260709 13:00:42.897313  1731 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:42.903964  1730 tablet_bootstrap.cc:654] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.919045  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:42.923118  1505 leader_election.cc:343] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.926821  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:42.927482  1616 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:42.930194  1792 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.936475  1762 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.964931  1730 tablet_bootstrap.cc:492] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:42.965529  1730 ts_tablet_manager.cc:1403] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.262s	user 0.015s	sys 0.031s
I20260709 13:00:42.969908  1737 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:42.952214  1813 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:00:42.970832  1731 tablet_bootstrap.cc:654] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.971124  1730 raft_consensus.cc:359] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.971987  1730 raft_consensus.cc:385] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:42.972313  1730 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:42.973122  1730 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:42.976303  1732 tablet_bootstrap.cc:654] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:42.977088  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:42.981474  1504 leader_election.cc:343] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:42.981985  1504 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:42.986852  1766 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:42.988940  1730 ts_tablet_manager.cc:1434] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:00:42.992604  1730 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:42.995239  1813 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:42.998224  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:42.998926  1689 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.006564  1613 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.009958  1616 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:43.008399  1736 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:43.012207  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:00:43.012310  1579 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:43.013988  1766 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:43.014523  1766 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:43.015820  1766 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.047547  1792 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.050302  1689 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:43.056264  1782 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.080240  1730 tablet_bootstrap.cc:654] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.095628  1818 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.096365  1818 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.102658  1731 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:43.103325  1731 ts_tablet_manager.cc:1403] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.206s	user 0.012s	sys 0.004s
I20260709 13:00:43.105870  1732 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.106609  1732 ts_tablet_manager.cc:1403] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.244s	user 0.012s	sys 0.012s
I20260709 13:00:43.109616  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:43.107466  1436 catalog_manager.cc:5697] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.115118  1787 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.129463  1731 raft_consensus.cc:359] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.130033  1731 raft_consensus.cc:385] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.130270  1731 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.130769  1731 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:43.134312  1505 leader_election.cc:343] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.139592  1818 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.140985  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.141533  1732 raft_consensus.cc:359] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.142318  1732 raft_consensus.cc:385] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.142568  1732 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
W20260709 13:00:43.143388  1504 leader_election.cc:343] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.144124  1504 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:43.146379  1731 ts_tablet_manager.cc:1434] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:00:43.146461  1818 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:43.147307  1731 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:43.143636  1732 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.183911  1732 ts_tablet_manager.cc:1434] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.077s	user 0.024s	sys 0.016s
I20260709 13:00:43.185798  1732 tablet_bootstrap.cc:492] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.186355  1780 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.191785  1730 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:43.192423  1730 ts_tablet_manager.cc:1403] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.203s	user 0.023s	sys 0.036s
I20260709 13:00:43.198557  1730 raft_consensus.cc:359] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.199440  1730 raft_consensus.cc:385] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.199743  1730 raft_consensus.cc:740] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.201756  1780 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.202839  1732 tablet_bootstrap.cc:654] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.229661  1731 tablet_bootstrap.cc:654] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.229486  1730 consensus_queue.cc:260] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.231644  1730 ts_tablet_manager.cc:1434] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
I20260709 13:00:43.255769  1732 tablet_bootstrap.cc:492] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.256572  1732 ts_tablet_manager.cc:1403] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.021s
I20260709 13:00:43.260438  1732 raft_consensus.cc:359] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.261421  1732 raft_consensus.cc:385] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.261706  1730 tablet_bootstrap.cc:492] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:43.261767  1732 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.263240  1732 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.266611  1732 ts_tablet_manager.cc:1434] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:00:43.268373  1732 tablet_bootstrap.cc:492] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.276216  1732 tablet_bootstrap.cc:654] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.304431  1762 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.305019  1762 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.306501  1730 tablet_bootstrap.cc:654] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.307307  1762 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.309168  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:43.309903  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:43.311219  1504 leader_election.cc:343] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:43.311919  1505 leader_election.cc:343] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.312429  1732 tablet_bootstrap.cc:492] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.312489  1505 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:43.313146  1732 ts_tablet_manager.cc:1403] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.020s
I20260709 13:00:43.313759  1762 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:43.320969  1731 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:43.321532  1731 ts_tablet_manager.cc:1403] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.174s	user 0.023s	sys 0.072s
I20260709 13:00:43.324232  1731 raft_consensus.cc:359] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.326656  1732 raft_consensus.cc:359] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.326679  1439 catalog_manager.cc:5697] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.324924  1731 raft_consensus.cc:385] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.328013  1732 raft_consensus.cc:385] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.328452  1731 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.328639  1732 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.329303  1731 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.329864  1732 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.331669  1731 ts_tablet_manager.cc:1434] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:00:43.332690  1731 tablet_bootstrap.cc:492] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:43.333642  1732 ts_tablet_manager.cc:1434] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:00:43.334661  1732 tablet_bootstrap.cc:492] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.335975  1730 tablet_bootstrap.cc:492] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:43.336551  1730 ts_tablet_manager.cc:1403] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.004s
I20260709 13:00:43.340003  1730 raft_consensus.cc:359] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.340785  1731 tablet_bootstrap.cc:654] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.341207  1732 tablet_bootstrap.cc:654] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.340871  1730 raft_consensus.cc:385] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.341616  1730 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.342537  1730 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.345711  1730 ts_tablet_manager.cc:1434] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:00:43.347787  1730 tablet_bootstrap.cc:492] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:43.353471  1792 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.355031  1732 tablet_bootstrap.cc:492] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.355639  1732 ts_tablet_manager.cc:1403] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:00:43.357110  1730 tablet_bootstrap.cc:654] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.360715  1732 raft_consensus.cc:359] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.362468  1732 raft_consensus.cc:385] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.362850  1732 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.364252  1732 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.366065  1792 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.366653  1792 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.368115  1732 ts_tablet_manager.cc:1434] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.012s	user 0.013s	sys 0.002s
I20260709 13:00:43.369649  1732 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.369983  1689 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.371688  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.370028  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:43.372643  1541 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:43.373298  1730 tablet_bootstrap.cc:492] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
W20260709 13:00:43.373193  1579 leader_election.cc:343] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.374099  1730 ts_tablet_manager.cc:1403] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.003s
I20260709 13:00:43.374374  1580 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:43.376581  1736 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:43.376776  1732 tablet_bootstrap.cc:654] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.377053  1736 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.377465  1736 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.378949  1730 raft_consensus.cc:359] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.379815  1730 raft_consensus.cc:385] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.381081  1730 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.382323  1792 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.382107  1730 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.385210  1730 ts_tablet_manager.cc:1434] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:00:43.388000  1736 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.390314  1730 tablet_bootstrap.cc:492] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:43.394676  1736 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.395659  1732 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.396493  1732 ts_tablet_manager.cc:1403] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 13:00:43.395484  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:43.397967  1541 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.416628  1730 tablet_bootstrap.cc:654] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.417248  1787 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.429533  1732 raft_consensus.cc:359] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.432905  1732 raft_consensus.cc:385] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.433485  1732 raft_consensus.cc:740] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.434664  1732 consensus_queue.cc:260] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.442139  1541 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:43.444130  1580 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:43.445087  1732 ts_tablet_manager.cc:1434] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 13:00:43.427098  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:43.445534  1736 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:43.446383  1736 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:43.446525  1732 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
W20260709 13:00:43.446592  1579 leader_election.cc:343] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.447346  1736 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.454807  1732 tablet_bootstrap.cc:654] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.455662  1730 tablet_bootstrap.cc:492] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:43.455629  1787 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.456323  1730 ts_tablet_manager.cc:1403] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.008s
I20260709 13:00:43.456282  1787 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.459444  1787 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.459687  1730 raft_consensus.cc:359] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.459957  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:43.460404  1730 raft_consensus.cc:385] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.460798  1730 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.461211  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.461588  1730 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:43.461835  1580 leader_election.cc:343] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:43.462765  1579 leader_election.cc:343] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.463215  1579 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:43.463874  1730 ts_tablet_manager.cc:1434] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:43.464233  1787 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:43.465251  1730 tablet_bootstrap.cc:492] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:43.468549  1731 tablet_bootstrap.cc:492] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:43.469141  1731 ts_tablet_manager.cc:1403] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.137s	user 0.028s	sys 0.017s
I20260709 13:00:43.471628  1730 tablet_bootstrap.cc:654] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.479475  1731 raft_consensus.cc:359] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.481772  1731 raft_consensus.cc:385] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.482197  1731 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.487397  1731 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.488575  1829 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.489713  1731 ts_tablet_manager.cc:1434] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:00:43.489348  1829 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.492544  1829 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:43.493113  1731 tablet_bootstrap.cc:492] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:43.493827  1732 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.494366  1732 ts_tablet_manager.cc:1403] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.001s
I20260709 13:00:43.494977  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:43.495500  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:43.496753  1654 leader_election.cc:343] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:43.497779  1654 leader_election.cc:343] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.497658  1732 raft_consensus.cc:359] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.498225  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:43.498450  1732 raft_consensus.cc:385] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.498886  1732 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.500213  1732 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.488063  1439 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.502664  1829 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:43.509933  1732 ts_tablet_manager.cc:1434] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:00:43.511463  1732 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.512338  1766 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.516397  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:43.518124  1766 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.521413  1766 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.522594  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.523351  1689 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:43.524766  1504 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:43.525336  1731 tablet_bootstrap.cc:654] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.524416  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:43.525873  1766 raft_consensus.cc:2804] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:43.526259  1766 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.526630  1766 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:43.527545  1505 leader_election.cc:343] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.532343  1730 tablet_bootstrap.cc:492] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:43.533144  1730 ts_tablet_manager.cc:1403] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.004s
I20260709 13:00:43.537636  1730 raft_consensus.cc:359] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.538625  1730 raft_consensus.cc:385] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.538970  1730 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.543556  1766 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.544260  1732 tablet_bootstrap.cc:654] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.544684  1731 tablet_bootstrap.cc:492] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:43.545156  1731 ts_tablet_manager.cc:1403] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.003s
I20260709 13:00:43.546195  1766 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.547178  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:43.539934  1730 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:43.548853  1505 leader_election.cc:343] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.548731  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:43.550195  1689 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.550804  1731 raft_consensus.cc:359] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.551781  1731 raft_consensus.cc:385] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.552192  1731 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.552938  1731 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.555452  1730 ts_tablet_manager.cc:1434] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260709 13:00:43.557014  1730 tablet_bootstrap.cc:492] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:43.565150  1689 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:43.568784  1731 ts_tablet_manager.cc:1434] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:00:43.571177  1731 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:43.573858  1730 tablet_bootstrap.cc:654] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.574298  1732 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.574764  1732 ts_tablet_manager.cc:1403] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.005s
I20260709 13:00:43.576604  1504 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:43.578265  1766 raft_consensus.cc:2804] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:43.578809  1766 raft_consensus.cc:697] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:43.579715  1766 consensus_queue.cc:237] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.582435  1732 raft_consensus.cc:359] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.583391  1732 raft_consensus.cc:385] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.583679  1732 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.584520  1732 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.587688  1732 ts_tablet_manager.cc:1434] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:00:43.590117  1732 tablet_bootstrap.cc:492] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.590142  1731 tablet_bootstrap.cc:654] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.590894  1730 tablet_bootstrap.cc:492] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:43.592854  1730 ts_tablet_manager.cc:1403] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.007s
I20260709 13:00:43.596630  1818 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.598699  1732 tablet_bootstrap.cc:654] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.600337  1730 raft_consensus.cc:359] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.601159  1730 raft_consensus.cc:385] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.601431  1730 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.602466  1730 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.606154  1818 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:43.609354  1731 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:43.610072  1731 ts_tablet_manager.cc:1403] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.008s
I20260709 13:00:43.612434  1730 ts_tablet_manager.cc:1434] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:00:43.613500  1730 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:43.619115  1731 raft_consensus.cc:359] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.622953  1731 raft_consensus.cc:385] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.623970  1731 raft_consensus.cc:740] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.625497  1731 consensus_queue.cc:260] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.627779  1762 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.629482  1762 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.630657  1730 tablet_bootstrap.cc:654] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.632167  1731 ts_tablet_manager.cc:1434] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:00:43.634259  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:43.636535  1505 leader_election.cc:343] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.637893  1762 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.642699  1736 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.643388  1736 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.646363  1787 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.646940  1787 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.647838  1736 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.649107  1787 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.651429  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.652328  1688 raft_consensus.cc:2393] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:43.654072  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:43.654699  1539 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:43.655805  1731 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:43.655663  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:43.655709  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.657744  1689 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:43.659160  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:43.659967  1787 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:43.660351  1787 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.660691  1787 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.660941  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.661895  1688 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:43.663409  1818 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.664368  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:43.664438  1818 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.665704  1762 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:43.666097  1762 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.666455  1762 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.666847  1818 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.669488  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:43.670426  1736 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.670929  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.671913  1688 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:43.673570  1504 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:43.678544  1787 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.686316  1787 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.687130  1858 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:43.690768  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:43.691275  1858 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.691525  1541 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.692225  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:43.704492  1613 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:43.709407  1858 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.726410  1736 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:43.734994  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:43.736080  1762 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.738823  1762 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.735836  1689 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.745601  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:43.746330  1688 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.748482  1541 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:43.762382  1439 catalog_manager.cc:5697] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.780093  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:43.781132  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:43.782006  1787 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:43.782532  1787 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:43.785611  1688 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:43.787213  1732 tablet_bootstrap.cc:492] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.787564  1732 ts_tablet_manager.cc:1403] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.198s	user 0.042s	sys 0.055s
I20260709 13:00:43.790195  1732 raft_consensus.cc:359] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.791486  1732 raft_consensus.cc:385] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.791790  1732 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.793095  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:43.794165  1818 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:43.793785  1732 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.794627  1818 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:43.799042  1731 tablet_bootstrap.cc:654] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.801255  1766 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.801960  1766 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.795480  1818 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.783380  1787 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:43.825016  1505 leader_election.cc:343] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.825711  1730 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:43.826237  1730 ts_tablet_manager.cc:1403] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.213s	user 0.062s	sys 0.083s
I20260709 13:00:43.828341  1766 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.828747  1689 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:43.830523  1730 raft_consensus.cc:359] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:43.832623  1852 log.cc:927] Time spent T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:00:43.832929  1730 raft_consensus.cc:385] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.833266  1730 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.836233  1732 ts_tablet_manager.cc:1434] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.020s
I20260709 13:00:43.852078  1732 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.851752  1730 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.859860  1859 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.860596  1859 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:43.857409  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 44766us
I20260709 13:00:43.866945  1730 ts_tablet_manager.cc:1434] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.007s
I20260709 13:00:43.867856  1730 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:43.863045  1858 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.875906  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:43.879794  1731 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:43.880340  1731 ts_tablet_manager.cc:1403] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.225s	user 0.017s	sys 0.002s
I20260709 13:00:43.886382  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.887566  1732 tablet_bootstrap.cc:654] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.870817  1859 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.892377  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:43.893290  1504 leader_election.cc:343] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.891088  1439 catalog_manager.cc:5697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.894274  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:43.896382  1505 leader_election.cc:343] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:43.899089  1504 leader_election.cc:343] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.899636  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:43.894269  1858 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.910706  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:43.911412  1690 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.910744  1730 tablet_bootstrap.cc:654] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.911489  1731 raft_consensus.cc:359] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.915354  1731 raft_consensus.cc:385] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.915510  1732 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.915690  1731 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.916639  1732 ts_tablet_manager.cc:1403] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.008s
I20260709 13:00:43.917228  1731 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.917589  1438 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.922807  1731 ts_tablet_manager.cc:1434] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:00:43.922778  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:43.924256  1613 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.907713  1818 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:43.927922  1505 leader_election.cc:343] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.930162  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:43.931413  1858 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:43.932262  1731 tablet_bootstrap.cc:492] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:43.934234  1690 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:43.936849  1613 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:43.937428  1504 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:43.940563  1732 raft_consensus.cc:359] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.941318  1732 raft_consensus.cc:385] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.941601  1732 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.942271  1732 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.942790  1858 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:43.943260  1859 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.943789  1858 raft_consensus.cc:697] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:43.943719  1859 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.944749  1858 consensus_queue.cc:237] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.945996  1859 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.946918  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:43.948539  1732 ts_tablet_manager.cc:1434] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
W20260709 13:00:43.948553  1505 leader_election.cc:343] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.949558  1732 tablet_bootstrap.cc:492] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.950872  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:43.951618  1690 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:43.953208  1731 tablet_bootstrap.cc:654] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.953162  1504 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:43.954241  1818 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:43.954607  1818 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.954908  1818 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:43.959924  1732 tablet_bootstrap.cc:654] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.970726  1439 catalog_manager.cc:5697] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:43.972499  1732 tablet_bootstrap.cc:492] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:43.973062  1732 ts_tablet_manager.cc:1403] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 13:00:43.973609  1730 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:43.974123  1730 ts_tablet_manager.cc:1403] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.002s
I20260709 13:00:43.974558  1731 tablet_bootstrap.cc:492] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:43.975081  1731 ts_tablet_manager.cc:1403] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 13:00:43.976568  1730 raft_consensus.cc:359] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.977156  1730 raft_consensus.cc:385] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.977392  1730 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.978039  1730 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.977728  1731 raft_consensus.cc:359] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.978948  1731 raft_consensus.cc:385] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.979223  1731 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.979592  1818 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.979981  1731 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.982091  1731 ts_tablet_manager.cc:1434] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:43.982591  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:43.982832  1818 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:43.982980  1731 tablet_bootstrap.cc:492] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
W20260709 13:00:43.984086  1505 leader_election.cc:343] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.984800  1730 ts_tablet_manager.cc:1434] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:00:43.985839  1730 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:43.985523  1732 raft_consensus.cc:359] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.986351  1732 raft_consensus.cc:385] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:43.986598  1780 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.987094  1732 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:43.987152  1780 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.988101  1732 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:43.989483  1780 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:43.990242  1732 ts_tablet_manager.cc:1434] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:00:43.991158  1732 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:43.992348  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:43.993157  1730 tablet_bootstrap.cc:654] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.995293  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:43.996527  1731 tablet_bootstrap.cc:654] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.998135  1732 tablet_bootstrap.cc:654] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:43.998143  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:44.000627  1690 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.001560  1780 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.002067  1780 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.003333  1818 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:44.004391  1780 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.008006  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.008854  1539 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
W20260709 13:00:44.011922  1654 leader_election.cc:343] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:43.995962  1541 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:44.013325  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:44.020550  1690 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:44.014047  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:44.022537  1504 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:44.022993  1829 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:44.023582  1829 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.027562  1818 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.036357  1818 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:44.037300  1818 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.039247  1787 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:44.029579  1829 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.058773  1787 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.050740  1654 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:44.059355  1787 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.061386  1780 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:44.062024  1780 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.062510  1780 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:44.062800  1579 consensus_peers.cc:597] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:44.062031  1787 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.063753  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.064528  1539 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:44.065961  1580 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:44.066752  1787 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:44.067175  1787 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.067541  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:44.067574  1787 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:44.073031  1579 leader_election.cc:343] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.080608  1780 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.082902  1780 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:00:44.080454  1654 leader_election.cc:343] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.085862  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:44.086493  1539 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.088356  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:44.089814  1730 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:44.090373  1730 ts_tablet_manager.cc:1403] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.014s
I20260709 13:00:44.092839  1732 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:44.093292  1732 ts_tablet_manager.cc:1403] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.102s	user 0.023s	sys 0.010s
I20260709 13:00:44.098022  1730 raft_consensus.cc:359] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.098795  1730 raft_consensus.cc:385] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.099045  1730 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.099704  1730 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.101774  1787 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.106277  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:44.106927  1690 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.101922  1730 ts_tablet_manager.cc:1434] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:00:44.108834  1730 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:44.113585  1731 tablet_bootstrap.cc:492] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:44.209501  1731 ts_tablet_manager.cc:1403] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.227s	user 0.026s	sys 0.021s
I20260709 13:00:44.137074  1732 raft_consensus.cc:359] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.211107  1732 raft_consensus.cc:385] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:44.107259  1654 leader_election.cc:343] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.211664  1732 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.177428  1858 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:00:44.212729  1732 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.214709  1732 ts_tablet_manager.cc:1434] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.121s	user 0.015s	sys 0.013s
I20260709 13:00:44.112870  1787 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.215782  1732 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:44.167495  1819 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.221086  1819 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.116129  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:00:44.219118  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 111893us
I20260709 13:00:44.225481  1690 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:44.225559  1436 catalog_manager.cc:5697] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:44.191217  1539 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:44.230110  1731 raft_consensus.cc:359] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.233280  1731 raft_consensus.cc:385] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.233824  1731 raft_consensus.cc:740] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.115654  1829 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.234624  1731 consensus_queue.cc:260] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.236930  1829 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.238350  1654 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:44.241176  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:44.226641  1540 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.243146  1613 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.243623  1829 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.246236  1731 ts_tablet_manager.cc:1434] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 13:00:44.247251  1731 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:44.245872  1829 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:00:44.244908  1654 leader_election.cc:343] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.249291  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:44.250097  1787 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.253435  1787 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:44.249406  1829 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.259575  1792 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:44.259699  1787 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.250417  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:44.261890  1539 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.275269  1732 tablet_bootstrap.cc:654] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.280176  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.276993  1819 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.280822  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:44.282019  1616 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:44.280982  1538 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:44.284272  1654 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:44.286748  1819 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:44.287168  1819 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.287556  1819 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.288781  1539 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:44.293814  1731 tablet_bootstrap.cc:654] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.298844  1730 tablet_bootstrap.cc:654] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.297142  1858 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:00:44.302745  1818 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:44.294394  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:44.305974  1732 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:44.306531  1732 ts_tablet_manager.cc:1403] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.004s
I20260709 13:00:44.309675  1829 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.310236  1829 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:44.311259  1829 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.313642  1540 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:44.319804  1438 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:44.334492  1819 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:44.356438  1875 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:44.358923  1436 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:44.364852  1819 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.366963  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:44.368373  1794 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:44.373396  1539 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.382782  1730 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:44.382591  1766 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:44.384570  1731 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:44.386094  1731 ts_tablet_manager.cc:1403] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.139s	user 0.001s	sys 0.018s
I20260709 13:00:44.390787  1731 raft_consensus.cc:359] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.392939  1731 raft_consensus.cc:385] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.393400  1731 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.394956  1731 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.399159  1731 ts_tablet_manager.cc:1434] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:00:44.400642  1731 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:44.394974  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:44.400837  1732 raft_consensus.cc:359] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.401568  1615 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.396842  1730 ts_tablet_manager.cc:1403] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.288s	user 0.017s	sys 0.035s
I20260709 13:00:44.399649  1437 catalog_manager.cc:5697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:44.410074  1730 raft_consensus.cc:359] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.415413  1730 raft_consensus.cc:385] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.419013  1730 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.419852  1730 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.424839  1539 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:44.401566  1732 raft_consensus.cc:385] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.425923  1732 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.426604  1654 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:44.427857  1819 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.414924  1615 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:44.428705  1819 raft_consensus.cc:697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:44.426725  1730 ts_tablet_manager.cc:1434] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:00:44.430239  1730 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:44.442510  1730 tablet_bootstrap.cc:654] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.427759  1732 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.430020  1819 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.445164  1860 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:44.446218  1732 ts_tablet_manager.cc:1434] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.139s	user 0.008s	sys 0.000s
I20260709 13:00:44.448158  1732 tablet_bootstrap.cc:492] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:44.454613  1787 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.455435  1787 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.459381  1787 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.460536  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:44.460928  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.443567  1731 tablet_bootstrap.cc:654] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.461796  1539 raft_consensus.cc:2393] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:00:44.468318  1732 tablet_bootstrap.cc:654] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.472204  1580 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:44.478958  1787 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.492735  1730 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:44.493259  1730 ts_tablet_manager.cc:1403] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 13:00:44.495949  1731 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:44.496572  1731 ts_tablet_manager.cc:1403] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.096s	user 0.007s	sys 0.012s
I20260709 13:00:44.499119  1731 raft_consensus.cc:359] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.499662  1731 raft_consensus.cc:385] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.499904  1731 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.500394  1787 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:44.501761  1732 tablet_bootstrap.cc:492] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:44.502393  1732 ts_tablet_manager.cc:1403] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.007s
I20260709 13:00:44.501111  1730 raft_consensus.cc:359] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.500545  1438 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:44.500669  1731 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.503464  1730 raft_consensus.cc:385] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.503916  1730 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.504706  1730 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.505450  1732 raft_consensus.cc:359] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.507614  1730 ts_tablet_manager.cc:1434] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:00:44.507826  1732 raft_consensus.cc:385] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.508669  1730 tablet_bootstrap.cc:492] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:44.508881  1762 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:44.508108  1732 raft_consensus.cc:740] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.510601  1732 consensus_queue.cc:260] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.512609  1732 ts_tablet_manager.cc:1434] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:00:44.512840  1829 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.513636  1732 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:44.513293  1829 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.515407  1829 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.517840  1762 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.518353  1762 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.519363  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:44.520532  1762 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.523077  1762 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.526033  1731 ts_tablet_manager.cc:1434] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:00:44.523542  1762 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.527443  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:44.527457  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.528318  1731 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:44.534022  1819 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.534574  1819 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:44.535220  1504 leader_election.cc:343] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.536072  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:44.536657  1819 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.523327  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:44.537525  1829 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:44.539444  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.543334  1539 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:44.540279  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:44.541065  1762 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.541934  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:44.547857  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:00:44.548362  1505 leader_election.cc:343] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.548974  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:00:44.549221  1654 leader_election.cc:343] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.546339  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:44.549933  1829 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:44.550436  1829 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.550800  1829 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:44.550866  1504 leader_election.cc:343] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.563956  1730 tablet_bootstrap.cc:654] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:44.565496  1505 leader_election.cc:343] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.566011  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:44.566891  1766 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:44.568497  1766 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:44.571292  1731 tablet_bootstrap.cc:654] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:44.577221  1505 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:44.588779  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:44.619022  1731 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:44.619513  1731 ts_tablet_manager.cc:1403] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.032s
I20260709 13:00:44.623525  1731 raft_consensus.cc:359] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.624043  1731 raft_consensus.cc:385] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.624351  1731 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.624433  1732 tablet_bootstrap.cc:654] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.625169  1731 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.627753  1731 ts_tablet_manager.cc:1434] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:00:44.630343  1730 tablet_bootstrap.cc:492] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:44.626293  1829 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.631359  1730 ts_tablet_manager.cc:1403] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.123s	user 0.032s	sys 0.041s
I20260709 13:00:44.631780  1731 tablet_bootstrap.cc:492] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:44.635006  1730 raft_consensus.cc:359] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.637269  1730 raft_consensus.cc:385] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.638392  1730 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.639330  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:44.639180  1730 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.639926  1539 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.641521  1731 tablet_bootstrap.cc:654] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.645924  1730 ts_tablet_manager.cc:1434] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.006s
I20260709 13:00:44.647109  1730 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:44.649336  1539 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:44.650908  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:44.651895  1819 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.652611  1819 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:44.653805  1819 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.659971  1780 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.660693  1780 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.662024  1730 tablet_bootstrap.cc:654] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.662817  1780 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.666596  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.667547  1541 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:44.668570  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:44.671450  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:44.672698  1780 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:44.673151  1780 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.673527  1780 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:44.672925  1654 leader_election.cc:343] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.673921  1731 tablet_bootstrap.cc:492] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:44.674893  1731 ts_tablet_manager.cc:1403] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.007s
I20260709 13:00:44.674297  1730 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:44.675849  1730 ts_tablet_manager.cc:1403] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.005s
I20260709 13:00:44.678926  1829 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.681668  1731 raft_consensus.cc:359] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.681034  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:44.689668  1731 raft_consensus.cc:385] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.690158  1731 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
W20260709 13:00:44.690786  1654 leader_election.cc:343] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.692046  1730 raft_consensus.cc:359] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.693063  1730 raft_consensus.cc:385] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.693921  1730 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.694794  1730 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.696985  1730 ts_tablet_manager.cc:1434] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:00:44.698050  1730 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:44.696889  1731 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.701025  1731 ts_tablet_manager.cc:1434] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.006s
I20260709 13:00:44.698100  1780 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.702628  1436 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:44.705250  1780 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.705961  1787 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.706050  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:44.706825  1731 tablet_bootstrap.cc:492] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:44.706606  1787 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.706849  1616 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.709007  1787 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.705170  1732 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:44.711895  1732 ts_tablet_manager.cc:1403] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.198s	user 0.031s	sys 0.027s
I20260709 13:00:44.715628  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:44.717501  1539 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.717490  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.718627  1541 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:44.720520  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:44.720897  1580 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:00:44.722821  1579 leader_election.cc:343] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.723764  1731 tablet_bootstrap.cc:654] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.724316  1787 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:44.724989  1787 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.725385  1787 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.726608  1732 raft_consensus.cc:359] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.727290  1732 raft_consensus.cc:385] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.727558  1732 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.731621  1730 tablet_bootstrap.cc:654] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.735967  1732 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.744021  1539 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:44.740387  1616 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:44.748989  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:44.750352  1819 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.753809  1780 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:44.755455  1819 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:44.756438  1732 ts_tablet_manager.cc:1434] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.002s
I20260709 13:00:44.757623  1732 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:44.772982  1794 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.778286  1794 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.782750  1794 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.757354  1819 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.741688  1787 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.783561  1732 tablet_bootstrap.cc:654] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.784533  1731 tablet_bootstrap.cc:492] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:44.790764  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:44.791203  1731 ts_tablet_manager.cc:1403] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.001s
I20260709 13:00:44.791548  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:44.785491  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.792213  1541 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.792450  1540 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:44.787246  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:44.793584  1730 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:44.794092  1730 ts_tablet_manager.cc:1403] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.018s
W20260709 13:00:44.796794  1579 leader_election.cc:343] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:44.797845  1579 leader_election.cc:343] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.797739  1730 raft_consensus.cc:359] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.798564  1730 raft_consensus.cc:385] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.798873  1730 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.801308  1541 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:44.802814  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:44.803752  1736 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:44.804148  1736 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.804514  1736 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.794486  1731 raft_consensus.cc:359] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.805159  1731 raft_consensus.cc:385] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.805353  1787 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.805474  1731 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.806306  1731 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.808763  1731 ts_tablet_manager.cc:1434] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:00:44.809669  1731 tablet_bootstrap.cc:492] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:44.811550  1794 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:44.819423  1828 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:44.823319  1731 tablet_bootstrap.cc:654] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.826386  1736 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.804164  1580 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:44.830845  1794 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.831533  1794 raft_consensus.cc:697] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:44.832582  1794 consensus_queue.cc:237] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.835408  1828 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:44.838660  1736 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.836340  1731 tablet_bootstrap.cc:492] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:44.839655  1731 ts_tablet_manager.cc:1403] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 13:00:44.842499  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:44.842556  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:44.844476  1539 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.844707  1731 raft_consensus.cc:359] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.845350  1731 raft_consensus.cc:385] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:44.845592  1731 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:44.846223  1731 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.848133  1731 ts_tablet_manager.cc:1434] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:00:44.848971  1731 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:44.849123  1730 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:44.850404  1579 leader_election.cc:343] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.855168  1792 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:44.863740  1731 tablet_bootstrap.cc:654] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.866056  1730 ts_tablet_manager.cc:1434] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.002s
I20260709 13:00:44.874643  1730 tablet_bootstrap.cc:492] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:44.877174  1731 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:44.877674  1731 ts_tablet_manager.cc:1403] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.029s	user 0.002s	sys 0.008s
I20260709 13:00:44.907159  1438 catalog_manager.cc:5697] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:44.915176  1730 tablet_bootstrap.cc:654] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:44.927719  1787 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.965189  1787 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.918630  1539 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:44.966537  1615 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.970644  1787 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:44.979240  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:44.979596  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:44.980723  1794 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:44.983789  1794 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:00:44.988300  1580 leader_election.cc:343] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:44.990800  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:44.994071  1794 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.998315  1616 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:44.966428  1731 raft_consensus.cc:359] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:44.970188  1732 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:45.004526  1731 raft_consensus.cc:385] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.004707  1732 ts_tablet_manager.cc:1403] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.247s	user 0.030s	sys 0.030s
I20260709 13:00:45.005252  1731 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.007571  1731 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.010897  1731 ts_tablet_manager.cc:1434] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.133s	user 0.010s	sys 0.010s
I20260709 13:00:45.012089  1780 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.013887  1828 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.014572  1828 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.015213  1732 raft_consensus.cc:359] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.016521  1732 raft_consensus.cc:385] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.016947  1732 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.017853  1828 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:44.991734  1688 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:45.018004  1732 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.020417  1731 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:45.026001  1732 ts_tablet_manager.cc:1434] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:00:45.026993  1819 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.027559  1732 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:45.028116  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:45.029202  1579 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:00:45.030246  1819 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:45.030849  1792 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:45.031401  1792 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.031859  1792 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.034104  1616 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:45.034384  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:45.042606  1732 tablet_bootstrap.cc:654] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.048408  1730 tablet_bootstrap.cc:492] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:45.049044  1730 ts_tablet_manager.cc:1403] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.175s	user 0.028s	sys 0.046s
I20260709 13:00:45.102257  1731 tablet_bootstrap.cc:654] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.104225  1787 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.114316  1787 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.118393  1787 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:00:45.110950  1654 leader_election.cc:343] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.135859  1687 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.144550  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:45.145429  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:00:45.147476  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:45.147837  1780 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:45.148290  1780 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.148697  1780 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.158531  1792 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.165714  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:45.166523  1539 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.174489  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:45.184165  1730 raft_consensus.cc:359] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.185074  1730 raft_consensus.cc:385] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.186777  1730 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.215319  1829 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.198364  1730 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.238719  1730 ts_tablet_manager.cc:1434] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.189s	user 0.012s	sys 0.000s
I20260709 13:00:45.251971  1730 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:45.256263  1792 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:45.257258  1787 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:45.262410  1539 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:45.263761  1731 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
W20260709 13:00:45.240396  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 66239.5us
I20260709 13:00:45.264595  1731 ts_tablet_manager.cc:1403] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.244s	user 0.032s	sys 0.003s
I20260709 13:00:45.264863  1580 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:45.265908  1792 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:45.266687  1792 raft_consensus.cc:697] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:45.268155  1792 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.269223  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:45.270262  1688 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.274837  1732 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:45.279870  1732 ts_tablet_manager.cc:1403] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.253s	user 0.020s	sys 0.022s
I20260709 13:00:45.276706  1731 raft_consensus.cc:359] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.281391  1731 raft_consensus.cc:385] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.281916  1731 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.287940  1731 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.298990  1688 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:45.302443  1730 tablet_bootstrap.cc:654] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:45.291060  1654 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:45.329064  1731 ts_tablet_manager.cc:1434] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 13:00:45.335537  1731 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:45.338915  1732 raft_consensus.cc:359] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.339991  1732 raft_consensus.cc:385] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.340427  1732 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.341274  1732 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.321401  1780 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.352278  1732 ts_tablet_manager.cc:1434] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.006s
I20260709 13:00:45.357000  1732 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:45.361159  1780 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:45.367399  1730 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:45.367866  1730 ts_tablet_manager.cc:1403] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.020s
I20260709 13:00:45.369830  1438 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.370770  1730 raft_consensus.cc:359] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.371522  1730 raft_consensus.cc:385] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.371791  1730 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.372602  1780 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:45.372262  1438 catalog_manager.cc:5697] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:45.374080  1730 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.376725  1730 ts_tablet_manager.cc:1434] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:00:45.378028  1730 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:45.378216  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:45.383651  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:45.384362  1614 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.385267  1730 tablet_bootstrap.cc:654] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.415530  1731 tablet_bootstrap.cc:654] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.417963  1436 catalog_manager.cc:5697] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:45.419504  1654 leader_election.cc:343] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.418744  1614 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:45.421351  1819 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.372116  1732 tablet_bootstrap.cc:654] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.427956  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:00:45.433547  1792 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.436340  1780 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:45.437037  1780 raft_consensus.cc:697] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:45.437451  1787 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.437976  1780 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.438207  1787 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.441309  1787 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:45.444751  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:45.445529  1731 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:45.445986  1731 ts_tablet_manager.cc:1403] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.116s	user 0.011s	sys 0.011s
I20260709 13:00:45.448850  1731 raft_consensus.cc:359] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.449536  1731 raft_consensus.cc:385] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.449806  1731 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.450507  1731 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.452554  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:45.454093  1730 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:45.454310  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:45.454762  1730 ts_tablet_manager.cc:1403] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.031s
I20260709 13:00:45.455430  1787 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:45.457607  1730 raft_consensus.cc:359] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.458283  1730 raft_consensus.cc:385] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.458566  1730 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.459411  1730 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.461951  1730 ts_tablet_manager.cc:1434] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:00:45.463075  1730 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:45.464843  1731 ts_tablet_manager.cc:1434] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 13:00:45.465876  1732 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:45.466712  1732 ts_tablet_manager.cc:1403] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.110s	user 0.022s	sys 0.004s
I20260709 13:00:45.470716  1732 raft_consensus.cc:359] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.471967  1730 tablet_bootstrap.cc:654] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.472097  1732 raft_consensus.cc:385] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.472798  1732 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.473827  1732 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.466012  1731 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:45.478176  1732 ts_tablet_manager.cc:1434] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:00:45.479995  1732 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
W20260709 13:00:45.500718  1579 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:45.501379  1731 tablet_bootstrap.cc:654] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.509433  1730 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:45.514246  1730 ts_tablet_manager.cc:1403] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.003s
I20260709 13:00:45.523691  1438 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.529729  1829 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.530251  1829 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.530603  1730 raft_consensus.cc:359] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.531241  1730 raft_consensus.cc:385] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.531522  1730 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.532384  1829 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:45.532274  1730 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.534435  1730 ts_tablet_manager.cc:1434] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:00:45.534934  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:45.535442  1730 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
W20260709 13:00:45.536594  1654 leader_election.cc:343] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.540580  1732 tablet_bootstrap.cc:654] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.547533  1829 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.551591  1829 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.552420  1828 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.553164  1828 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.554241  1829 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:45.556757  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:45.557260  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:45.564465  1654 leader_election.cc:343] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.565254  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:45.565631  1654 leader_election.cc:343] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.566026  1538 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:45.566279  1736 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.570024  1828 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:45.582016  1730 tablet_bootstrap.cc:654] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.571894  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:45.590989  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:45.593847  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:45.594713  1541 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:45.596994  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:45.597703  1933 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:45.597817  1614 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:45.599053  1819 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:45.616659  1819 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.617194  1819 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.620539  1732 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:45.602944  1688 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.604919  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:45.633747  1933 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:45.634356  1933 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.635653  1933 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.622280  1732 ts_tablet_manager.cc:1403] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.019s
I20260709 13:00:45.623495  1731 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:45.636608  1731 ts_tablet_manager.cc:1403] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.171s	user 0.018s	sys 0.031s
I20260709 13:00:45.639681  1731 raft_consensus.cc:359] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.640592  1731 raft_consensus.cc:385] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.640965  1731 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.641779  1731 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.642026  1736 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:45.644528  1731 ts_tablet_manager.cc:1434] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:00:45.645733  1731 tablet_bootstrap.cc:492] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:45.648661  1732 raft_consensus.cc:359] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.649470  1732 raft_consensus.cc:385] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.649756  1732 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.627267  1819 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.650496  1732 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.662107  1732 ts_tablet_manager.cc:1434] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:00:45.664687  1732 tablet_bootstrap.cc:492] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:45.664541  1933 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.663059  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:45.665730  1538 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.666219  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:45.666853  1614 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.668587  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:45.667121  1731 tablet_bootstrap.cc:654] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.671231  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:45.671797  1539 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.673857  1614 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:45.674925  1819 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:45.675640  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:45.669225  1616 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.666853  1933 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:45.680011  1933 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:45.680516  1933 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:45.681308  1933 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:45.683910  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:45.684634  1736 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.687490  1732 tablet_bootstrap.cc:654] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.701099  1616 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:45.683396  1539 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:45.704897  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:45.705338  1730 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:45.706529  1730 ts_tablet_manager.cc:1403] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.171s	user 0.020s	sys 0.014s
I20260709 13:00:45.709292  1730 raft_consensus.cc:359] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.709941  1730 raft_consensus.cc:385] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.710186  1730 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.710708  1829 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:45.710767  1730 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.691045  1538 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:45.711287  1829 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:45.712481  1829 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.718745  1731 tablet_bootstrap.cc:492] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:45.719369  1731 ts_tablet_manager.cc:1403] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.007s
I20260709 13:00:45.720811  1730 ts_tablet_manager.cc:1434] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:00:45.722210  1730 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:45.726601  1730 tablet_bootstrap.cc:654] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.730762  1731 raft_consensus.cc:359] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.731571  1731 raft_consensus.cc:385] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.731841  1731 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.732522  1731 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.735850  1731 ts_tablet_manager.cc:1434] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:00:45.736971  1731 tablet_bootstrap.cc:492] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:45.736943  1439 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.746450  1787 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.754148  1731 tablet_bootstrap.cc:654] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.767037  1732 tablet_bootstrap.cc:492] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:45.767903  1732 ts_tablet_manager.cc:1403] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.103s	user 0.022s	sys 0.004s
I20260709 13:00:45.771865  1732 raft_consensus.cc:359] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.772711  1732 raft_consensus.cc:385] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.773295  1732 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.774011  1732 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.776114  1732 ts_tablet_manager.cc:1434] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:45.777271  1732 tablet_bootstrap.cc:492] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:45.786903  1732 tablet_bootstrap.cc:654] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.789889  1731 tablet_bootstrap.cc:492] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:45.790500  1731 ts_tablet_manager.cc:1403] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.005s
I20260709 13:00:45.795796  1438 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:45.794929  1730 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:45.797909  1730 ts_tablet_manager.cc:1403] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.076s	user 0.037s	sys 0.021s
I20260709 13:00:45.794925  1731 raft_consensus.cc:359] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.800446  1731 raft_consensus.cc:385] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.800835  1731 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.801501  1731 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.803596  1731 ts_tablet_manager.cc:1434] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:00:45.804687  1731 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:45.809139  1730 raft_consensus.cc:359] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.809813  1730 raft_consensus.cc:385] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.810084  1730 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.810737  1730 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.812172  1818 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.812636  1818 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.816071  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:45.816900  1614 raft_consensus.cc:2393] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:00:45.818670  1818 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:45.820312  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:45.820960  1730 ts_tablet_manager.cc:1434] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:00:45.823187  1732 tablet_bootstrap.cc:492] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:45.823570  1731 tablet_bootstrap.cc:654] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.823668  1732 ts_tablet_manager.cc:1403] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.010s
I20260709 13:00:45.826890  1732 raft_consensus.cc:359] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.827564  1732 raft_consensus.cc:385] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.827670  1730 tablet_bootstrap.cc:492] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:45.827852  1732 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.828536  1732 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.831653  1732 ts_tablet_manager.cc:1434] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:00:45.831949  1819 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.833146  1504 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:45.835628  1732 tablet_bootstrap.cc:492] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:45.833815  1819 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.839102  1818 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.839418  1858 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.840432  1858 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.845404  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:45.845314  1858 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:45.846702  1616 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:45.852159  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:45.852267  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:45.857308  1504 leader_election.cc:343] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.858290  1858 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:45.858714  1858 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.858971  1819 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:45.863446  1731 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:45.864094  1731 ts_tablet_manager.cc:1403] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.000s
I20260709 13:00:45.864436  1730 tablet_bootstrap.cc:654] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.868966  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:45.871006  1654 leader_election.cc:343] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.872957  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:45.859055  1858 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:45.878654  1654 leader_election.cc:343] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.882380  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:45.885370  1762 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.886196  1762 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.885432  1819 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:45.889384  1762 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:45.892688  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:45.889129  1731 raft_consensus.cc:359] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.896678  1731 raft_consensus.cc:385] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.896965  1731 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.897284  1614 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:45.895411  1504 leader_election.cc:343] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.900309  1858 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.898260  1731 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.903167  1731 ts_tablet_manager.cc:1434] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:00:45.907970  1732 tablet_bootstrap.cc:654] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.908704  1730 tablet_bootstrap.cc:492] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:45.909210  1730 ts_tablet_manager.cc:1403] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.003s
I20260709 13:00:45.914908  1858 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:45.912004  1730 raft_consensus.cc:359] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.916520  1730 raft_consensus.cc:385] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:45.916985  1730 raft_consensus.cc:740] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:45.921367  1731 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:45.924783  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:45.919967  1730 consensus_queue.cc:260] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:45.926640  1504 leader_election.cc:343] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.933086  1933 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:45.935154  1818 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:45.942603  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:45.953685  1730 ts_tablet_manager.cc:1434] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
W20260709 13:00:45.959829  1505 leader_election.cc:343] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:45.960141  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:45.960882  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:45.961390  1615 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:45.966621  1730 tablet_bootstrap.cc:492] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:45.967731  1949 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:45.978778  1829 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.979512  1829 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.986076  1732 tablet_bootstrap.cc:492] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:45.986867  1732 ts_tablet_manager.cc:1403] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.152s	user 0.026s	sys 0.006s
I20260709 13:00:45.995316  1794 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.998167  1731 tablet_bootstrap.cc:654] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:45.998811  1828 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:46.000605  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:46.007740  1829 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:46.011587  1732 raft_consensus.cc:359] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.012931  1732 raft_consensus.cc:385] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.013350  1732 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.014403  1732 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:45.998041  1794 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.020773  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:46.025080  1579 leader_election.cc:343] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.028709  1732 ts_tablet_manager.cc:1434] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.000s
I20260709 13:00:46.037388  1730 tablet_bootstrap.cc:654] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.038920  1794 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.041491  1732 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:46.045930  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:46.046989  1538 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:46.048213  1615 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:46.064126  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:46.067755  1732 tablet_bootstrap.cc:654] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.069427  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:46.070463  1949 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.070853  1792 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.071508  1792 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.072078  1792 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.071023  1787 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.073253  1787 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.071400  1949 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.075727  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:46.077221  1818 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.077047  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:46.078068  1687 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:46.079373  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:46.079526  1579 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:46.080072  1688 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:46.080614  1794 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.080864  1818 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:46.081506  1792 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.081759  1504 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:46.081014  1794 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.082957  1794 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.083130  1766 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.083129  1949 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.083701  1766 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.084261  1766 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.085901  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:00:46.063774  1654 leader_election.cc:343] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:46.087663  1579 leader_election.cc:343] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.092629  1731 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:46.075727  1787 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.093173  1731 ts_tablet_manager.cc:1403] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.172s	user 0.010s	sys 0.021s
I20260709 13:00:46.082319  1818 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.093397  1792 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.094237  1794 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.095767  1731 raft_consensus.cc:359] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.097343  1731 raft_consensus.cc:385] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.097728  1731 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.098372  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:46.098721  1731 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.105086  1731 ts_tablet_manager.cc:1434] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:00:46.104485  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:46.105752  1538 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:46.111315  1654 leader_election.cc:343] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.112730  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:46.114347  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:46.115639  1616 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:46.115787  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:46.116503  1688 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.117794  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:46.120846  1731 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:46.122260  1732 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:46.127116  1732 ts_tablet_manager.cc:1403] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.003s
I20260709 13:00:46.127199  1933 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:46.121130  1766 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.125959  1688 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:46.120716  1794 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.134935  1732 raft_consensus.cc:359] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.135650  1732 raft_consensus.cc:385] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.135499  1730 tablet_bootstrap.cc:492] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:46.135977  1732 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.136238  1730 ts_tablet_manager.cc:1403] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.170s	user 0.014s	sys 0.006s
I20260709 13:00:46.136739  1732 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.138604  1794 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.143129  1539 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:46.144338  1766 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.143826  1439 catalog_manager.cc:5697] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.139938  1949 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.141217  1579 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:46.152351  1792 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.152915  1792 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:46.153885  1792 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.141671  1732 ts_tablet_manager.cc:1434] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:00:46.157562  1732 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:46.153715  1949 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.142313  1794 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.168681  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:46.169703  1688 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:46.170776  1731 tablet_bootstrap.cc:654] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.170415  1794 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.150494  1538 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:46.177285  1730 raft_consensus.cc:359] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.178186  1730 raft_consensus.cc:385] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.178535  1730 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.181681  1933 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.182428  1732 tablet_bootstrap.cc:654] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.186033  1730 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.188897  1828 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:46.183696  1933 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.189812  1730 ts_tablet_manager.cc:1434] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.002s
I20260709 13:00:46.194410  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:46.195480  1688 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:46.195703  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:46.198832  1579 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:46.201094  1787 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.202075  1787 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.202497  1787 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.191744  1730 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:46.216383  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:46.217538  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:46.230132  1436 catalog_manager.cc:5697] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.249030  1766 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.258525  1766 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.260179  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:46.225279  1933 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:46.232131  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:46.231096  1829 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.260959  1766 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.267048  1828 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:46.270998  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:46.267467  1949 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.269488  1780 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:00:46.271907  1829 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.279528  1794 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.287002  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:46.287012  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:46.277597  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:46.298610  1794 raft_consensus.cc:697] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:46.300765  1794 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.301656  1829 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:00:46.313743  1504 leader_election.cc:343] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.344272  1819 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:46.348568  1730 tablet_bootstrap.cc:654] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.351657  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:46.353968  1731 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:46.354463  1731 ts_tablet_manager.cc:1403] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.245s	user 0.016s	sys 0.033s
I20260709 13:00:46.368719  1731 raft_consensus.cc:359] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.369792  1731 raft_consensus.cc:385] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.370158  1731 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.371268  1731 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:46.376636  1504 leader_election.cc:343] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.399887  1732 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:46.400461  1732 ts_tablet_manager.cc:1403] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.243s	user 0.020s	sys 0.018s
I20260709 13:00:46.364670  1829 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:00:46.398999  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:46.426960  1731 ts_tablet_manager.cc:1434] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.072s	user 0.013s	sys 0.013s
I20260709 13:00:46.399448  1787 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.438252  1731 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:46.449561  1787 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.440642  1616 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:46.450791  1730 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:46.451251  1730 ts_tablet_manager.cc:1403] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.260s	user 0.025s	sys 0.022s
W20260709 13:00:46.433449  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 145642us
W20260709 13:00:46.463145  1580 leader_election.cc:343] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.469929  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:46.470830  1688 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.505681  1730 raft_consensus.cc:359] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.506886  1730 raft_consensus.cc:385] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.507297  1730 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.507973  1730 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.513827  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:46.502557  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:46.477909  1689 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.523278  1730 ts_tablet_manager.cc:1434] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.001s
I20260709 13:00:46.524672  1829 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.520349  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:46.528227  1505 leader_election.cc:343] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.537398  1732 raft_consensus.cc:359] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.540401  1732 raft_consensus.cc:385] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.540782  1732 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.544930  1505 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:46.545492  1732 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.551304  1730 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:46.551559  1732 ts_tablet_manager.cc:1434] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.151s	user 0.008s	sys 0.001s
I20260709 13:00:46.552507  1731 tablet_bootstrap.cc:654] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.540424  1970 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:46.553200  1766 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:46.570953  1969 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.581276  1969 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.590407  1969 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:46.608219  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:46.608961  1540 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:46.615471  1688 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:46.616537  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:46.619208  1829 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:46.619840  1654 leader_election.cc:343] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.620675  1654 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:46.622076  1828 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.622810  1828 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.623303  1828 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.622087  1732 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:46.640659  1579 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:46.654222  1436 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:46.656169  1505 leader_election.cc:343] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.658586  1964 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.675544  1732 tablet_bootstrap.cc:654] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.671977  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:46.676496  1731 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:46.677030  1731 ts_tablet_manager.cc:1403] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.239s	user 0.019s	sys 0.011s
I20260709 13:00:46.682235  1970 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:46.683880  1970 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:46.688591  1731 raft_consensus.cc:359] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.689365  1731 raft_consensus.cc:385] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.686336  1964 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:46.689719  1731 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.690637  1731 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.690724  1964 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.699401  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:46.691614  1828 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.719650  1731 ts_tablet_manager.cc:1434] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.003s
I20260709 13:00:46.721088  1731 tablet_bootstrap.cc:492] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:46.747875  1730 tablet_bootstrap.cc:654] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.749437  1828 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:46.751035  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:46.751698  1616 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:46.752655  1580 leader_election.cc:343] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.757841  1964 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:46.765867  1964 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:46.777951  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:46.778215  1732 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:46.778517  1730 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:46.782639  1731 tablet_bootstrap.cc:654] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.778968  1732 ts_tablet_manager.cc:1403] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.157s	user 0.015s	sys 0.009s
I20260709 13:00:46.786034  1730 ts_tablet_manager.cc:1403] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.236s	user 0.012s	sys 0.010s
I20260709 13:00:46.778712  1541 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.789402  1438 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:46.803117  1616 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:46.807179  1964 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.810331  1964 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.811772  1732 raft_consensus.cc:359] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.812378  1654 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:46.812942  1732 raft_consensus.cc:385] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.813490  1732 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.817525  1732 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.816860  1828 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:46.805652  1541 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:46.822254  1732 ts_tablet_manager.cc:1434] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:00:46.822333  1828 raft_consensus.cc:697] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:46.806803  1970 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:00:46.824606  1730 raft_consensus.cc:359] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.833151  1730 raft_consensus.cc:385] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.833891  1730 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.826977  1732 tablet_bootstrap.cc:492] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:46.839413  1730 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.842212  1976 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.828588  1579 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:46.861275  1828 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.863466  1766 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.864076  1766 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.866657  1766 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:00:46.868642  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:46.872442  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:46.831580  1964 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.842748  1976 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.880880  1730 ts_tablet_manager.cc:1434] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.002s
I20260709 13:00:46.854084  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:46.891026  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:46.900985  1976 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:46.906031  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:46.907029  1685 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:46.897111  1541 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:46.910768  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:46.915591  1732 tablet_bootstrap.cc:654] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:46.926398  1730 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:46.932114  1731 tablet_bootstrap.cc:492] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:46.932925  1731 ts_tablet_manager.cc:1403] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.212s	user 0.019s	sys 0.018s
I20260709 13:00:46.926168  1976 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:46.938885  1976 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:46.939463  1976 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.941459  1731 raft_consensus.cc:359] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:46.942526  1731 raft_consensus.cc:385] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:46.942795  1731 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:46.943477  1731 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:46.947803  1579 leader_election.cc:343] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:46.910799  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:46.951709  1688 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:46.960594  1504 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:46.967257  1731 ts_tablet_manager.cc:1434] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:00:46.966881  1977 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:46.981356  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:46.986114  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:46.993582  1731 tablet_bootstrap.cc:492] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.003932  1972 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.004693  1972 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.005084  1972 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.021380  1977 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.022338  1436 catalog_manager.cc:5697] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:47.029500  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 43502.7us
W20260709 13:00:47.035326  1505 leader_election.cc:343] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.037454  1731 tablet_bootstrap.cc:654] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.051074  1972 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.054438  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:00:47.057233  1579 leader_election.cc:343] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.057143  1965 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.062263  1972 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.070134  1730 tablet_bootstrap.cc:654] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.080797  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:47.081853  1538 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.097671  1732 tablet_bootstrap.cc:492] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:47.098769  1732 ts_tablet_manager.cc:1403] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.272s	user 0.028s	sys 0.015s
I20260709 13:00:47.111383  1731 tablet_bootstrap.cc:492] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:47.112094  1731 ts_tablet_manager.cc:1403] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.119s	user 0.033s	sys 0.017s
I20260709 13:00:47.115092  1976 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.118645  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:47.119071  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:47.118515  1731 raft_consensus.cc:359] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.119697  1689 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.115306  1732 raft_consensus.cc:359] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.120188  1732 raft_consensus.cc:385] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.120471  1732 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.121301  1732 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.119870  1731 raft_consensus.cc:385] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:00:47.122558  1505 leader_election.cc:343] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.122833  1731 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.123550  1731 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.125893  1731 ts_tablet_manager.cc:1434] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:00:47.127866  1731 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.129137  1732 ts_tablet_manager.cc:1434] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 13:00:47.130324  1732 tablet_bootstrap.cc:492] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:47.133329  1689 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:47.138082  1732 tablet_bootstrap.cc:654] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.138713  1538 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:47.138903  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:47.137233  1730 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:47.140765  1730 ts_tablet_manager.cc:1403] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.252s	user 0.012s	sys 0.013s
I20260709 13:00:47.141721  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.140861  1970 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.141119  1976 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.142616  1970 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:47.143401  1970 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.145258  1962 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.145748  1962 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:47.146411  1730 raft_consensus.cc:359] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.146595  1962 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.147516  1730 raft_consensus.cc:385] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.147907  1730 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.148793  1730 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.149600  1731 tablet_bootstrap.cc:654] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.152693  1730 ts_tablet_manager.cc:1434] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:47.156212  1730 tablet_bootstrap.cc:492] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:47.161127  1828 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.161357  1731 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:47.161727  1828 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.163844  1732 tablet_bootstrap.cc:492] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:47.164366  1732 ts_tablet_manager.cc:1403] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
I20260709 13:00:47.166232  1730 tablet_bootstrap.cc:654] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.166025  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:47.167241  1732 raft_consensus.cc:359] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.167732  1977 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.161963  1731 ts_tablet_manager.cc:1403] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.011s
I20260709 13:00:47.168330  1977 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.169037  1439 catalog_manager.cc:5697] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.170555  1977 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.171221  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:47.179046  1794 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.177776  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:47.171003  1731 raft_consensus.cc:359] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.176839  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:47.171087  1828 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:47.182274  1731 raft_consensus.cc:385] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.182598  1731 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.183247  1731 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:47.179633  1505 leader_election.cc:343] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.181635  1654 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:47.185170  1828 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.185741  1731 ts_tablet_manager.cc:1434] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:00:47.186957  1829 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.187465  1829 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:47.189090  1504 leader_election.cc:343] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.189677  1829 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:47.191247  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.191967  1731 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.195945  1730 tablet_bootstrap.cc:492] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:47.196501  1730 ts_tablet_manager.cc:1403] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.004s
I20260709 13:00:47.197012  1977 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.167974  1732 raft_consensus.cc:385] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.198550  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:47.199060  1731 tablet_bootstrap.cc:654] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.198876  1732 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.199635  1730 raft_consensus.cc:359] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.195518  1438 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.204427  1730 raft_consensus.cc:385] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.204810  1730 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.205610  1730 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.204768  1732 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.205638  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:47.208945  1540 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:47.210161  1730 ts_tablet_manager.cc:1434] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:00:47.211242  1730 tablet_bootstrap.cc:492] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:47.216598  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:47.219508  1828 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.210212  1732 ts_tablet_manager.cc:1434] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:00:47.222131  1732 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:47.227486  1731 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:47.227596  1730 tablet_bootstrap.cc:654] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.228228  1731 ts_tablet_manager.cc:1403] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.024s
I20260709 13:00:47.231796  1828 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.231648  1731 raft_consensus.cc:359] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.232465  1731 raft_consensus.cc:385] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.232743  1731 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.233660  1731 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.236588  1732 tablet_bootstrap.cc:654] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.250164  1689 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.236024  1731 ts_tablet_manager.cc:1434] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:47.252135  1731 tablet_bootstrap.cc:492] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.259881  1731 tablet_bootstrap.cc:654] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.265296  1732 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:47.265784  1732 ts_tablet_manager.cc:1403] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 13:00:47.267196  1962 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.270218  1962 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.272881  1965 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.274683  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:47.275177  1962 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:00:47.276592  1580 leader_election.cc:343] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.284436  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:47.287609  1579 leader_election.cc:343] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.288458  1579 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.291997  1794 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.311399  1965 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.312193  1965 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.317544  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:47.318490  1538 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:47.321787  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:47.326399  1962 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.326869  1962 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.327167  1962 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.328895  1828 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.335433  1965 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.338652  1962 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.341739  1962 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.343542  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:47.344940  1538 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.374955  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:47.377516  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:47.380918  1732 raft_consensus.cc:359] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.381918  1732 raft_consensus.cc:385] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.382200  1732 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.384080  1538 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:47.385169  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:47.385872  1962 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.386341  1962 raft_consensus.cc:697] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:47.387122  1962 consensus_queue.cc:237] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.394115  1732 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.396633  1732 ts_tablet_manager.cc:1434] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.000s
I20260709 13:00:47.397650  1732 tablet_bootstrap.cc:492] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:47.404122  1732 tablet_bootstrap.cc:654] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.413466  1730 tablet_bootstrap.cc:492] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:47.414127  1730 ts_tablet_manager.cc:1403] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.203s	user 0.050s	sys 0.043s
I20260709 13:00:47.414173  1436 catalog_manager.cc:5697] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.418399  1732 tablet_bootstrap.cc:492] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:47.418912  1732 ts_tablet_manager.cc:1403] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:00:47.421991  1732 raft_consensus.cc:359] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.422792  1732 raft_consensus.cc:385] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.423090  1732 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
W20260709 13:00:47.427242  1579 leader_election.cc:343] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:47.429293  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 59773.4us
I20260709 13:00:47.423800  1732 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.436250  1730 raft_consensus.cc:359] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.437489  1730 raft_consensus.cc:385] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.438202  1829 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.437484  1977 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.440953  1732 ts_tablet_manager.cc:1434] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:00:47.443203  1732 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:47.440739  1977 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.445703  1731 tablet_bootstrap.cc:492] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:47.437888  1730 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.448617  1731 ts_tablet_manager.cc:1403] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.197s	user 0.073s	sys 0.100s
I20260709 13:00:47.448892  1730 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:47.454895  1579 leader_election.cc:343] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.455572  1977 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.464382  1731 raft_consensus.cc:359] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.465131  1731 raft_consensus.cc:385] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.464859  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:47.465616  1731 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.466038  1612 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:47.467702  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:47.468531  1977 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.466365  1731 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.474241  1730 ts_tablet_manager.cc:1434] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.001s
I20260709 13:00:47.470465  1977 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.478741  1977 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.479698  1731 ts_tablet_manager.cc:1434] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:00:47.481388  1731 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.492697  1965 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.497349  1965 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.500012  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:47.500784  1685 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:47.493392  1970 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.507028  1970 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.509914  1970 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.511710  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:47.512409  1730 tablet_bootstrap.cc:492] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:47.522713  1965 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.514912  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:47.524720  1504 leader_election.cc:343] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.525235  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:47.525750  1505 leader_election.cc:343] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.526262  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.514981  1977 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.528331  1976 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.531723  1611 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.540426  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:47.541031  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:47.541225  1612 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.542973  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:47.543962  1685 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.546933  1688 raft_consensus.cc:2393] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:47.553979  1612 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:47.555857  1962 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:00:47.542670  1977 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.560135  1976 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.560572  1579 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.564252  1965 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.564553  1730 tablet_bootstrap.cc:654] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:47.566285  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 113720us
I20260709 13:00:47.567797  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:47.568903  1970 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.569469  1970 raft_consensus.cc:697] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:47.570542  1731 tablet_bootstrap.cc:654] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.571365  1970 consensus_queue.cc:237] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.586570  1685 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:47.593425  1732 tablet_bootstrap.cc:654] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.611565  1436 catalog_manager.cc:5697] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.615057  1730 tablet_bootstrap.cc:492] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:47.615903  1730 ts_tablet_manager.cc:1403] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.111s	user 0.008s	sys 0.008s
I20260709 13:00:47.641671  1730 raft_consensus.cc:359] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.642789  1730 raft_consensus.cc:385] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.644320  1730 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.653616  1730 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.657509  1732 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:47.658074  1732 ts_tablet_manager.cc:1403] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.215s	user 0.017s	sys 0.013s
I20260709 13:00:47.659931  1730 ts_tablet_manager.cc:1434] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 13:00:47.666011  1731 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:47.666585  1731 ts_tablet_manager.cc:1403] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.186s	user 0.018s	sys 0.025s
I20260709 13:00:47.666337  1732 raft_consensus.cc:359] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.667148  1732 raft_consensus.cc:385] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.667452  1732 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.668138  1732 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.669499  1730 tablet_bootstrap.cc:492] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:47.672235  1732 ts_tablet_manager.cc:1434] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:00:47.673491  1732 tablet_bootstrap.cc:492] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:47.679358  1970 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.681398  1731 raft_consensus.cc:359] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.682156  1731 raft_consensus.cc:385] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.682428  1731 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.683143  1731 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.685286  1731 ts_tablet_manager.cc:1434] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:00:47.686218  1731 tablet_bootstrap.cc:492] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.686654  1965 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.687116  1965 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.689349  1965 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.691445  2012 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.692085  2012 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.693572  1962 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.694221  2012 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:47.696152  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:47.697094  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:47.697853  1654 leader_election.cc:343] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:47.699096  1579 leader_election.cc:343] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.705112  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:47.705852  1540 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:47.708137  1731 tablet_bootstrap.cc:654] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.708118  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:47.709569  2011 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:47.708160  1730 tablet_bootstrap.cc:654] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.709955  2011 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.710429  2011 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.728022  2011 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.742463  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:47.744138  1540 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.745728  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:47.746935  1732 tablet_bootstrap.cc:654] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.747355  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:00:47.750056  1654 leader_election.cc:343] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.756973  1540 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:47.757550  2011 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:47.768285  1730 tablet_bootstrap.cc:492] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:47.768458  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:47.766278  1731 tablet_bootstrap.cc:492] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
W20260709 13:00:47.758649  1580 leader_election.cc:343] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.770047  1828 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:47.770108  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.770671  1828 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:47.771778  1731 ts_tablet_manager.cc:1403] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.011s
I20260709 13:00:47.771909  1962 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.761330  1732 tablet_bootstrap.cc:492] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:47.771507  1828 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.775789  1731 raft_consensus.cc:359] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.776563  1731 raft_consensus.cc:385] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.776811  1731 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.777504  1731 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.778502  1977 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.768807  1730 ts_tablet_manager.cc:1403] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.006s
I20260709 13:00:47.778779  1732 ts_tablet_manager.cc:1403] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.105s	user 0.017s	sys 0.000s
I20260709 13:00:47.779065  1977 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.781268  1977 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.782011  1731 ts_tablet_manager.cc:1434] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:00:47.781797  1732 raft_consensus.cc:359] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.782526  1732 raft_consensus.cc:385] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.782817  1732 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.783618  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:47.783128  1731 tablet_bootstrap.cc:492] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
W20260709 13:00:47.785687  1504 leader_election.cc:343] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.791534  1436 catalog_manager.cc:5697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:47.792459  1730 raft_consensus.cc:359] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.792848  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:47.793157  1730 raft_consensus.cc:385] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.793504  1730 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.802349  1689 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:47.802695  1730 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.791607  1731 tablet_bootstrap.cc:654] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.804922  1730 ts_tablet_manager.cc:1434] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
W20260709 13:00:47.798043  1505 leader_election.cc:343] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.805572  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.806236  1970 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.810196  1731 tablet_bootstrap.cc:492] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:47.810735  1731 ts_tablet_manager.cc:1403] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.028s	user 0.004s	sys 0.007s
I20260709 13:00:47.798684  1962 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.801525  1732 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.811444  1962 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.813936  1732 ts_tablet_manager.cc:1434] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:00:47.813683  1731 raft_consensus.cc:359] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.814380  1731 raft_consensus.cc:385] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.814664  1731 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.814972  1962 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.815462  1732 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:47.815338  1731 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.811429  1965 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:47.817529  1731 ts_tablet_manager.cc:1434] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:00:47.818559  1731 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.822474  1730 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:47.824632  1731 tablet_bootstrap.cc:654] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.830137  1730 tablet_bootstrap.cc:654] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.833806  1732 tablet_bootstrap.cc:654] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.855888  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:47.857571  1580 leader_election.cc:343] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.859484  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:47.861020  1579 leader_election.cc:343] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.861570  1579 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.862645  1965 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:47.895612  1731 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:47.895885  1732 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:47.896117  1731 ts_tablet_manager.cc:1403] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.013s
I20260709 13:00:47.899132  1731 raft_consensus.cc:359] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.899817  1731 raft_consensus.cc:385] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.900144  1731 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.900751  1731 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.902660  1731 ts_tablet_manager.cc:1434] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:47.903641  1731 tablet_bootstrap.cc:492] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.909330  1731 tablet_bootstrap.cc:654] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.896467  1732 ts_tablet_manager.cc:1403] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.006s
I20260709 13:00:47.917251  1730 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:47.917814  1730 ts_tablet_manager.cc:1403] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.096s	user 0.023s	sys 0.041s
I20260709 13:00:47.919119  1732 raft_consensus.cc:359] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.919932  1732 raft_consensus.cc:385] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.920245  1732 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.920477  1730 raft_consensus.cc:359] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.922845  1730 raft_consensus.cc:385] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.923115  1730 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.923626  1965 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:47.923893  1730 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.925776  1730 ts_tablet_manager.cc:1434] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:00:47.927050  1730 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:47.931895  1732 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.933686  1730 tablet_bootstrap.cc:654] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.934217  1732 ts_tablet_manager.cc:1434] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:00:47.935324  1732 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:47.952559  1965 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.953033  1730 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:47.953473  1730 ts_tablet_manager.cc:1403] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.001s
I20260709 13:00:47.953189  1965 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.955947  1965 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:47.959030  1731 tablet_bootstrap.cc:492] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:47.959508  1731 ts_tablet_manager.cc:1403] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.009s
I20260709 13:00:47.960410  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:47.961977  1731 raft_consensus.cc:359] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:47.962357  1580 leader_election.cc:343] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.962659  1731 raft_consensus.cc:385] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.963006  1731 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.963106  1732 tablet_bootstrap.cc:654] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.965355  1731 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:47.959930  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:47.968410  1731 ts_tablet_manager.cc:1434] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:00:47.969866  1731 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:47.973526  1732 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:47.974144  1732 ts_tablet_manager.cc:1403] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.039s	user 0.006s	sys 0.011s
I20260709 13:00:47.977694  1732 raft_consensus.cc:359] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.978595  1732 raft_consensus.cc:385] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.979027  1731 tablet_bootstrap.cc:654] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:47.978965  1732 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.981081  1730 raft_consensus.cc:359] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.981698  1730 raft_consensus.cc:385] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:47.981986  1730 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:47.982645  1730 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.985855  1730 ts_tablet_manager.cc:1434] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 13:00:47.987282  1730 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:47.990404  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:47.992159  1579 leader_election.cc:343] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:47.992238  1732 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:47.992753  1579 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:47.997435  1732 ts_tablet_manager.cc:1434] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:00:47.998849  1732 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:48.006213  1732 tablet_bootstrap.cc:654] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.006810  1730 tablet_bootstrap.cc:654] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.016451  1964 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:48.032459  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44498.3us
I20260709 13:00:48.044507  1731 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:48.045053  1731 ts_tablet_manager.cc:1403] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.076s	user 0.029s	sys 0.039s
I20260709 13:00:48.048000  1731 raft_consensus.cc:359] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.048676  1731 raft_consensus.cc:385] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.048952  1731 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.049531  1730 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:48.049583  1731 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.050213  1730 ts_tablet_manager.cc:1403] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.003s
I20260709 13:00:48.051249  1732 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:48.051754  1732 ts_tablet_manager.cc:1403] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.021s
I20260709 13:00:48.052779  1730 raft_consensus.cc:359] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.053516  1730 raft_consensus.cc:385] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.053755  1730 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.054477  1730 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.055079  1732 raft_consensus.cc:359] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.055853  1732 raft_consensus.cc:385] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.055934  1731 ts_tablet_manager.cc:1434] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:00:48.056226  1732 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.056402  1730 ts_tablet_manager.cc:1434] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:00:48.057077  1731 tablet_bootstrap.cc:492] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:48.057327  1730 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:48.057739  1732 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.062915  1965 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.063472  1965 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.065593  1965 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.067559  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:48.069128  1579 leader_election.cc:343] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.070466  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:48.076992  1731 tablet_bootstrap.cc:654] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:48.078400  1580 leader_election.cc:343] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.078945  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:48.079752  1965 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.082067  1732 ts_tablet_manager.cc:1434] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:00:48.083225  1730 tablet_bootstrap.cc:654] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.086180  1828 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.086784  1828 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.090552  1732 tablet_bootstrap.cc:492] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:48.090583  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:48.092393  1541 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:48.093875  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:48.094915  2012 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.095376  2012 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.095799  2012 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.099612  1732 tablet_bootstrap.cc:654] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.114305  1970 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:48.116195  1962 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.116724  1962 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.118021  2011 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.118462  2011 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.119652  1962 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.121061  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:48.121132  1731 tablet_bootstrap.cc:492] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:48.122117  1540 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:48.122413  1731 ts_tablet_manager.cc:1403] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.023s
I20260709 13:00:48.122308  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:48.126108  1731 raft_consensus.cc:359] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.126751  1731 raft_consensus.cc:385] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.127009  1731 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.127671  1731 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.128441  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:48.129701  1731 ts_tablet_manager.cc:1434] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:00:48.130100  1962 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.130677  1731 tablet_bootstrap.cc:492] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:48.130614  1962 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.131239  1962 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.131320  2011 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:48.134181  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:48.134884  1540 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:48.137073  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:48.137499  1731 tablet_bootstrap.cc:654] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.139744  1968 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.140137  1968 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.140457  1968 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.144631  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:48.145467  1611 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
W20260709 13:00:48.153784  1579 leader_election.cc:343] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.140393  1977 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.158277  1977 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.161121  1977 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.163878  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:48.164824  1611 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:48.168617  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:48.169994  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:48.170878  1689 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:48.172964  1970 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.173560  1970 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.174052  1970 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.192957  2041 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.193666  2041 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.159405  1962 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.195756  2041 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:48.196940  1962 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.198379  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:48.199244  1541 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.200161  1970 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.203559  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:48.204331  1611 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.204780  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:48.205915  1540 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:48.209959  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:48.217406  1977 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:48.221024  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:48.221707  1970 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.221976  1616 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:48.223524  1611 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:48.224259  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:48.225364  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:48.225404  2011 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.226812  2019 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.227264  2011 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.227455  2019 raft_consensus.cc:697] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:48.227836  2011 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.228720  2019 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:48.233791  1579 leader_election.cc:343] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.236707  1962 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.237645  1962 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.236776  1977 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.244870  1962 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.241076  1977 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.258419  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:48.259339  1689 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.264278  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:48.271131  1438 catalog_manager.cc:5697] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:48.267382  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:48.296905  1505 leader_election.cc:343] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.281844  1828 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:48.300493  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:48.301486  1732 tablet_bootstrap.cc:492] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:48.302181  1732 ts_tablet_manager.cc:1403] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.212s	user 0.023s	sys 0.066s
I20260709 13:00:48.302421  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:48.304606  1504 leader_election.cc:343] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.305063  1504 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:48.308226  1689 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:48.288894  1977 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.282459  2012 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.297935  1540 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:48.332192  2046 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:48.335961  2045 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.343149  1731 tablet_bootstrap.cc:492] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:48.343708  1731 ts_tablet_manager.cc:1403] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.213s	user 0.069s	sys 0.067s
I20260709 13:00:48.345392  1732 raft_consensus.cc:359] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.369246  1732 raft_consensus.cc:385] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.369666  1732 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.370836  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:48.371475  1616 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:48.370425  1732 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:48.378829  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 74252.7us
W20260709 13:00:48.366446  1567 tablet.cc:2406] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:00:48.377509  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:48.395028  1730 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:48.395633  1730 ts_tablet_manager.cc:1403] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.339s	user 0.008s	sys 0.018s
I20260709 13:00:48.394098  1731 raft_consensus.cc:359] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.397547  1731 raft_consensus.cc:385] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.397938  1731 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.398773  1731 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.402107  1732 ts_tablet_manager.cc:1434] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.100s	user 0.003s	sys 0.017s
I20260709 13:00:48.403702  1732 tablet_bootstrap.cc:492] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:48.405146  2012 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:48.388116  1965 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:48.418061  1541 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:48.421097  1964 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.421679  1964 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.430841  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:48.423813  1964 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.415226  1965 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.390854  1968 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.434547  1962 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:48.413259  2011 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.440465  1965 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.437744  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:48.486891  1731 ts_tablet_manager.cc:1434] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.143s	user 0.021s	sys 0.028s
I20260709 13:00:48.473884  1962 raft_consensus.cc:697] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:48.487839  1540 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.530084  1731 tablet_bootstrap.cc:492] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:48.538425  1970 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.539192  1732 tablet_bootstrap.cc:654] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.541424  1970 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.556993  1730 raft_consensus.cc:359] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.558020  1730 raft_consensus.cc:385] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.558342  1730 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.565522  1731 tablet_bootstrap.cc:654] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.535142  1964 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.569969  1730 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.530242  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:48.606864  1730 ts_tablet_manager.cc:1434] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.211s	user 0.008s	sys 0.002s
I20260709 13:00:48.591720  1968 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:48.582389  1964 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:48.653090  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 205973us
I20260709 13:00:48.576517  1962 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.675908  1964 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.631989  2011 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:48.672118  1611 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:48.712071  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 93002.2us
I20260709 13:00:48.693586  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:00:48.719029  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45565.9us
I20260709 13:00:48.722432  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:48.722916  1616 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.721822  1613 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.728621  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:48.729200  1539 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:48.713554  1579 leader_election.cc:343] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.751099  1616 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:48.753890  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:48.754674  1535 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.758994  1970 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:48.794759  1539 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:48.795063  1730 tablet_bootstrap.cc:492] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
W20260709 13:00:48.809672  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 74041.4us
I20260709 13:00:48.837961  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:48.845268  1732 tablet_bootstrap.cc:492] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:48.846015  1732 ts_tablet_manager.cc:1403] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.443s	user 0.013s	sys 0.011s
I20260709 13:00:48.846676  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:48.879294  1535 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:48.880405  1612 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:48.797274  1965 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:48.890930  1504 leader_election.cc:343] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:48.895867  1731 tablet_bootstrap.cc:492] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:48.896416  1731 ts_tablet_manager.cc:1403] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.380s	user 0.037s	sys 0.060s
W20260709 13:00:48.897993  2071 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:00:48.898910  1732 raft_consensus.cc:359] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.899451  1732 raft_consensus.cc:385] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:48.899711  1732 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:48.901033  1732 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:48.903672  2019 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:48.904680  1730 tablet_bootstrap.cc:654] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:48.909312  1732 ts_tablet_manager.cc:1434] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
W20260709 13:00:48.909080  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 62044.1us
I20260709 13:00:48.923939  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:48.924763  1616 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:48.933485  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:48.935822  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:48.917094  1965 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:00:48.950863  2076 log.cc:927] Time spent T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
I20260709 13:00:48.948825  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:48.972575  1579 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:48.982064  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:48.946470  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:48.947347  1613 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:49.000166  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:00:49.008594  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:48.984486  1964 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:48.981380  1540 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:49.017894  2066 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.028182  2067 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:49.028769  2067 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.029101  2067 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:49.032737  1580 leader_election.cc:343] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.035776  2059 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.036602  2059 raft_consensus.cc:697] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:49.037658  2059 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.042495  2069 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.043181  2069 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:48.995734  2057 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:00:49.044454  2069 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:49.049042  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 65927.9us
I20260709 13:00:49.074601  1730 tablet_bootstrap.cc:492] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:49.075062  1730 ts_tablet_manager.cc:1403] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.280s	user 0.009s	sys 0.008s
I20260709 13:00:49.055245  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:49.078156  1612 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:49.080191  2056 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.085681  1732 tablet_bootstrap.cc:492] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:49.088624  1731 raft_consensus.cc:359] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.095803  1731 raft_consensus.cc:385] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.096148  1731 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.097949  1731 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.020974  2066 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:49.090508  1579 leader_election.cc:343] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.100934  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:49.065126  2073 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
W20260709 13:00:49.100108  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 80146.3us
I20260709 13:00:49.100502  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:49.108538  2057 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.097227  2056 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.176103  1731 ts_tablet_manager.cc:1434] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.279s	user 0.011s	sys 0.000s
I20260709 13:00:49.108705  1730 raft_consensus.cc:359] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.190369  1730 raft_consensus.cc:385] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.190725  1730 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.190971  1731 tablet_bootstrap.cc:492] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:49.191514  1730 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.189003  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:49.201328  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:49.201983  1535 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.162770  2067 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.207998  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:49.144692  1965 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:49.240869  1732 tablet_bootstrap.cc:654] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:49.192925  2066 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:00:49.272380  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 57399.8us
W20260709 13:00:49.273267  1504 leader_election.cc:343] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.273713  1690 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.279217  2056 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:00:49.279811  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 69201.6us
I20260709 13:00:49.283640  1730 ts_tablet_manager.cc:1434] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.208s	user 0.008s	sys 0.007s
I20260709 13:00:49.284914  1730 tablet_bootstrap.cc:492] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
W20260709 13:00:49.282721  1505 leader_election.cc:343] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.288488  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:49.289109  1438 catalog_manager.cc:5697] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:49.295033  2067 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:49.300864  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:49.302953  1731 tablet_bootstrap.cc:654] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:49.303999  1504 leader_election.cc:343] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.275648  2057 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:49.298118  2045 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:49.329033  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:49.329813  1610 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.329392  1732 tablet_bootstrap.cc:492] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:49.331527  1732 ts_tablet_manager.cc:1403] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.246s	user 0.009s	sys 0.009s
I20260709 13:00:49.314836  2057 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.338114  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:49.338488  1535 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:49.340517  1537 raft_consensus.cc:2393] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:49.346861  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:49.352344  1690 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:49.352463  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:49.356057  2052 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:49.363932  2082 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.364573  2082 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:49.367033  1732 raft_consensus.cc:359] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.367990  1732 raft_consensus.cc:385] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.366133  2082 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.368307  1732 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.379585  1610 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:49.386030  1732 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.404382  1685 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.420374  2052 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.436333  1654 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:49.450533  1732 ts_tablet_manager.cc:1434] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.119s	user 0.002s	sys 0.007s
I20260709 13:00:49.455132  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:49.420943  2052 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.475632  1730 tablet_bootstrap.cc:654] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:49.477526  1732 tablet_bootstrap.cc:492] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:49.478790  1731 tablet_bootstrap.cc:492] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:49.479532  1731 ts_tablet_manager.cc:1403] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.289s	user 0.031s	sys 0.033s
I20260709 13:00:49.481542  2064 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:49.467454  2056 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:49.495149  2065 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:00:49.502162  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:49.502357  2064 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:49.502965  1536 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
W20260709 13:00:49.489192  2090 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:00:49.503700  2064 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.515766  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:49.517910  1579 leader_election.cc:343] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:49.514851  2052 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:49.532609  1580 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:49.537416  2061 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:49.538621  2061 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.538980  2061 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.588909  1731 raft_consensus.cc:359] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.589723  1731 raft_consensus.cc:385] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.590021  1731 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.615837  1731 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.630206  1731 ts_tablet_manager.cc:1434] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.150s	user 0.025s	sys 0.061s
I20260709 13:00:49.632650  1731 tablet_bootstrap.cc:492] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:49.627228  2056 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:49.638585  1730 tablet_bootstrap.cc:492] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:49.640872  1732 tablet_bootstrap.cc:654] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:49.642387  1730 ts_tablet_manager.cc:1403] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.358s	user 0.012s	sys 0.024s
I20260709 13:00:49.652998  2050 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:49.671893  1731 tablet_bootstrap.cc:654] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:49.661075  2061 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.711009  1730 raft_consensus.cc:359] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.712527  1730 raft_consensus.cc:385] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.712918  1730 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.720193  2061 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:49.734480  1730 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.736512  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:49.740898  1534 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:49.926142  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 112204us
I20260709 13:00:49.930308  1732 tablet_bootstrap.cc:492] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:49.931078  1732 ts_tablet_manager.cc:1403] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.462s	user 0.014s	sys 0.026s
I20260709 13:00:49.946063  1732 raft_consensus.cc:359] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.946781  1732 raft_consensus.cc:385] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:49.947058  1732 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:49.947661  1732 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:49.950079  1732 ts_tablet_manager.cc:1434] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:00:49.951018  1732 tablet_bootstrap.cc:492] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:49.958047  1730 ts_tablet_manager.cc:1434] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.315s	user 0.011s	sys 0.009s
W20260709 13:00:49.969985  2105 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
I20260709 13:00:49.971051  1732 tablet_bootstrap.cc:654] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:49.975283  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:49.975957  1690 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:49.976151  1731 tablet_bootstrap.cc:492] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:49.976588  1731 ts_tablet_manager.cc:1403] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.345s	user 0.019s	sys 0.026s
I20260709 13:00:49.977078  1534 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:49.983260  1690 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:49.986357  1730 tablet_bootstrap.cc:492] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:49.991438  1732 tablet_bootstrap.cc:492] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:49.992111  1732 ts_tablet_manager.cc:1403] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.003s
I20260709 13:00:49.997764  2057 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:50.014256  1580 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:50.016939  1962 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:50.017668  1962 raft_consensus.cc:697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:50.019078  1962 consensus_queue.cc:237] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.048292  1732 raft_consensus.cc:359] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.104462  1732 raft_consensus.cc:385] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.104791  1732 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.105407  1732 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.107492  1732 ts_tablet_manager.cc:1434] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.115s	user 0.011s	sys 0.015s
I20260709 13:00:50.126232  1732 tablet_bootstrap.cc:492] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
W20260709 13:00:50.129477  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 86424.6us
I20260709 13:00:50.137045  1730 tablet_bootstrap.cc:654] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:50.151638  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 107850us
I20260709 13:00:50.163000  1731 raft_consensus.cc:359] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.164422  1731 raft_consensus.cc:385] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.164609  1731 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.170198  1731 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.188347  1731 ts_tablet_manager.cc:1434] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.211s	user 0.006s	sys 0.003s
I20260709 13:00:50.189299  1731 tablet_bootstrap.cc:492] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:50.157315  1965 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.204859  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:00:50.213380  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 48005.7us
W20260709 13:00:50.215364  1504 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:00:50.227381  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44185.9us
I20260709 13:00:50.236606  1962 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:50.237437  2061 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.238123  2061 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.207747  1965 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.299729  2085 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.324568  2085 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.327057  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:50.292817  1965 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:00:50.354633  1579 leader_election.cc:343] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.362794  2085 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.365902  2116 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.369781  2011 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 13:00:50.380092  2113 log.cc:927] Time spent T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:00:50.380757  2061 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.393754  1730 tablet_bootstrap.cc:492] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:50.394306  1730 ts_tablet_manager.cc:1403] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.408s	user 0.012s	sys 0.020s
I20260709 13:00:50.384159  1731 tablet_bootstrap.cc:654] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.395869  1732 tablet_bootstrap.cc:654] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.400604  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:50.412420  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:50.395123  2116 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.420300  2048 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:50.430365  2046 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:50.429653  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 195519us
I20260709 13:00:50.444689  2123 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.448011  2123 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.451818  2123 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.443368  1962 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:00:50.460100  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:50.459933  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:50.461490  1533 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
W20260709 13:00:50.463416  1580 leader_election.cc:343] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.464423  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:50.446453  2064 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:00:50.474303  2084 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:50.476977  2084 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.477438  2084 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.479027  1730 raft_consensus.cc:359] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.479645  1730 raft_consensus.cc:385] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.479878  1730 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.472362  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:50.484558  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:50.488193  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:50.488991  1608 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:50.491248  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:50.492481  1505 leader_election.cc:343] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.493171  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:50.496454  2115 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:50.496892  2115 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.497201  2115 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:50.501554  1504 leader_election.cc:343] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.501144  1730 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.502039  1504 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:50.502430  1688 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:50.517379  2049 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:50.535247  1579 leader_election.cc:343] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.535873  1579 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:50.522776  2116 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.553145  2065 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:50.585501  1731 tablet_bootstrap.cc:492] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:50.586434  1731 ts_tablet_manager.cc:1403] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.397s	user 0.020s	sys 0.010s
I20260709 13:00:50.563807  1962 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:00:50.611881  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:50.615842  1731 raft_consensus.cc:359] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.617576  1731 raft_consensus.cc:385] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.617995  1731 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:50.621523  2084 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.622646  1731 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:50.642537  2131 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.175s	user 0.004s	sys 0.000s
I20260709 13:00:50.651733  1616 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:50.654865  1731 ts_tablet_manager.cc:1434] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.004s
I20260709 13:00:50.660732  2061 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.661381  1730 ts_tablet_manager.cc:1434] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.267s	user 0.004s	sys 0.008s
I20260709 13:00:50.661309  2061 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.662181  2115 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.662444  1730 tablet_bootstrap.cc:492] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:50.741041  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:00:50.732649  2137 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:00:50.747270  1681 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.734162  2061 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.751493  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:50.727613  2084 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.753450  2115 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.662994  1731 tablet_bootstrap.cc:492] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:50.760924  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:50.785156  1732 tablet_bootstrap.cc:492] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:50.787294  1732 ts_tablet_manager.cc:1403] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.661s	user 0.021s	sys 0.032s
I20260709 13:00:50.790544  1681 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:50.790904  1731 tablet_bootstrap.cc:654] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.790956  1730 tablet_bootstrap.cc:654] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:50.792079  1438 catalog_manager.cc:5697] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:50.795821  1438 catalog_manager.cc:5697] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:50.817848  1504 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:50.818648  2115 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:50.819039  2115 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.819368  2115 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:50.866410  2053 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.907083  2053 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.976017  2053 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.981840  1732 raft_consensus.cc:359] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.983129  1732 raft_consensus.cc:385] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:50.983497  1732 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
W20260709 13:00:50.982034  1504 leader_election.cc:343] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.984347  1732 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:50.956880  2115 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:50.990130  1579 leader_election.cc:343] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.991124  2084 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:00:50.992245  2115 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:50.995280  1732 ts_tablet_manager.cc:1434] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.208s	user 0.037s	sys 0.067s
W20260709 13:00:50.996223  1504 leader_election.cc:343] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:50.997030  1732 tablet_bootstrap.cc:492] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:51.005594  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:51.011090  2065 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:51.016335  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:51.017313  1681 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:51.019210  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:51.027066  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:51.029023  1539 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:51.018749  2065 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:51.038414  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:51.039019  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:51.039244  1533 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:51.039748  1541 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:51.022598  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:51.076072  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:51.093178  1580 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:51.096742  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:51.100677  1962 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:51.108541  1962 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.108904  1962 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.088449  1609 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.110998  1730 tablet_bootstrap.cc:492] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:51.111497  1730 ts_tablet_manager.cc:1403] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.449s	user 0.028s	sys 0.003s
I20260709 13:00:51.118309  1732 tablet_bootstrap.cc:654] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.119129  1730 raft_consensus.cc:359] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.119980  1730 raft_consensus.cc:385] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.120278  1730 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.120498  1731 tablet_bootstrap.cc:492] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:51.120956  1731 ts_tablet_manager.cc:1403] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.465s	user 0.039s	sys 0.023s
I20260709 13:00:51.106737  2052 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:51.139695  2052 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.172513  2052 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:51.199816  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 73127.9us
I20260709 13:00:51.176187  1730 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.122526  2065 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.307160  1731 raft_consensus.cc:359] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.308022  1731 raft_consensus.cc:385] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.310076  1731 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.310724  1730 ts_tablet_manager.cc:1434] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.199s	user 0.012s	sys 0.000s
I20260709 13:00:51.316336  1731 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:51.319072  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 182580us
I20260709 13:00:51.323801  1688 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:51.335389  1579 leader_election.cc:343] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:51.337420  1731 ts_tablet_manager.cc:1434] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.216s	user 0.009s	sys 0.005s
I20260709 13:00:51.345651  1731 tablet_bootstrap.cc:492] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
W20260709 13:00:51.390650  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 53897.8us
W20260709 13:00:51.400749  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:51.407002  1965 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.407712  1965 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.410318  1965 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:51.410881  1609 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:51.416297  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:51.427297  1732 tablet_bootstrap.cc:492] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:51.428231  1732 ts_tablet_manager.cc:1403] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.432s	user 0.016s	sys 0.024s
I20260709 13:00:51.432499  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:51.435890  1580 leader_election.cc:343] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:51.425730  2064 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:51.431095  1962 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.454252  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:00:51.500257  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58624.5us
I20260709 13:00:51.485443  2064 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:51.521415  1962 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:51.531983  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:51.532893  1539 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:51.546579  1732 raft_consensus.cc:359] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:51.547504  1579 leader_election.cc:343] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:51.547770  1732 raft_consensus.cc:385] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:51.548010  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:51.548400  1732 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:51.565836  1732 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.569448  2064 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.565445  2118 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:51.578086  1731 tablet_bootstrap.cc:654] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:51.581806  1732 ts_tablet_manager.cc:1434] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.153s	user 0.008s	sys 0.003s
W20260709 13:00:51.628998  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 91513.1us
I20260709 13:00:51.649909  1539 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:00:51.690538  2052 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:51.953135  2052 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:51.988601  1731 tablet_bootstrap.cc:492] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:51.989128  1731 ts_tablet_manager.cc:1403] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.651s	user 0.017s	sys 0.020s
I20260709 13:00:52.032806  1730 tablet_bootstrap.cc:492] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:52.039935  1730 tablet_bootstrap.cc:654] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.042858  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:52.046746  1730 tablet_bootstrap.cc:492] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:52.047673  1730 ts_tablet_manager.cc:1403] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.003s
I20260709 13:00:52.048625  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:52.054332  1730 raft_consensus.cc:359] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.055348  1730 raft_consensus.cc:385] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.055672  1730 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.056613  1730 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.059310  1730 ts_tablet_manager.cc:1434] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:00:52.060684  1730 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:52.067714  1730 tablet_bootstrap.cc:654] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.071863  2116 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.072580  2116 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.074712  2116 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:52.075881  1730 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:52.076381  1730 ts_tablet_manager.cc:1403] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.001s
I20260709 13:00:52.079118  1730 raft_consensus.cc:359] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.080112  1730 raft_consensus.cc:385] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.080600  1730 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.081590  1730 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.083568  1730 ts_tablet_manager.cc:1434] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:00:52.084980  1730 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:52.093041  1730 tablet_bootstrap.cc:654] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.100682  1730 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:52.101177  1730 ts_tablet_manager.cc:1403] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:00:52.104007  1730 raft_consensus.cc:359] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.104882  1730 raft_consensus.cc:385] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.105213  1730 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.105948  1730 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.107309  1730 ts_tablet_manager.cc:1434] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:00:52.108394  1730 tablet_bootstrap.cc:492] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:52.115127  2116 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:52.115578  1730 tablet_bootstrap.cc:654] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.115803  2116 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.119006  2116 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:52.130052  1730 tablet_bootstrap.cc:492] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:52.130662  1730 ts_tablet_manager.cc:1403] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.008s
I20260709 13:00:52.133654  1730 raft_consensus.cc:359] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.135241  1730 raft_consensus.cc:385] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.135566  1730 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.136332  1730 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.138055  1730 ts_tablet_manager.cc:1434] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:52.139029  1730 tablet_bootstrap.cc:492] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:52.146360  1730 tablet_bootstrap.cc:654] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.147624  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:52.148241  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:52.149504  1828 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.150038  1828 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.153728  1828 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:52.158273  1730 tablet_bootstrap.cc:492] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:52.158890  1730 ts_tablet_manager.cc:1403] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:00:52.162936  1730 raft_consensus.cc:359] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.163694  1730 raft_consensus.cc:385] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.164000  1730 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.164731  1730 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.166473  1730 ts_tablet_manager.cc:1434] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:00:52.167484  1730 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
W20260709 13:00:52.175561  1504 leader_election.cc:343] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.177145  1730 tablet_bootstrap.cc:654] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.167327  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:52.196152  1731 raft_consensus.cc:359] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.197042  1731 raft_consensus.cc:385] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.197338  1731 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.198112  1731 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:52.202950  1654 leader_election.cc:343] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:52.207370  1506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.004s	sys 0.008s
I20260709 13:00:52.210459  2167 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.213874  2011 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.214408  2011 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.218374  2011 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:52.211390  2167 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.228293  1732 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:52.245434  1730 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:52.248322  1730 ts_tablet_manager.cc:1403] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.081s	user 0.031s	sys 0.020s
I20260709 13:00:52.248481  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:52.251421  2167 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:52.251575  1730 raft_consensus.cc:359] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.252589  1730 raft_consensus.cc:385] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.252904  1730 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.259939  1730 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.260773  1731 ts_tablet_manager.cc:1434] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.271s	user 0.008s	sys 0.000s
I20260709 13:00:52.263131  1731 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:52.263245  1732 tablet_bootstrap.cc:654] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.267416  2011 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.268330  1730 ts_tablet_manager.cc:1434] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:00:52.268055  2011 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.269843  1730 tablet_bootstrap.cc:492] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:52.283840  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:52.284652  1688 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 0.
I20260709 13:00:52.259603  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 207) took 1240 ms. Trace:
W20260709 13:00:52.289467  1579 leader_election.cc:343] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.294171  2011 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:52.288636  1616 rpcz_store.cc:276] 0709 13:00:51.018767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.018907 (+   140us) service_pool.cc:224] Handling call
0709 13:00:52.259303 (+1240396us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54003a34d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:00:52.259486 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297653504}
I20260709 13:00:52.295487  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:52.298617  1731 tablet_bootstrap.cc:654] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.303298  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:52.303817  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:52.300498  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 210) took 1265 ms. Trace:
I20260709 13:00:52.296438  1540 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:52.307200  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:52.308769  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:52.310032  1613 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:52.304840  1615 rpcz_store.cc:276] 0709 13:00:51.034782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.042173 (+  7391us) service_pool.cc:224] Handling call
0709 13:00:51.042528 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:51.042752 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:00:52.212861 (+1170109us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b1800150400. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba18455 00007fd0325003c7 00007fd02eb129a7 00007fd02eb220bf
0709 13:00:52.213040 (+   179us) log.cc:844] Serialized 14 byte log entry
0709 13:00:52.299947 (+ 86907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:52.300026 (+    79us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:52.300126 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:52.300235 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:52.300383 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":891250,"prepare.queue_time_us":267156,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":1862,"spinlock_wait_cycles":2601856,"thread_start_us":332302,"threads_started":2,"wal-append.queue_time_us":82470}
I20260709 13:00:52.312294  2011 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:00:52.313265  1654 leader_election.cc:343] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.313895  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:52.312913  2011 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:52.315074  1654 leader_election.cc:343] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.324234  1580 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:52.326469  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:52.328229  2127 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.332159  1965 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:00:52.319541  1579 leader_election.cc:343] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.341297  1579 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:52.346817  2154 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.346952  2041 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.341554  2011 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.352711  2061 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.360270  2154 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:52.362062  2154 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.360419  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:52.384472  1536 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.353230  2061 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.388346  2061 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.390558  2011 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.403347  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:52.408075  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:52.434561  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:52.437399  1536 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
W20260709 13:00:52.439109  1505 leader_election.cc:343] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.439838  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:52.441272  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:52.465387  1730 tablet_bootstrap.cc:654] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.472313  1730 tablet_bootstrap.cc:492] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:52.472812  1730 ts_tablet_manager.cc:1403] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.203s	user 0.015s	sys 0.010s
I20260709 13:00:52.479807  2189 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.480796  2189 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:52.500865  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 180380us
I20260709 13:00:52.517767  1732 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:52.518437  1732 ts_tablet_manager.cc:1403] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.290s	user 0.023s	sys 0.028s
I20260709 13:00:52.521297  1732 raft_consensus.cc:359] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.521878  1732 raft_consensus.cc:385] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.522178  1732 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.522898  1732 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.526010  1732 ts_tablet_manager.cc:1434] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:00:52.527158  1732 tablet_bootstrap.cc:492] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:52.537283  1732 tablet_bootstrap.cc:654] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.543812  1732 tablet_bootstrap.cc:492] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:52.544402  1732 ts_tablet_manager.cc:1403] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:00:52.547614  1732 raft_consensus.cc:359] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.548341  1732 raft_consensus.cc:385] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.548641  1732 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.549587  1732 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.551434  1732 ts_tablet_manager.cc:1434] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:00:52.552399  1732 tablet_bootstrap.cc:492] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:52.559360  1732 tablet_bootstrap.cc:654] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.566573  1731 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:52.566912  1732 tablet_bootstrap.cc:492] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:52.567060  1731 ts_tablet_manager.cc:1403] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.304s	user 0.032s	sys 0.042s
I20260709 13:00:52.567476  1732 ts_tablet_manager.cc:1403] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.015s	user 0.003s	sys 0.008s
W20260709 13:00:52.569324  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 144734us
I20260709 13:00:52.570381  1732 raft_consensus.cc:359] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.571177  1732 raft_consensus.cc:385] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.571441  1732 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.572122  1732 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.574366  1732 ts_tablet_manager.cc:1434] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:00:52.577491  2154 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.578279  2084 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:00:52.578418  2154 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.578948  2084 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.580024  2064 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.580590  2064 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.581658  2154 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:52.581758  2084 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:52.582366  2154 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:00:52.583029  2064 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:52.582906  2154 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.585026  2154 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:52.585731  1732 tablet_bootstrap.cc:492] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:52.586632  1964 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:00:52.592312  1731 raft_consensus.cc:359] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.593323  1731 raft_consensus.cc:385] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.593640  1731 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.594190  1732 tablet_bootstrap.cc:654] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:52.596437  1580 leader_election.cc:343] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.598443  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:52.608620  2121 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:52.594424  1731 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.606604  1732 tablet_bootstrap.cc:492] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:52.609472  2121 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:52.610713  1731 ts_tablet_manager.cc:1434] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:00:52.610713  2121 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.612023  1731 tablet_bootstrap.cc:492] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:52.612972  1439 catalog_manager.cc:5697] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:52.630836  2011 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:52.628556  2065 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.614951  1439 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.770668  2065 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.771445  1439 catalog_manager.cc:5697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.621969  2048 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.618503  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 116864us
I20260709 13:00:52.775316  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:52.776732  2125 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.615984  1732 ts_tablet_manager.cc:1403] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.004s
I20260709 13:00:52.630909  1730 raft_consensus.cc:359] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.779438  1730 raft_consensus.cc:385] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.616520  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:52.618710  2170 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.683604  2061 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.625069  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:52.644299  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:52.627146  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:52.784626  1685 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:52.615912  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:52.784171  1614 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:00:52.634282  2190 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.146s	user 0.004s	sys 0.000s
I20260709 13:00:52.774070  2048 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.623842  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:52.782047  2170 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.660372  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 100) took 2374 ms. Trace:
I20260709 13:00:52.779809  1730 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.620195  2162 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.625377  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:52.762135  1731 tablet_bootstrap.cc:700] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Time spent opening tablet: real 0.101s	user 0.002s	sys 0.000s
W20260709 13:00:52.792083  1579 leader_election.cc:343] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:52.791678  1730 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.781987  1732 raft_consensus.cc:359] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.801482  1732 raft_consensus.cc:385] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:52.801936  1732 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:52.795852  1504 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:00:52.797466  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:52.803825  1731 tablet_bootstrap.cc:654] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:52.831144  1730 ts_tablet_manager.cc:1434] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.358s	user 0.011s	sys 0.009s
I20260709 13:00:52.737383  2127 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.789009  2048 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:52.836083  1732 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.617141  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:52.790254  1438 rpcz_store.cc:276] 0709 13:00:50.286229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.287245 (+  1016us) service_pool.cc:224] Handling call
0709 13:00:52.660224 (+2372979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:51.016268 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:51.016857 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:51.016896 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:00:51.016912 (+    16us) tablet.cc:662] Decoding operations
0709 13:00:51.017345 (+   433us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:51.017428 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:51.017458 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:51.074462 (+ 57004us) tablet.cc:701] Row locks acquired
0709 13:00:51.077680 (+  3218us) write_op.cc:260] PREPARE: finished
0709 13:00:51.082869 (+  5189us) write_op.cc:270] Start()
0709 13:00:51.083037 (+   168us) write_op.cc:276] Timestamp: P: 1783602051082811 usec, L: 0
0709 13:00:51.083068 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:00:51.086049 (+  2981us) log.cc:844] Serialized 928 byte log entry
0709 13:00:52.314113 (+1228064us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b1800138f40. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:00:52.415945 (+101832us) op_driver.cc:464] REPLICATION: finished
0709 13:00:52.440991 (+ 25046us) write_op.cc:301] APPLY: starting
0709 13:00:52.441071 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:52.441189 (+   118us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:52.441203 (+    14us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:52.441457 (+   254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:52.441616 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:52.441666 (+    50us) write_op.cc:312] APPLY: finished
0709 13:00:52.441851 (+   185us) log.cc:844] Serialized 28 byte log entry
0709 13:00:52.441960 (+   109us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:52.442018 (+    58us) write_op.cc:454] Released schema lock
0709 13:00:52.442045 (+    27us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:52.442332 (+   287us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:52.442354 (+    22us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":24767,"apply.run_cpu_time_us":1332,"apply.run_wall_time_us":1335,"num_ops":2,"prepare.queue_time_us":180964,"prepare.run_cpu_time_us":19292,"prepare.run_wall_time_us":271005,"raft.queue_time_us":63409,"raft.run_cpu_time_us":8822,"raft.run_wall_time_us":24127,"replication_time_us":1332716,"spinlock_wait_cycles":14740224,"thread_start_us":403903,"threads_started":4,"wal-append.queue_time_us":223060}]]}
I20260709 13:00:52.845785  1732 ts_tablet_manager.cc:1434] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 13:00:52.846335  2125 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:52.847221  1732 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:52.847640  2170 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:52.847536  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:52.848292  1609 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.805207  2162 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.852417  2162 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:52.852982  1730 tablet_bootstrap.cc:492] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:52.827639  2189 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:52.890213  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:52.899497  1538 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.889552  2189 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.910604  2189 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:52.923489  1580 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:52.933386  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:52.881008  2127 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:52.949273  2053 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:52.966163  2127 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:00:52.982858  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 124159us
W20260709 13:00:52.994860  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57124.5us
W20260709 13:00:53.001386  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 77989.2us
I20260709 13:00:52.942030  2050 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:00:53.003729  1580 leader_election.cc:343] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.004240  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:52.943004  2140 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:00:52.943276  2019 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.063s
I20260709 13:00:53.013942  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:53.021412  2062 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.024516  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:53.025622  1532 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:53.026014  2061 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.026655  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:53.008872  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:53.009052  2121 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:00:53.029376  2121 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.036993  1730 tablet_bootstrap.cc:654] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.056288  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:53.057128  1613 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:53.013376  2140 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.058202  2121 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.009406  2154 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.067241  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:53.049443  2202 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.067770  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:00:53.083671  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 78277.5us
I20260709 13:00:53.007309  2050 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.097843  2050 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:00:53.106841  1654 leader_election.cc:343] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.101048  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:53.113595  1731 tablet_bootstrap.cc:492] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:53.114259  1731 ts_tablet_manager.cc:1403] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.502s	user 0.013s	sys 0.010s
W20260709 13:00:53.228086  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 166181us
I20260709 13:00:53.093057  2202 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.105021  1538 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:53.113692  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:53.118471  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:53.248987  2116 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.249254  2202 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.250049  2140 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.252635  1609 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
W20260709 13:00:53.254628  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 180599us
I20260709 13:00:53.302291  1731 raft_consensus.cc:359] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.303259  1731 raft_consensus.cc:385] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.303555  1731 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.253562  2065 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.305657  1731 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.291355  2116 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.320870  1732 tablet_bootstrap.cc:654] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.325167  1731 ts_tablet_manager.cc:1434] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.211s	user 0.006s	sys 0.005s
I20260709 13:00:53.301870  1682 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.327286  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:53.329996  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:53.305912  2202 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.331708  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:53.335711  1731 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:53.334726  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:53.322971  2116 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.342885  2121 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.337589  2202 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.373921  2202 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.356052  2189 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.375828  1532 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:53.376626  2116 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:53.382552  1654 leader_election.cc:343] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.383049  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:53.392194  1730 tablet_bootstrap.cc:492] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:53.392962  1730 ts_tablet_manager.cc:1403] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.540s	user 0.013s	sys 0.032s
I20260709 13:00:53.376837  1682 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
W20260709 13:00:53.408543  1637 debug-util.cc:398] Leaking SignalData structure 0x7b0800109fa0 after lost signal to thread 434
W20260709 13:00:53.415583  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08000babc0 after lost signal to thread 1473
W20260709 13:00:53.416904  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba900 after lost signal to thread 1565
W20260709 13:00:53.417999  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9c80 after lost signal to thread 1640
W20260709 13:00:53.418309  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9f60 after lost signal to thread 1641
I20260709 13:00:53.418440  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:53.419414  1610 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:53.419668  1637 debug-util.cc:398] Leaking SignalData structure 0x7b0800293c00 after lost signal to thread 1714
I20260709 13:00:53.420987  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:53.422488  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:53.408010  2189 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.426963  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:53.430056  1609 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:00:53.424541  1637 debug-util.cc:398] Leaking SignalData structure 0x7b0800293b80 after lost signal to thread 1715
I20260709 13:00:53.432435  1614 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
W20260709 13:00:53.435283  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002936c0 after lost signal to thread 2135
I20260709 13:00:53.443758  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:53.442930  2116 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.453624  1731 tablet_bootstrap.cc:654] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.452812  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:53.454896  1610 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:53.457679  2152 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:00:53.469228  1505 leader_election.cc:343] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.474435  1732 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:53.475747  1732 ts_tablet_manager.cc:1403] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.629s	user 0.020s	sys 0.024s
I20260709 13:00:53.479198  1732 raft_consensus.cc:359] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.480083  1732 raft_consensus.cc:385] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.481258  1732 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.481680  1579 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:00:53.480784  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:53.482125  2196 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.482609  1732 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.482748  2196 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.494894  2196 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:00:53.495014  1504 leader_election.cc:343] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:53.496199  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:53.483886  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:53.485105  2085 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:53.481742  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:53.486268  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 103741us
I20260709 13:00:53.500061  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:53.487705  2140 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.490455  1730 raft_consensus.cc:359] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.505295  1730 raft_consensus.cc:385] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.505614  1730 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.506309  1730 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.498095  2085 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.507603  2085 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.486716  2205 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.526996  1732 ts_tablet_manager.cc:1434] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:00:53.530680  1730 ts_tablet_manager.cc:1434] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.137s	user 0.002s	sys 0.005s
I20260709 13:00:53.508278  2162 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.526325  2140 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:53.542090  1732 tablet_bootstrap.cc:492] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: Bootstrap starting.
I20260709 13:00:53.524576  2064 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:53.557271  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:53.557047  2140 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.558085  1537 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:53.553452  2064 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:53.563283  2064 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.539141  2121 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:00:53.550771  2162 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:53.569211  2162 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.572379  2085 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.577558  1731 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:53.578482  1731 ts_tablet_manager.cc:1403] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.251s	user 0.023s	sys 0.015s
I20260709 13:00:53.582314  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:53.583920  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:53.586587  1828 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.600919  1683 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.615206  2085 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.616991  1732 tablet_bootstrap.cc:654] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.619007  1731 raft_consensus.cc:359] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.621222  1731 raft_consensus.cc:385] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.621665  1731 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.621302  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:53.623812  1731 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.625416  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:53.645304  1731 ts_tablet_manager.cc:1434] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.002s
I20260709 13:00:53.627245  2110 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.627352  2206 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.719137  2110 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.730122  1732 tablet_bootstrap.cc:492] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: No bootstrap required, opened a new log
I20260709 13:00:53.732290  1732 ts_tablet_manager.cc:1403] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: Time spent bootstrapping tablet: real 0.190s	user 0.018s	sys 0.000s
I20260709 13:00:53.739214  1732 raft_consensus.cc:359] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.740195  1732 raft_consensus.cc:385] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.740540  1732 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.741393  1732 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.744630  1732 ts_tablet_manager.cc:1434] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:00:53.782430  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:53.825042  1730 tablet_bootstrap.cc:492] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:53.836301  1730 tablet_bootstrap.cc:654] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:53.847255  1730 tablet_bootstrap.cc:492] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:53.847755  1730 ts_tablet_manager.cc:1403] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.012s
I20260709 13:00:53.850381  1730 raft_consensus.cc:359] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.851075  1730 raft_consensus.cc:385] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:53.851328  1730 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:53.852697  1730 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.855906  1730 ts_tablet_manager.cc:1434] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:00:53.882198  2064 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.883050  2064 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.884982  2064 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.903676  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:53.904580  1689 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:00:53.905417  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:53.905982  1689 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:53.913563  1689 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:53.915433  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:53.916693  2169 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.916684  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:53.917387  2169 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.919551  2169 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:53.920289  1685 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:53.963891  1579 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:53.964884  2118 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:53.971201  2121 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:00:53.971761  2121 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:53.973503  2121 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:53.981835  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:53.986304  2162 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:53.990953  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:53.993098  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:53.993782  1614 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:53.994099  1731 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:53.996163  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:53.996827  1690 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
W20260709 13:00:54.090233  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 122828us
I20260709 13:00:54.099629  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:54.103286  2120 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.002058  1504 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:00:54.105196  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 103230us
W20260709 13:00:54.106546  1504 leader_election.cc:343] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.106680  2180 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:00:54.108700  1504 leader_election.cc:343] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.137732  1504 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:00:54.147698  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52933.8us
I20260709 13:00:54.150549  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:54.151373  1539 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
W20260709 13:00:54.153347  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51961.9us
I20260709 13:00:54.154564  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:54.156153  1612 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.156690  2180 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.157089  2180 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.157397  2180 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.160540  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:54.163810  2232 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.183123  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:54.193604  1731 tablet_bootstrap.cc:654] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:54.199186  1505 leader_election.cc:343] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.199883  1828 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.201386  1828 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.201881  1828 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.197239  2169 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:54.222010  1828 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.224928  1828 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:54.286978  1612 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
W20260709 13:00:54.292348  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 102166us
W20260709 13:00:54.292659  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 73154.4us
I20260709 13:00:54.302721  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:54.303500  1533 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.308338  1828 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.309204  1828 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.320901  1828 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:54.345431  1828 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:54.281646  2169 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.353579  2236 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.354384  2169 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:54.354283  2236 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.358101  1730 tablet_bootstrap.cc:492] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:54.366406  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:54.365244  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:54.365923  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:54.396301  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:54.412196  1535 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 0.
I20260709 13:00:54.416798  1731 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:54.417340  1731 ts_tablet_manager.cc:1403] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.424s	user 0.016s	sys 0.003s
W20260709 13:00:54.419691  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 121394us
I20260709 13:00:54.421010  1580 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:00:54.422530  1654 leader_election.cc:343] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.420953  2180 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.429054  2231 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:54.434834  1731 raft_consensus.cc:359] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.435650  1731 raft_consensus.cc:385] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:54.439183  2236 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:54.444352  1731 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:54.430037  2180 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:54.447599  1731 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.466548  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:54.470609  2246 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.471161  2246 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:54.472067  2246 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.478091  2140 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:00:54.478730  2140 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.487182  1731 ts_tablet_manager.cc:1434] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:00:54.489213  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:54.498296  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:00:54.499603  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 130767us
I20260709 13:00:54.500316  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:54.506767  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:54.507524  1689 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.511307  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:54.512225  1828 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.512745  1828 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.513021  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:54.513160  1828 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.483019  2140 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:54.502367  2232 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:54.519842  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:54.520501  1616 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.527086  1689 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:54.527729  1616 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:54.528993  2212 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.529546  2212 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.531729  2212 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:54.538795  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:54.514910  1533 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:54.537716  2248 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:00:54.545600  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:54.560348  1616 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 0.
I20260709 13:00:54.568369  1828 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.568789  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:54.536098  2212 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:00:54.570367  1688 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 1: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:00:54.575053  2246 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:00:54.563380  2120 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:00:54.577737  1828 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:54.578553  2116 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:00:54.579002  2116 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.579355  2116 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.567226  2236 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.582104  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:54.587160  2236 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:00:54.588452  2236 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.574503  2212 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.594687  1730 tablet_bootstrap.cc:654] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:54.615868  1654 leader_election.cc:343] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:00:54.612723  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 46274.9us
W20260709 13:00:54.620668  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51957.2us
I20260709 13:00:54.627276  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:54.630133  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:54.634008  1828 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:54.634562  1828 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.637248  2110 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:54.637794  2110 raft_consensus.cc:697] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:54.638677  2110 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.640291  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:54.632730  2120 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:00:54.644563  2120 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.658388  1828 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:54.657874  2116 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:54.662635  1436 catalog_manager.cc:5697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:54.665606  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:54.694491  2116 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:54.694940  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:54.697875  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 252) took 1033 ms. Trace:
I20260709 13:00:54.775302  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:54.777163  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:54.776866  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:54.778447  1540 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:00:54.776402  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 145257us
I20260709 13:00:54.698354  1685 rpcz_store.cc:276] 0709 13:00:53.664921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.667153 (+  2232us) service_pool.cc:224] Handling call
0709 13:00:54.697657 (+1030504us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b54000d61d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:00:54.697771 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5905280}
W20260709 13:00:54.799700  1504 leader_election.cc:343] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:54.790917  2212 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:54.810392  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:54.804553  2222 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:54.819566  1540 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:54.811193  1607 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:54.828693  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:54.841883  1730 tablet_bootstrap.cc:492] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:54.842609  1730 ts_tablet_manager.cc:1403] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.485s	user 0.019s	sys 0.025s
I20260709 13:00:54.844067  2048 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:55.019595  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080018e160 after lost signal to thread 434
W20260709 13:00:55.099332  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 68688.2us
I20260709 13:00:55.179768  1828 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:55.180528  1828 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.230454  1828 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:55.337548  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:55.341732  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:55.349663  1730 raft_consensus.cc:359] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.345424  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:55.353627  1730 raft_consensus.cc:385] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.357882  1730 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.351728  2169 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.364877  1730 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:55.363485  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1020 after lost signal to thread 1473
I20260709 13:00:55.351369  2244 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:00:55.377808  1730 ts_tablet_manager.cc:1434] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.535s	user 0.011s	sys 0.005s
I20260709 13:00:55.361361  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:00:55.378930  1730 ts_tablet_manager.cc:1467] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Tablet startup took 535ms
I20260709 13:00:55.392657  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 303) took 1227 ms. Trace:
W20260709 13:00:55.398350  1607 consensus_meta.cc:287] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.566s	user 0.013s	sys 0.000s
W20260709 13:00:55.398715  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800277780 after lost signal to thread 1565
W20260709 13:00:55.402446  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 283) took 1799 ms (client timeout 2221 ms). Trace:
I20260709 13:00:55.393916  1609 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.401441  2205 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.393963  2169 raft_consensus.cc:697] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:55.408324  1607 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
W20260709 13:00:55.410835  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800277700 after lost signal to thread 1566
I20260709 13:00:55.431113  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 288) took 1124 ms. Trace:
I20260709 13:00:55.428748  2205 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:55.393239  1730 ts_tablet_manager.cc:1469] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Trace:
0709 13:00:41.938245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.938395 (+   150us) service_pool.cc:224] Handling call
0709 13:00:41.940502 (+  2107us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:00:41.940589 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:00:41.950557 (+  9968us) tablet_metadata.cc:665] Metadata flushed
0709 13:00:42.017863 (+ 67306us) tablet_replica.cc:206] Creating consensus instance
0709 13:00:42.018353 (+   490us) inbound_call.cc:177] Queueing success response
0709 13:00:54.357680 (+12339327us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:00:54.842988 (+485308us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:00:54.947609 (+104621us) tablet_replica.cc:261] Starting instrumentation
0709 13:00:54.949638 (+  2029us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":156933,"raft.queue_time_us":8807,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":19316,"tablet-open.queue_time_us":12339447}
I20260709 13:00:55.429199  2247 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:00:55.434376  2247 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:00:55.412143  1687 rpcz_store.cc:269] 0709 13:00:53.583828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.584792 (+   964us) service_pool.cc:224] Handling call
0709 13:00:54.207223 (+622431us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:00:55.345256 (+1138033us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3e9c 00007fd02b9e3a5b 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:00:55.383470 (+ 38214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15273728}
I20260709 13:00:55.438800  1730 tablet_bootstrap.cc:492] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Bootstrap starting.
I20260709 13:00:55.441198  2247 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:55.441220  2205 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:55.441531  2169 consensus_queue.cc:237] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.396602  1682 rpcz_store.cc:276] 0709 13:00:54.155250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.175942 (+ 20692us) service_pool.cc:224] Handling call
0709 13:00:54.819978 (+644036us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3e9c 00007fd02b9e3a5b 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:00:54.820999 (+  1021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.825358 (+  4359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.825388 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.825855 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.849153 (+ 23298us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:00:54.850205 (+  1052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.860286 (+ 10081us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.363032 (+502746us) raft_consensus.cc:1685] finished
0709 13:00:55.363134 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.379982 (+ 16848us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":569,"raft.queue_time_us":3914,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":77,"spinlock_wait_cycles":4886912,"thread_start_us":21415,"threads_started":1,"wal-append.queue_time_us":28435}
W20260709 13:00:55.450870  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa3a0 after lost signal to thread 1640
W20260709 13:00:55.451272  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa3c0 after lost signal to thread 1641
W20260709 13:00:55.452104  2268 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:00:55.452255  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080029ab00 after lost signal to thread 1714
W20260709 13:00:55.452919  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080029aaa0 after lost signal to thread 1715
I20260709 13:00:55.506538  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:55.432287  1607 rpcz_store.cc:276] 0709 13:00:54.306654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.310586 (+  3932us) service_pool.cc:224] Handling call
0709 13:00:54.438703 (+128117us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:00:54.810232 (+371529us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3e9c 00007fd02b9e3a5b 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:00:55.430993 (+620761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75184768}
I20260709 13:00:55.520546  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 290) took 1213 ms. Trace:
I20260709 13:00:55.521420  1615 rpcz_store.cc:276] 0709 13:00:54.307259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.310328 (+  3069us) service_pool.cc:224] Handling call
0709 13:00:54.434804 (+124476us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3eee 0000000000375939 00007fd033a571e0 00007fd033b200c4 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:00:55.404660 (+969856us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3f8c 00007fd02b9e3ef6 0000000000375939 00007fd033a571e0 00007fd033b200c4 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:00:55.409352 (+  4692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.422112 (+ 12760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.429758 (+  7646us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.435720 (+  5962us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:55.439630 (+  3910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.519742 (+ 80112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.520161 (+   419us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105307904}
I20260709 13:00:55.522845  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 277) took 1344 ms. Trace:
I20260709 13:00:55.542866  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 98) took 4958 ms. Trace:
I20260709 13:00:55.543650  1439 rpcz_store.cc:276] 0709 13:00:50.584358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.584547 (+   189us) service_pool.cc:224] Handling call
0709 13:00:55.542476 (+4957929us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:53.081976 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:53.102045 (+ 20069us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:53.102087 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:00:53.102110 (+    23us) tablet.cc:662] Decoding operations
0709 13:00:53.227158 (+125048us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:53.247769 (+ 20611us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:53.253764 (+  5995us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:00:53.325867 (+ 72103us) tablet.cc:701] Row locks acquired
0709 13:00:53.325892 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:00:53.327269 (+  1377us) write_op.cc:270] Start()
0709 13:00:53.328525 (+  1256us) write_op.cc:276] Timestamp: P: 1783602053327218 usec, L: 0
0709 13:00:53.328554 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:00:53.329336 (+   782us) log.cc:844] Serialized 1316 byte log entry
0709 13:00:53.412167 (+ 82831us) op_driver.cc:464] REPLICATION: finished
0709 13:00:53.468487 (+ 56320us) write_op.cc:301] APPLY: starting
0709 13:00:53.468567 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:53.468724 (+   157us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:53.468950 (+   226us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:53.472428 (+  3478us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:53.472588 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:00:53.472632 (+    44us) write_op.cc:312] APPLY: finished
0709 13:00:53.472849 (+   217us) log.cc:844] Serialized 34 byte log entry
0709 13:00:53.473010 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.473117 (+   107us) write_op.cc:454] Released schema lock
0709 13:00:53.473173 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:53.474176 (+  1003us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:53.474203 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31710,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":56078,"apply.run_cpu_time_us":2064,"apply.run_wall_time_us":5670,"num_ops":3,"prepare.queue_time_us":214606,"prepare.run_cpu_time_us":4685,"prepare.run_wall_time_us":267457,"replication_time_us":83402,"thread_start_us":215367,"threads_started":2}]]}
I20260709 13:00:55.548435  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:00:55.550230  1687 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:55.558244  1731 tablet_bootstrap.cc:492] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Bootstrap starting.
I20260709 13:00:55.570456  2260 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:55.571599  2260 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.575269  2260 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:55.523516  1608 rpcz_store.cc:276] 0709 13:00:54.178548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.179573 (+  1025us) service_pool.cc:224] Handling call
0709 13:00:54.692887 (+513314us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:00:55.520834 (+827947us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3e9c 00007fd02b9e3a5b 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:00:55.521302 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.522004 (+   702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.522055 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:55.522289 (+   234us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:55.522337 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.522426 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.522614 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21601408}
I20260709 13:00:55.578902  2275 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:55.587795  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 311) took 1095 ms. Trace:
I20260709 13:00:55.591969  2205 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:00:55.580580  1609 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:00:55.601418  2258 raft_consensus.cc:2764] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:00:55.605243  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:55.593216  2205 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.610530  2205 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:55.614235  1730 tablet_bootstrap.cc:654] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Neither blocks nor log segments found. Creating new log.
W20260709 13:00:55.624755  1505 leader_election.cc:343] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:00:55.616078  2120 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:55.625445  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:55.627238  2249 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:55.629577  1579 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:38063 timed out after 2.221s (SENT) [suppressed 4 similar messages]
I20260709 13:00:55.611271  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:55.588611  1684 rpcz_store.cc:276] 0709 13:00:54.492635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.492773 (+   138us) service_pool.cc:224] Handling call
0709 13:00:54.493287 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:54.493772 (+   485us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:54.493825 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:54.494592 (+   767us) log.cc:844] Serialized 26 byte log entry
0709 13:00:54.579463 (+ 84871us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02b9fe0ac 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b
0709 13:00:54.630547 (+ 51084us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:00:54.802262 (+171715us) log.cc:844] Serialized 14 byte log entry
0709 13:00:54.813446 (+ 11184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.818156 (+  4710us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:55.582115 (+763959us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18002e9780. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:00:55.587128 (+  5013us) raft_consensus.cc:1685] finished
0709 13:00:55.587164 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:55.587494 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8,"prepare.queue_time_us":187113,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":5780,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":5281,"spinlock_wait_cycles":14203264,"thread_start_us":268592,"threads_started":2,"wal-append.queue_time_us":130648}
I20260709 13:00:55.640911  1687 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
W20260709 13:00:55.675369  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50848.6us
I20260709 13:00:55.677565  2201 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:55.678529  1731 tablet_bootstrap.cc:654] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Neither blocks nor log segments found. Creating new log.
I20260709 13:00:55.680624  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:00:55.672576  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 61169.3us
I20260709 13:00:55.714308  2201 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:55.715391  2201 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.715864  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:55.718698  2201 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:55.721855  2258 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:55.727057  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:55.738207  1540 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:00:55.745067  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:55.769035  1730 tablet_bootstrap.cc:492] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: No bootstrap required, opened a new log
I20260709 13:00:55.769971  1730 ts_tablet_manager.cc:1403] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent bootstrapping tablet: real 0.331s	user 0.018s	sys 0.015s
I20260709 13:00:55.773470  1730 raft_consensus.cc:359] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.775007  1730 raft_consensus.cc:385] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.777338  1730 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.788326  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:55.794238  1730 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.808192  1730 ts_tablet_manager.cc:1434] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.002s
I20260709 13:00:55.813797  1731 tablet_bootstrap.cc:492] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: No bootstrap required, opened a new log
I20260709 13:00:55.814352  1731 ts_tablet_manager.cc:1403] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Time spent bootstrapping tablet: real 0.259s	user 0.020s	sys 0.011s
I20260709 13:00:55.832871  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:55.836804  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 94) took 4959 ms. Trace:
I20260709 13:00:55.824570  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:55.855914  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:55.855360  1438 catalog_manager.cc:5697] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:55.858590  2064 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:00:55.859421  2064 raft_consensus.cc:697] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:00:55.861567  1504 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:55.862636  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:55.865600  2064 consensus_queue.cc:237] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.866030  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:55.867117  1609 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 1: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:00:55.868407  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:55.869140  2264 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:55.877180  2085 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:00:55.872025  1438 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:55.884568  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:55.899421  1504 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:55.903825  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:55.909332  1731 raft_consensus.cc:359] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.910323  1731 raft_consensus.cc:385] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:00:55.910620  1731 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Initialized, Role: FOLLOWER
I20260709 13:00:55.911301  1731 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:55.928387  2212 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:55.930483  1731 ts_tablet_manager.cc:1434] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Time spent starting tablet: real 0.116s	user 0.010s	sys 0.000s
I20260709 13:00:55.932142  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:55.931803  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:55.938630  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:55.837289  1436 rpcz_store.cc:276] 0709 13:00:50.878018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:50.878296 (+   278us) service_pool.cc:224] Handling call
0709 13:00:55.836553 (+4958257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:54.811105 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:54.813669 (+  2564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:54.813704 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:00:54.813721 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:54.814051 (+   330us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:54.814119 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:54.814149 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:00:54.818461 (+  4312us) tablet.cc:701] Row locks acquired
0709 13:00:54.818499 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:00:54.820070 (+  1571us) write_op.cc:270] Start()
0709 13:00:54.823647 (+  3577us) write_op.cc:276] Timestamp: P: 1783602054818602 usec, L: 0
0709 13:00:54.824294 (+   647us) op_driver.cc:348] REPLICATION: starting
0709 13:00:54.884320 (+ 60026us) log.cc:844] Serialized 540 byte log entry
0709 13:00:55.463868 (+579548us) op_driver.cc:464] REPLICATION: finished
0709 13:00:55.789852 (+325984us) write_op.cc:301] APPLY: starting
0709 13:00:55.790057 (+   205us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:55.790217 (+   160us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:55.792680 (+  2463us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:55.793108 (+   428us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:55.793410 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:00:55.793479 (+    69us) write_op.cc:312] APPLY: finished
0709 13:00:55.794917 (+  1438us) log.cc:844] Serialized 22 byte log entry
0709 13:00:55.795250 (+   333us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:55.795391 (+   141us) write_op.cc:454] Released schema lock
0709 13:00:55.795460 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:55.795995 (+   535us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:55.796025 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":483529,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":211631,"apply.run_cpu_time_us":3440,"apply.run_wall_time_us":8787,"num_ops":1,"prepare.queue_time_us":64606,"prepare.run_cpu_time_us":22526,"prepare.run_wall_time_us":504336,"raft.queue_time_us":9029,"raft.run_cpu_time_us":69358,"raft.run_wall_time_us":241161,"replication_time_us":639065,"thread_start_us":593378,"threads_started":4,"wal-append.queue_time_us":477951}]]}
I20260709 13:00:55.963244  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:55.969684  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:00:55.980357  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 84514.5us
I20260709 13:00:55.979756  2201 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:55.991008  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 78853.3us
I20260709 13:00:56.002281  2206 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:56.002990  2206 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:56.003945  2206 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:00:56.031600  2290 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:00:56.040578  1487 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:00:56.047619  2205 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.080229  2205 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.089192  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:56.089856  1579 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:56.091889  2110 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:56.092310  2222 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:56.092919  2222 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:56.088303  2264 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:56.093930  2264 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:56.095503  2222 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:56.097327  2264 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:56.098452  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:56.099529  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:56.100196  2205 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:56.101194  2205 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:00:56.104609  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 82116.4us
I20260709 13:00:56.109944  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:56.110888  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:56.082378  2206 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:56.128356  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:56.126585  2120 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:00:56.129859  2206 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:56.132686  2169 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.136878  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:56.140487  1579 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:56.143672  2120 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:56.183805  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:56.186383  1689 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.182694  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:56.192165  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:00:56.192603  2222 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:56.195880  2275 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:00:56.219003  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 101) took 2331 ms. Trace:
I20260709 13:00:56.222910  2244 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:56.221969  1438 rpcz_store.cc:276] 0709 13:00:53.883726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.883871 (+   145us) service_pool.cc:224] Handling call
0709 13:00:56.215207 (+2331336us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:56.112749 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:56.116535 (+  3786us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:56.116596 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:00:56.116628 (+    32us) tablet.cc:662] Decoding operations
0709 13:00:56.125630 (+  9002us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:56.125748 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:56.125776 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:00:56.137040 (+ 11264us) tablet.cc:701] Row locks acquired
0709 13:00:56.137080 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:00:56.137258 (+   178us) write_op.cc:270] Start()
0709 13:00:56.137420 (+   162us) write_op.cc:276] Timestamp: P: 1783602056137199 usec, L: 0
0709 13:00:56.137554 (+   134us) op_driver.cc:348] REPLICATION: starting
0709 13:00:56.138317 (+   763us) log.cc:844] Serialized 928 byte log entry
0709 13:00:56.153759 (+ 15442us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b540010eb20. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea72090 00007fd02ea7f6b8 00007fd02ea7f2fa 00007fd02eb03965 00007fd02eb03e09 00007fd03253e581 00007fd03253dd58 00007fd0325429f1 00007fd0325429a9 00007fd032542939 00007fd032542901
0709 13:00:56.154081 (+   322us) op_driver.cc:464] REPLICATION: finished
0709 13:00:56.156979 (+  2898us) write_op.cc:301] APPLY: starting
0709 13:00:56.157045 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:56.157158 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:56.157178 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:56.157479 (+   301us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:56.157629 (+   150us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:00:56.157669 (+    40us) write_op.cc:312] APPLY: finished
0709 13:00:56.157856 (+   187us) log.cc:844] Serialized 28 byte log entry
0709 13:00:56.158014 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:56.158100 (+    86us) write_op.cc:454] Released schema lock
0709 13:00:56.158135 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:56.193697 (+ 35562us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:56.195408 (+  1711us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40420,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":2698,"apply.run_cpu_time_us":1404,"apply.run_wall_time_us":1404,"num_ops":2,"prepare.queue_time_us":103978,"prepare.run_cpu_time_us":6445,"prepare.run_wall_time_us":56901,"replication_time_us":16379,"spinlock_wait_cycles":22131968,"thread_start_us":42380,"threads_started":1}]]}
I20260709 13:00:56.223678  2244 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:56.238766  2244 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:56.255518  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:56.258350  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:56.286733  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:56.289036  2274 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:00:56.287654  1436 catalog_manager.cc:5697] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:00:56.298672  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 103806us
I20260709 13:00:56.323055  1612 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:00:56.326629  1436 catalog_manager.cc:5697] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:56.329341  1436 catalog_manager.cc:5697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:56.331955  1436 catalog_manager.cc:5697] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:56.355511  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:56.385231  1579 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:00:56.349189  1436 catalog_manager.cc:5697] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.397716  2209 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:00:56.385545  2309 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:00:56.407472  1436 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:56.409456  2305 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.415316  2180 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.416967  1436 catalog_manager.cc:5697] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:56.430424  2274 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:00:56.505409  1438 catalog_manager.cc:5697] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:56.508540  1438 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:00:56.527933  1439 catalog_manager.cc:5697] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 0 to 1, leader changed from <none> to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:56.713873  1685 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:00:56.715471  2273 consensus_queue.cc:1059] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:56.716655  2273 raft_consensus.cc:3055] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:00:56.717021  2273 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:00:56.720209  2273 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:56.736980  2273 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:57.728458   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:00:57.748247  2313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.760157  2110 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.760876  2110 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:57.764864  2110 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:57.766178  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:57.767134  1612 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:00:57.768437  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:57.769294  2110 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:00:57.769714  2110 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.770457  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:00:57.771723  2110 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:57.786684  2314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.799167  2110 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:57.800494  2180 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:57.801172  2180 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:57.808286  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:00:57.808401  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:00:57.809161  1612 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:00:57.810289  2180 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:57.811120  1505 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:00:57.812223  1685 raft_consensus.cc:2368] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:00:57.812407  2180 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:00:57.812865  2180 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:00:57.813293  2180 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:00:57.813930   431 server_base.cc:1061] running on GCE node
I20260709 13:00:57.816193  1504 leader_election.cc:400] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:00:57.819979  2110 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:00:57.821614  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:00:57.822728  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:57.823819  1612 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:00:57.823993  2180 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:57.825297  1534 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:00:57.833531  2316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:00:57.836550  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:00:57.839603   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:00:57.840382  2180 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:57.842048  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:00:57.840086   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:00:57.842861  1685 raft_consensus.cc:2368] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:00:57.846750  1504 leader_election.cc:400] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:00:57.847078  1504 leader_election.cc:403] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:00:57.849521  1534 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:00:57.850188  2085 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:00:57.862274  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:00:57.863201  2110 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:00:57.863852  2110 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:00:57.864941  2110 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:00:57.842814   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602057842784 us; error 0 us; skew 500 ppm
I20260709 13:00:57.876371   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:00:57.881997  1612 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:00:57.927424  1438 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:57.989512   431 webserver.cc:533] Webserver started at http://127.0.107.196:41149/ using document root <none> and password file <none>
I20260709 13:00:58.010325   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:00:58.015424   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:00:58.016009   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:00:58.020673   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-3-root/instance:
uuid: "9d926c10b90f452ba52d80dab6a50351"
format_stamp: "Formatted at 2026-07-09 13:00:58 on dist-test-slave-smzk"
I20260709 13:00:58.029392   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:00:58.047271  2327 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:58.048584   431 fs_manager.cc:730] Time spent opening block manager: real 0.016s	user 0.006s	sys 0.009s
I20260709 13:00:58.048952   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-3-root
uuid: "9d926c10b90f452ba52d80dab6a50351"
format_stamp: "Formatted at 2026-07-09 13:00:58 on dist-test-slave-smzk"
I20260709 13:00:58.051532   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:00:58.114810   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:00:58.117291   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:00:58.127621   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:00:58.147253   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:00:58.147598   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:00:58.147965   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:00:58.148247   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:00:58.354718  1615 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:58.357020  2305 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:58.385243  1534 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:00:58.391572  2305 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:58.882720   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:38365
I20260709 13:00:58.882810  2395 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:38365 every 8 connection(s)
I20260709 13:00:58.915763   431 auto_leader_rebalancer-test.cc:384] add a tserver: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:00:58.946811  2396 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33773
I20260709 13:00:58.949220  2396 heartbeater.cc:461] Registering TS with master...
I20260709 13:00:58.951611  2396 heartbeater.cc:507] Master 127.0.107.254:33773 requested a full tablet report, sending...
I20260709 13:00:58.954371  1438 ts_manager.cc:194] Registered new tserver with Master: 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:00:58.956660  1438 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55714
I20260709 13:00:59.474222  1685 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:00:59.492830  1612 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:59.494238  2110 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.494439  1534 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:59.500600  2110 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:00:59.527572  1653 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7137e5b424304fc6a6513886dd9dc135. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:59.537894  2322 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:00:59.555867  1612 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:00:59.577126  1538 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:00:59.620085  1438 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:00:59.682922  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 86087.8us
W20260709 13:00:59.684142  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 84425.1us
W20260709 13:00:59.740237  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 89602.8us
I20260709 13:00:59.816845  1608 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:00:59.842769  1539 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:59.844552  2273 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:00:59.847218  1686 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:00:59.852131  2417 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:00:59.873277  2273 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:00:59.889119  1579 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8967fd754a1f427d8138f7d6380b06c0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:00:59.903896  1689 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:00:59.904594  1436 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:59.913498  1534 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:00:59.902848  1686 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:00:59.954809  2428 ts_tablet_manager.cc:933] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:00:59.960718  2396 heartbeater.cc:499] Master 127.0.107.254:33773 was elected leader, sending a full tablet report...
W20260709 13:01:00.002168  1653 consensus_peers.cc:597] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c93bc5462474ec6bb7155abd2e93aac. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:00.007903  2428 tablet_copy_client.cc:323] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:00.010986  1608 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:00.016963  1534 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:00.023574  2409 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:00.030045  2409 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:00.054447  2409 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:00.068563  1539 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:00.107336  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet 7137e5b424304fc6a6513886dd9dc135 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:00.108915  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet 7137e5b424304fc6a6513886dd9dc135 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-7137e5b424304fc6a6513886dd9dc135
I20260709 13:01:00.118923  1686 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:00.137537  1436 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:00.154557  1700 tablet_copy_source_session.cc:215] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:00.154446  1608 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:00.161005  2428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7137e5b424304fc6a6513886dd9dc135. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:00.173605  1615 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:00.176718  1539 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:00.184270  2423 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:00.185310  2410 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:00.190106  1653 consensus_peers.cc:597] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 336b1cd3c29f40b094a733c275aecd2d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:00.209196  2428 tablet_copy_client.cc:806] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:00.212726  2428 tablet_copy_client.cc:670] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:00.213857  2409 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:00.221276  2428 tablet_copy_client.cc:538] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:00.225540  1608 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:00.227979  1539 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:00.234424  2428 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:00.262497  1437 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:00.362361  2438 ts_tablet_manager.cc:933] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:00.404647  2428 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:00.405880  2428 tablet_bootstrap.cc:492] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:00.410437  2428 ts_tablet_manager.cc:1403] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.176s	user 0.039s	sys 0.021s
I20260709 13:01:00.423759  2438 tablet_copy_client.cc:323] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:01:00.441519  2428 raft_consensus.cc:359] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:00.445212  2428 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:00.445657  2441 ts_tablet_manager.cc:933] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:00.446295  2428 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:00.483299  2441 tablet_copy_client.cc:323] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:00.487043  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet 7c93bc5462474ec6bb7155abd2e93aac from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:00.487720  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet 7c93bc5462474ec6bb7155abd2e93aac from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-7c93bc5462474ec6bb7155abd2e93aac
I20260709 13:01:00.491163  1626 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet 8967fd754a1f427d8138f7d6380b06c0 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:01:00.491855  1626 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet 8967fd754a1f427d8138f7d6380b06c0 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-8967fd754a1f427d8138f7d6380b06c0
I20260709 13:01:00.498982  1700 tablet_copy_source_session.cc:215] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:00.499923  2428 ts_tablet_manager.cc:1434] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.011s
I20260709 13:01:00.503137  1626 tablet_copy_source_session.cc:215] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:00.503046  1699 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-7137e5b424304fc6a6513886dd9dc135 received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:00.508872  1699 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-7137e5b424304fc6a6513886dd9dc135 on tablet 7137e5b424304fc6a6513886dd9dc135 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:00.515061  2371 raft_consensus.cc:1217] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:00.512782  2441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c93bc5462474ec6bb7155abd2e93aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:00.539016  2438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8967fd754a1f427d8138f7d6380b06c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:00.553229  2428 ts_tablet_manager.cc:933] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:00.570739  2428 tablet_copy_client.cc:323] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:00.572595  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet 336b1cd3c29f40b094a733c275aecd2d from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:00.573207  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet 336b1cd3c29f40b094a733c275aecd2d from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-336b1cd3c29f40b094a733c275aecd2d
I20260709 13:01:00.580459  2438 tablet_copy_client.cc:806] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:00.581260  2438 tablet_copy_client.cc:670] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:00.583081  1700 tablet_copy_source_session.cc:215] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:00.588131  2438 tablet_copy_client.cc:538] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:00.588995  2428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 336b1cd3c29f40b094a733c275aecd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:00.609333  2441 tablet_copy_client.cc:806] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:00.610191  2441 tablet_copy_client.cc:670] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:00.609598  2438 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:00.629690  2428 tablet_copy_client.cc:806] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:00.632977  2428 tablet_copy_client.cc:670] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:00.643719  2428 tablet_copy_client.cc:538] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:00.682024  2441 tablet_copy_client.cc:538] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:00.704828  2428 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:00.763240  2441 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:00.770870  2438 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:00.777410  2438 tablet_bootstrap.cc:492] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:00.778185  2438 ts_tablet_manager.cc:1403] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.169s	user 0.024s	sys 0.005s
I20260709 13:01:00.794509  2438 raft_consensus.cc:359] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:00.795590  2438 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:00.816407  2438 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:00.827634  2438 ts_tablet_manager.cc:1434] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.005s
I20260709 13:01:00.831179  1626 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-8967fd754a1f427d8138f7d6380b06c0 received from {username='slave'} at 127.0.0.1:57944
I20260709 13:01:00.831682  1626 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-8967fd754a1f427d8138f7d6380b06c0 on tablet 8967fd754a1f427d8138f7d6380b06c0 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:00.854453  2428 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:00.855615  2428 tablet_bootstrap.cc:492] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:00.856402  2428 ts_tablet_manager.cc:1403] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.169s	user 0.020s	sys 0.009s
I20260709 13:01:00.859927  2428 raft_consensus.cc:359] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:00.874687  2428 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:00.875487  2428 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:00.879376  2371 raft_consensus.cc:1217] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:00.888981  2428 ts_tablet_manager.cc:1434] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 13:01:00.891597  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-336b1cd3c29f40b094a733c275aecd2d received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:00.892074  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-336b1cd3c29f40b094a733c275aecd2d on tablet 336b1cd3c29f40b094a733c275aecd2d with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:00.902350  2409 raft_consensus.cc:1064] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:00.906376  2409 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:00.953962  2371 raft_consensus.cc:1217] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:00.976967  2371 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:00.985395  2409 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:01.016731  2441 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:01.019286  1608 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.020331  1539 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.021451  2322 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.024468  2410 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.035295  2441 tablet_bootstrap.cc:492] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:01.037690  2441 ts_tablet_manager.cc:1403] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.275s	user 0.054s	sys 0.037s
I20260709 13:01:01.044445  2441 raft_consensus.cc:359] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:01.045480  2441 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:01.046252  2441 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:01.051703  2441 ts_tablet_manager.cc:1434] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.005s
I20260709 13:01:01.053093  2452 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.055080  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-7c93bc5462474ec6bb7155abd2e93aac received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:01.055559  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-7c93bc5462474ec6bb7155abd2e93aac on tablet 7c93bc5462474ec6bb7155abd2e93aac with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:01.062891  1608 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.083243  1539 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.088666  2371 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.109704  1436 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:01.135591  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48690us
I20260709 13:01:01.173544  2371 raft_consensus.cc:1217] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:01.201713  1686 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:01.348296  2371 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:01.369903  2456 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:01.396124  1538 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:01.397874  2452 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.420012  2371 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.467484  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7137e5b424304fc6a6513886dd9dc135 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:01.476379  2410 raft_consensus.cc:1064] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:01.479487  2410 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:01.486673  1438 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:01.488565  2409 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:01.527134  1612 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.533970  2371 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.539749  2452 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.541929  2410 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:01.548740  1539 raft_consensus.cc:2955] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.536300  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet 7137e5b424304fc6a6513886dd9dc135 with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57540
W20260709 13:01:01.552171  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 54820.8us
I20260709 13:01:01.534233  2273 raft_consensus.cc:1064] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:01.556252  2273 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:01.579460  1538 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.605343  2467 tablet_replica.cc:333] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:01:01.610354  2409 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.623525  2467 raft_consensus.cc:2243] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:01.624891  2467 raft_consensus.cc:2272] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:01.623191  2371 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.641197  2423 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.660652  2467 ts_tablet_manager.cc:1916] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:01.686110  2370 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.689953  2460 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.700379  1538 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.720805  2452 raft_consensus.cc:1064] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:01.718786  1539 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.756467  2414 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:01:01.772529  1688 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.776964  2452 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:01.781628  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52150.1us
I20260709 13:01:01.782948  1438 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.842793  2467 ts_tablet_manager.cc:1929] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:01.843500  2467 log.cc:1199] T 7137e5b424304fc6a6513886dd9dc135 P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/7137e5b424304fc6a6513886dd9dc135
I20260709 13:01:01.846879  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet 7137e5b424304fc6a6513886dd9dc135 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:01.847913  1615 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:01.867504  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 71466.2us
I20260709 13:01:01.868451  1539 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.874936  1612 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.918958  2423 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.923113  2370 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:01.926860  1688 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:01.929114  2473 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.930547  2409 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.941787  2370 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:01.953548  2470 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:01.955191  1607 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:01.954952  2414 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:01.946456  1534 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.942835  2479 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.972159  2470 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:01.973834  2371 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.016934  1685 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.011416  2473 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:01:02.037092  1439 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.043816  1612 raft_consensus.cc:2955] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.015198  2369 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.086814  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 336b1cd3c29f40b094a733c275aecd2d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:02.096190  1608 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:02.103181  1436 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.120779  2371 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:02.125982  2470 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.133893  2479 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:02.138350  2370 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.141242  1534 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.162890  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 336b1cd3c29f40b094a733c275aecd2d with delete_type TABLET_DATA_TOMBSTONED (TS c98c328741aa493d87abafbf08f04944 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37894
I20260709 13:01:02.183527  2273 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.189707  2484 tablet_replica.cc:333] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:01:02.196508  1435 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.189234  1608 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.205837  1532 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:02.209095  2369 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.214582  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8967fd754a1f427d8138f7d6380b06c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:02.232348  2273 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:02.246845  1532 raft_consensus.cc:2955] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.254386  2484 raft_consensus.cc:2243] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.255398  2484 raft_consensus.cc:2272] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.266870  2484 ts_tablet_manager.cc:1916] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:02.304172  2484 ts_tablet_manager.cc:1929] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:02.304766  2484 log.cc:1199] T 336b1cd3c29f40b094a733c275aecd2d P c98c328741aa493d87abafbf08f04944: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/wals/336b1cd3c29f40b094a733c275aecd2d
I20260709 13:01:02.307504  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet 336b1cd3c29f40b094a733c275aecd2d (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:02.354352  1681 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:02.331648  1439 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.364153  2369 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:02.365866  1608 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:02.368023  2470 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:02.373173  2410 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:02.382805  2409 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.386443  2369 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.390690  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 8967fd754a1f427d8138f7d6380b06c0 with delete_type TABLET_DATA_TOMBSTONED (TS f6eecf73c1c24b5eb268b5088a3030d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48350
I20260709 13:01:02.433688  1612 raft_consensus.cc:2955] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.442693  2485 tablet_replica.cc:333] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:01:02.447889  1437 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:02.462673  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c93bc5462474ec6bb7155abd2e93aac with delete_type TABLET_DATA_TOMBSTONED (TS c98c328741aa493d87abafbf08f04944 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37894
I20260709 13:01:02.464579  2484 tablet_replica.cc:333] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:01:02.465706  2484 raft_consensus.cc:2243] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.466463  2484 raft_consensus.cc:2272] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.471837  2484 ts_tablet_manager.cc:1916] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:02.472934  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c93bc5462474ec6bb7155abd2e93aac with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:02.484400  2485 raft_consensus.cc:2243] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:02.485348  2485 raft_consensus.cc:2272] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:02.491937  2485 ts_tablet_manager.cc:1916] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:02.504977  2484 ts_tablet_manager.cc:1929] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:02.517403  2484 log.cc:1199] T 7c93bc5462474ec6bb7155abd2e93aac P c98c328741aa493d87abafbf08f04944: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/wals/7c93bc5462474ec6bb7155abd2e93aac
I20260709 13:01:02.520354  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet 7c93bc5462474ec6bb7155abd2e93aac (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:02.550191  2485 ts_tablet_manager.cc:1929] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:02.550698  2485 log.cc:1199] T 8967fd754a1f427d8138f7d6380b06c0 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/wals/8967fd754a1f427d8138f7d6380b06c0
I20260709 13:01:02.566460  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 8967fd754a1f427d8138f7d6380b06c0 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
W20260709 13:01:03.607883  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 77742.1us
I20260709 13:01:03.632117  1681 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:01:03.651757  1653 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4fad2168ccb42729f2409fbb0a88116. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:03.660239  1532 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:03.662398  2470 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:03.672650  1608 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:03.675573  2423 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:03.709893  2423 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:03.717509  1615 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:03.745563  1608 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:03.774081  1439 catalog_manager.cc:5697] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.787546  1681 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:01:03.787643  1579 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c75c8e4f95149fba99bb9728c2f21d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:03.793545  1532 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:03.796581  1540 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:03.794308  2488 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:03.798672  2490 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:03.838124  2487 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:03.839408  1681 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:03.842262  1540 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:03.898079  2495 consensus_queue.cc:1175] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c98c328741aa493d87abafbf08f04944" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:01:03.900574  1686 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:01:03.939968  1653 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d48f4ba9b7ac4684ba28c86536416e65. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:03.935812  1435 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:03.940876  1534 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:03.942826  1608 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:03.948501  2470 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:03.949651  2423 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:04.015416  2495 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:04.021909  1540 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:04.046057  1435 catalog_manager.cc:5697] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:04.061179  1608 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:04.067152  2507 ts_tablet_manager.cc:933] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:04.153316  2507 tablet_copy_client.cc:323] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:04.156270  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet d4fad2168ccb42729f2409fbb0a88116 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:04.156865  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet d4fad2168ccb42729f2409fbb0a88116 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-d4fad2168ccb42729f2409fbb0a88116
I20260709 13:01:04.171378  1700 tablet_copy_source_session.cc:215] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:04.167261  1534 consensus_queue.cc:237] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:04.175205  2507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4fad2168ccb42729f2409fbb0a88116. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:04.185998  1608 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:04.188218  2447 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:04.190843  1681 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:04.194264  2489 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:04.228163  2507 tablet_copy_client.cc:806] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:04.228991  2507 tablet_copy_client.cc:670] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:04.234671  2507 tablet_copy_client.cc:538] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:04.236502  2447 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:04.241196  1688 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:04.250087  2507 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:04.268746  1439 catalog_manager.cc:5697] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:04.300134  1608 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:04.317041  1504 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fd446bc21be451c86d30ee76d6e6137. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:04.321549  2507 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:04.331543  2507 tablet_bootstrap.cc:492] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:04.354204  2507 ts_tablet_manager.cc:1403] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.006s
I20260709 13:01:04.358631  2507 raft_consensus.cc:359] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:04.359582  2507 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:04.360351  2507 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:04.395565  2518 ts_tablet_manager.cc:933] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:04.407056  2507 ts_tablet_manager.cc:1434] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.028s
I20260709 13:01:04.420321  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-d4fad2168ccb42729f2409fbb0a88116 received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:04.420806  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-d4fad2168ccb42729f2409fbb0a88116 on tablet d4fad2168ccb42729f2409fbb0a88116 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:04.419426  2518 tablet_copy_client.cc:323] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:01:04.424566  1626 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet 5c75c8e4f95149fba99bb9728c2f21d8 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:01:04.425278  1626 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet 5c75c8e4f95149fba99bb9728c2f21d8 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-5c75c8e4f95149fba99bb9728c2f21d8
I20260709 13:01:04.435839  1626 tablet_copy_source_session.cc:215] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:04.444083  2518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c75c8e4f95149fba99bb9728c2f21d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:04.484146  2518 tablet_copy_client.cc:806] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:04.484943  2518 tablet_copy_client.cc:670] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:04.490882  2518 tablet_copy_client.cc:538] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:04.496971  2507 ts_tablet_manager.cc:933] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:04.504927  2507 tablet_copy_client.cc:323] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:04.506824  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet d48f4ba9b7ac4684ba28c86536416e65 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:04.507494  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet d48f4ba9b7ac4684ba28c86536416e65 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-d48f4ba9b7ac4684ba28c86536416e65
I20260709 13:01:04.515694  1700 tablet_copy_source_session.cc:215] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:04.520915  2507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d48f4ba9b7ac4684ba28c86536416e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:04.531457  2518 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:04.572196  2507 tablet_copy_client.cc:806] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:04.572986  2507 tablet_copy_client.cc:670] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:04.582209  2507 tablet_copy_client.cc:538] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:04.604357  2507 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:04.609671  2369 raft_consensus.cc:1217] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:04.668399  2518 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:04.669660  2518 tablet_bootstrap.cc:492] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:04.670629  2518 ts_tablet_manager.cc:1403] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.139s	user 0.032s	sys 0.013s
I20260709 13:01:04.674870  2518 raft_consensus.cc:359] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:04.679201  2507 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:04.687757  2507 tablet_bootstrap.cc:492] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:04.688803  2507 ts_tablet_manager.cc:1403] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.008s
I20260709 13:01:04.691504  2518 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:04.692397  2507 raft_consensus.cc:359] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:04.692477  2518 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:04.693696  2507 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:04.696008  2518 ts_tablet_manager.cc:1434] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:01:04.696935  2507 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:04.701054  2507 ts_tablet_manager.cc:1434] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:01:04.710634  2524 ts_tablet_manager.cc:933] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:04.710757  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-d48f4ba9b7ac4684ba28c86536416e65 received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:04.711331  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-d48f4ba9b7ac4684ba28c86536416e65 on tablet d48f4ba9b7ac4684ba28c86536416e65 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:04.702268  1626 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-5c75c8e4f95149fba99bb9728c2f21d8 received from {username='slave'} at 127.0.0.1:57944
I20260709 13:01:04.713498  1626 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-5c75c8e4f95149fba99bb9728c2f21d8 on tablet 5c75c8e4f95149fba99bb9728c2f21d8 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:04.742758  2524 tablet_copy_client.cc:323] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:35051
I20260709 13:01:04.808385  1551 tablet_copy_service.cc:140] P c98c328741aa493d87abafbf08f04944: Received BeginTabletCopySession request for tablet 4fd446bc21be451c86d30ee76d6e6137 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:34908)
I20260709 13:01:04.809756  1551 tablet_copy_service.cc:161] P c98c328741aa493d87abafbf08f04944: Beginning new tablet copy session on tablet 4fd446bc21be451c86d30ee76d6e6137 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:34908: session id = 9d926c10b90f452ba52d80dab6a50351-4fd446bc21be451c86d30ee76d6e6137
I20260709 13:01:04.832094  2369 raft_consensus.cc:1217] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:04.860929  1551 tablet_copy_source_session.cc:215] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:04.883641  2524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fd446bc21be451c86d30ee76d6e6137. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:04.919947  2524 tablet_copy_client.cc:806] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:04.921085  2524 tablet_copy_client.cc:670] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:04.951128  2369 raft_consensus.cc:1217] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:04.977814  2524 tablet_copy_client.cc:538] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:04.991693  2524 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:05.057456  2524 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:05.058405  2524 tablet_bootstrap.cc:492] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:05.064370  2524 ts_tablet_manager.cc:1403] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.007s
I20260709 13:01:05.076743  2524 raft_consensus.cc:359] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:05.077737  2524 raft_consensus.cc:740] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:05.078701  2524 consensus_queue.cc:260] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:05.081851  2524 ts_tablet_manager.cc:1434] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:01:05.090193  1551 tablet_copy_service.cc:342] P c98c328741aa493d87abafbf08f04944: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-4fd446bc21be451c86d30ee76d6e6137 received from {username='slave'} at 127.0.0.1:34908
I20260709 13:01:05.090704  1551 tablet_copy_service.cc:434] P c98c328741aa493d87abafbf08f04944: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-4fd446bc21be451c86d30ee76d6e6137 on tablet 4fd446bc21be451c86d30ee76d6e6137 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:05.164453  2369 raft_consensus.cc:1217] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:05.225535  2495 raft_consensus.cc:1064] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:05.230360  2495 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:05.243666  2488 raft_consensus.cc:1064] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:05.246196  2488 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:05.263303  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 59671.5us
I20260709 13:01:05.268726  1681 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.272327  2369 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.290397  2531 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:05.292938  2490 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:05.308578  1532 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.329123  2370 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.332670  2522 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:05.386716  1612 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.390537  2531 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:05.431138  2488 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:05.438048  2369 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:05.453752  2522 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:05.456190  1688 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:05.460433  1534 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.541724  1435 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:05.566069  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 73126.3us
I20260709 13:01:05.669585  2470 raft_consensus.cc:1064] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
W20260709 13:01:05.686756  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 84914.2us
I20260709 13:01:05.702339  2470 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:05.735389  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 64737.7us
W20260709 13:01:05.741420  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 84853.8us
W20260709 13:01:05.752779  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 97900.4us
W20260709 13:01:05.786154  2551 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:01:05.789459  2539 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:05.805887  2489 raft_consensus.cc:1064] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
W20260709 13:01:05.813302  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 47903.7us
I20260709 13:01:05.822853  2489 consensus_queue.cc:237] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:05.839571  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 100065us
I20260709 13:01:05.892791  2522 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:05.915736  1615 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.916144  1534 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.939888  2369 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:05.969925  1609 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:05.972719  2555 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:01:06.004528  2371 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:06.017937  1688 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:06.052137  2505 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:06.069805  1609 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:06.074656  1541 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.091984  1609 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:06.107848  2489 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:06.116606  1437 catalog_manager.cc:5697] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.125926  2371 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:06.128003  2544 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:06.129592  2555 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:01:06.135128  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 46207.6us
I20260709 13:01:06.137074  2489 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:06.158058  2531 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.167374  2369 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.177840  2370 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.186177  1685 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:06.220178  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 81446.2us
I20260709 13:01:06.228650  1536 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:06.236869  2515 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:06.241381  2544 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:06.244210  1541 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.329928  1540 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:06.339829  2539 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:06.304137  1536 raft_consensus.cc:2955] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.389622  2542 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.399966  2371 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.462718  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c75c8e4f95149fba99bb9728c2f21d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:06.474402  1435 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.489236  2367 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:06.499775  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c75c8e4f95149fba99bb9728c2f21d8 with delete_type TABLET_DATA_TOMBSTONED (TS f6eecf73c1c24b5eb268b5088a3030d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48350
I20260709 13:01:06.500133  2505 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:06.499879  1609 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.513780  1614 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.477383  2489 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.524183  2539 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.564831  2571 tablet_replica.cc:333] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:01:06.591053  2571 raft_consensus.cc:2243] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.574069  1681 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.603061  2370 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:06.630576  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 73165.8us
I20260709 13:01:06.640305  1540 raft_consensus.cc:2955] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.654239  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d4fad2168ccb42729f2409fbb0a88116 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:06.640727  1532 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.666657  2571 raft_consensus.cc:2272] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.674851  2371 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.697865  2571 ts_tablet_manager.cc:1916] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:06.715988  1437 catalog_manager.cc:5697] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.741861  1436 catalog_manager.cc:5697] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.743597  1436 catalog_manager.cc:5697] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.776433  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet d4fad2168ccb42729f2409fbb0a88116 with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57540
I20260709 13:01:06.783269  2571 ts_tablet_manager.cc:1929] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:06.795223  2571 log.cc:1199] T 5c75c8e4f95149fba99bb9728c2f21d8 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/wals/5c75c8e4f95149fba99bb9728c2f21d8
I20260709 13:01:06.795974  1540 consensus_queue.cc:237] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:06.798138  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 5c75c8e4f95149fba99bb9728c2f21d8 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:06.819769  1688 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:06.832314  2371 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:06.835367  1614 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:06.841388  2554 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:06.851311  2575 tablet_replica.cc:333] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:01:06.854290  2447 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:06.863797  2371 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:06.863106  1536 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:06.865731  2572 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:06.869539  2371 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.866490  2447 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.874774  2522 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:06.881237  2555 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.883739  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fd446bc21be451c86d30ee76d6e6137 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:06.894098  2370 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.898728  1608 raft_consensus.cc:2955] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.909144  1540 raft_consensus.cc:2955] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:06.911949  1436 catalog_manager.cc:5697] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.917378  2575 raft_consensus.cc:2243] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.945701  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d48f4ba9b7ac4684ba28c86536416e65 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:06.969177  2575 raft_consensus.cc:2272] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:06.968436  1437 catalog_manager.cc:5697] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:06.974443  2575 ts_tablet_manager.cc:1916] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:06.990942  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fd446bc21be451c86d30ee76d6e6137 with delete_type TABLET_DATA_TOMBSTONED (TS f6eecf73c1c24b5eb268b5088a3030d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48350
I20260709 13:01:06.994681  2571 tablet_replica.cc:333] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:01:06.996150  2571 raft_consensus.cc:2243] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:06.997243  2571 raft_consensus.cc:2272] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.011281  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet d48f4ba9b7ac4684ba28c86536416e65 with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57540
I20260709 13:01:07.021657  2575 ts_tablet_manager.cc:1929] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:07.022284  2575 log.cc:1199] T d4fad2168ccb42729f2409fbb0a88116 P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/d4fad2168ccb42729f2409fbb0a88116
I20260709 13:01:07.027930  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet d4fad2168ccb42729f2409fbb0a88116 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:07.032420  2571 ts_tablet_manager.cc:1916] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:07.047206  2575 tablet_replica.cc:333] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:01:07.048347  2575 raft_consensus.cc:2243] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:07.049636  2575 raft_consensus.cc:2272] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:07.055461  2575 ts_tablet_manager.cc:1916] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:07.086745  2571 ts_tablet_manager.cc:1929] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:07.098228  2571 log.cc:1199] T 4fd446bc21be451c86d30ee76d6e6137 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/wals/4fd446bc21be451c86d30ee76d6e6137
I20260709 13:01:07.100427  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 4fd446bc21be451c86d30ee76d6e6137 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:07.113281  2575 ts_tablet_manager.cc:1929] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:07.113833  2575 log.cc:1199] T d48f4ba9b7ac4684ba28c86536416e65 P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/d48f4ba9b7ac4684ba28c86536416e65
I20260709 13:01:07.115506  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet d48f4ba9b7ac4684ba28c86536416e65 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:08.178443  1614 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:08.203276  1681 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:08.204326  1540 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:08.205425  2577 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.207659  2577 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:08.212956  1579 consensus_peers.cc:597] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71514c8580924feb8600dfd3daef60d8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:08.230278  2577 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.233933  1540 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.259270  1436 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.270498  1685 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.295285  1614 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:01:08.324882  1579 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72c7a933e3e84bcfb3f8de277043f0ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:08.332366  1532 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:08.344686  2553 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.356065  1681 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:08.357872  2553 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.394778  2577 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.399672  1540 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.437193  1435 catalog_manager.cc:5697] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.468480  1682 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:08.504963  1608 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:08.509531  2505 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.513485  1532 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:08.515936  2578 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:08.530932  1653 consensus_peers.cc:597] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16ec23ffe82f42bfad9cca928a92d9ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:08.532779  2505 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.536685  1532 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.539774  1608 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.532058  1682 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.557024  1540 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:08.578233  1435 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:08.581658  1504 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f38d50e761f346b8b9b49b532d70e057. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:08.586880  1608 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:08.589166  1685 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:08.590224  2563 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:08.592067  2557 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:08.610853  2587 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.613293  1690 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.614979  1614 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.652662  1435 catalog_manager.cc:5697] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:08.707914  2600 ts_tablet_manager.cc:933] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:08.769217  2602 ts_tablet_manager.cc:933] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:08.733083  2600 tablet_copy_client.cc:323] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:01:08.775255  1626 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet 71514c8580924feb8600dfd3daef60d8 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:01:08.775976  1626 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet 71514c8580924feb8600dfd3daef60d8 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-71514c8580924feb8600dfd3daef60d8
I20260709 13:01:08.783780  2602 tablet_copy_client.cc:323] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:01:08.824877  1625 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet 72c7a933e3e84bcfb3f8de277043f0ab from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:01:08.825636  1625 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet 72c7a933e3e84bcfb3f8de277043f0ab from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-72c7a933e3e84bcfb3f8de277043f0ab
I20260709 13:01:08.844059  1625 tablet_copy_source_session.cc:215] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:08.847857  2602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c7a933e3e84bcfb3f8de277043f0ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.860599  1626 tablet_copy_source_session.cc:215] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:08.866017  2600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71514c8580924feb8600dfd3daef60d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.916587  2602 tablet_copy_client.cc:806] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:08.917223  2602 tablet_copy_client.cc:670] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:08.918237  2600 tablet_copy_client.cc:806] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:08.918567  2605 ts_tablet_manager.cc:933] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:08.925239  2602 tablet_copy_client.cc:538] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:08.930617  2605 tablet_copy_client.cc:323] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:08.931651  2600 tablet_copy_client.cc:670] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:08.934113  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet 16ec23ffe82f42bfad9cca928a92d9ab from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:08.934754  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet 16ec23ffe82f42bfad9cca928a92d9ab from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-16ec23ffe82f42bfad9cca928a92d9ab
I20260709 13:01:08.944166  2600 tablet_copy_client.cc:538] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:08.950692  2602 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:08.952384  1700 tablet_copy_source_session.cc:215] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:08.961038  2605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ec23ffe82f42bfad9cca928a92d9ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:08.967355  2600 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:08.998420  2600 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.000169  2600 tablet_bootstrap.cc:492] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:09.001559  2600 ts_tablet_manager.cc:1403] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.034s	user 0.026s	sys 0.003s
I20260709 13:01:08.995383  2605 tablet_copy_client.cc:806] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:09.007747  2605 tablet_copy_client.cc:670] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:09.007418  2600 raft_consensus.cc:359] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:09.009815  2600 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:09.007455  2602 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.015151  2602 tablet_bootstrap.cc:492] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:09.015731  2605 tablet_copy_client.cc:538] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:09.015959  2602 ts_tablet_manager.cc:1403] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.004s
I20260709 13:01:09.020337  2602 raft_consensus.cc:359] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:09.010671  2600 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:09.022714  2602 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:09.034686  2600 ts_tablet_manager.cc:1434] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.033s	user 0.015s	sys 0.000s
I20260709 13:01:09.034266  2602 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:09.041993  1625 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-71514c8580924feb8600dfd3daef60d8 received from {username='slave'} at 127.0.0.1:57944
I20260709 13:01:09.037911  2605 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:09.042912  1625 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-71514c8580924feb8600dfd3daef60d8 on tablet 71514c8580924feb8600dfd3daef60d8 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:09.042183  2602 ts_tablet_manager.cc:1434] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:01:09.051210  1625 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-72c7a933e3e84bcfb3f8de277043f0ab received from {username='slave'} at 127.0.0.1:57944
I20260709 13:01:09.051645  1625 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-72c7a933e3e84bcfb3f8de277043f0ab on tablet 72c7a933e3e84bcfb3f8de277043f0ab with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:09.090040  2605 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.091513  2605 tablet_bootstrap.cc:492] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:09.092377  2605 ts_tablet_manager.cc:1403] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.055s	user 0.026s	sys 0.016s
I20260709 13:01:09.096123  2605 raft_consensus.cc:359] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:09.097026  2605 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:09.097803  2605 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:09.100178  2605 ts_tablet_manager.cc:1434] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:01:09.102023  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-16ec23ffe82f42bfad9cca928a92d9ab received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:09.102468  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-16ec23ffe82f42bfad9cca928a92d9ab on tablet 16ec23ffe82f42bfad9cca928a92d9ab with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:09.104698  2602 ts_tablet_manager.cc:933] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:09.117635  2602 tablet_copy_client.cc:323] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:35051
I20260709 13:01:09.119350  1551 tablet_copy_service.cc:140] P c98c328741aa493d87abafbf08f04944: Received BeginTabletCopySession request for tablet f38d50e761f346b8b9b49b532d70e057 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:34908)
I20260709 13:01:09.119889  1551 tablet_copy_service.cc:161] P c98c328741aa493d87abafbf08f04944: Beginning new tablet copy session on tablet f38d50e761f346b8b9b49b532d70e057 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:34908: session id = 9d926c10b90f452ba52d80dab6a50351-f38d50e761f346b8b9b49b532d70e057
I20260709 13:01:09.130824  1551 tablet_copy_source_session.cc:215] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:09.134405  2602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f38d50e761f346b8b9b49b532d70e057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:09.190866  2602 tablet_copy_client.cc:806] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:09.195353  2602 tablet_copy_client.cc:670] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:09.243223  2371 raft_consensus.cc:1217] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:09.254689  2602 tablet_copy_client.cc:538] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:09.293907  2371 raft_consensus.cc:1217] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:09.271910  2602 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:09.423123  2371 raft_consensus.cc:1217] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:09.456533  2602 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:09.461229  2602 tablet_bootstrap.cc:492] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:09.462481  2602 ts_tablet_manager.cc:1403] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.191s	user 0.011s	sys 0.018s
I20260709 13:01:09.466154  2602 raft_consensus.cc:359] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:09.467211  2602 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:09.467990  2602 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:09.479331  2602 ts_tablet_manager.cc:1434] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:01:09.484956  1551 tablet_copy_service.cc:342] P c98c328741aa493d87abafbf08f04944: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-f38d50e761f346b8b9b49b532d70e057 received from {username='slave'} at 127.0.0.1:34908
I20260709 13:01:09.485477  1551 tablet_copy_service.cc:434] P c98c328741aa493d87abafbf08f04944: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-f38d50e761f346b8b9b49b532d70e057 on tablet f38d50e761f346b8b9b49b532d70e057 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:09.605976  2371 raft_consensus.cc:1217] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:09.633344  2579 raft_consensus.cc:1064] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:09.636153  2579 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:09.678304  2577 raft_consensus.cc:1064] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:09.683641  2577 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:09.726495  2371 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:09.728511  2544 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.739974  1682 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:09.742910  1532 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:09.743693  2544 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.745011  2553 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.754820  2370 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:09.759110  1540 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:09.760932  2553 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:09.767517  2544 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:09.767889  1685 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:09.783563  2579 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:09.836372  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 49561.6us
I20260709 13:01:09.852303  2620 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:09.853377  2579 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:09.860709  1532 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:09.880777  1437 catalog_manager.cc:5697] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:09.919989  1540 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:09.936378  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 95036.9us
I20260709 13:01:09.949235  2371 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:09.960876  2370 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:09.984427  1685 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:09.988951  1682 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.034191  1614 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:10.038316  2594 raft_consensus.cc:1064] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:10.048517  2370 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.050239  2579 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:10.054280  1538 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.055979  2625 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:10.055748  1436 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.059525  2594 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:10.065826  2579 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.068563  2370 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.070942  1538 raft_consensus.cc:2955] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.080400  2598 raft_consensus.cc:1064] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:10.083048  2598 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:10.100414  1614 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.101665  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 72c7a933e3e84bcfb3f8de277043f0ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:10.103977  2578 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:10.105899  1608 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:10.106861  2371 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.108697  2495 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:10.116803  1532 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.118230  1685 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.119333  2578 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:10.126068  2371 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.130321  2625 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:10.135602  1435 catalog_manager.cc:5697] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.146644  2625 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.156708  2553 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.160492  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 72c7a933e3e84bcfb3f8de277043f0ab with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:48350
I20260709 13:01:10.169256  2367 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.191256  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71514c8580924feb8600dfd3daef60d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:10.219400  2370 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.235100  1682 raft_consensus.cc:2955] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.229563  2639 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:10.248919  2635 tablet_replica.cc:333] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:01:10.250272  2635 raft_consensus.cc:2243] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:10.251173  2635 raft_consensus.cc:2272] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:10.250955  1435 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.253384  2578 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.264513  1609 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.281930  1540 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.306237  2635 ts_tablet_manager.cc:1916] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:10.311049  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 71514c8580924feb8600dfd3daef60d8 with delete_type TABLET_DATA_TOMBSTONED (TS c98c328741aa493d87abafbf08f04944 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37894
I20260709 13:01:10.317765  1439 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.347430  1609 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.351859  2639 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:10.355101  1690 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:10.357712  2635 ts_tablet_manager.cc:1929] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:10.358337  2635 log.cc:1199] T 72c7a933e3e84bcfb3f8de277043f0ab P f6eecf73c1c24b5eb268b5088a3030d4: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/wals/72c7a933e3e84bcfb3f8de277043f0ab
I20260709 13:01:10.360283  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 72c7a933e3e84bcfb3f8de277043f0ab (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:10.373412  2644 tablet_replica.cc:333] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:01:10.374785  2644 raft_consensus.cc:2243] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:10.375551  2644 raft_consensus.cc:2272] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:10.385615  2644 ts_tablet_manager.cc:1916] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:10.404534  2636 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:10.412923  2367 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.430718  2644 ts_tablet_manager.cc:1929] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:10.431923  2644 log.cc:1199] T 71514c8580924feb8600dfd3daef60d8 P c98c328741aa493d87abafbf08f04944: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/wals/71514c8580924feb8600dfd3daef60d8
I20260709 13:01:10.456763  1685 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:10.468597  1614 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.469166  2367 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.470218  2594 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:10.471099  2578 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:10.480223  2495 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.482198  2370 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.495880  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 16ec23ffe82f42bfad9cca928a92d9ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:10.500444  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet 71514c8580924feb8600dfd3daef60d8 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:10.504433  1435 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.507117  2637 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.529330  1614 raft_consensus.cc:2955] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.535015  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 16ec23ffe82f42bfad9cca928a92d9ab with delete_type TABLET_DATA_TOMBSTONED (TS c98c328741aa493d87abafbf08f04944 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37894
I20260709 13:01:10.536161  2644 tablet_replica.cc:333] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:01:10.537220  2644 raft_consensus.cc:2243] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:10.539129  2367 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.540592  2644 raft_consensus.cc:2272] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:10.544952  2644 ts_tablet_manager.cc:1916] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:10.559607  1608 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.565178  1690 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.576851  1435 catalog_manager.cc:5697] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:10.605772  2644 ts_tablet_manager.cc:1929] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:10.606673  2644 log.cc:1199] T 16ec23ffe82f42bfad9cca928a92d9ab P c98c328741aa493d87abafbf08f04944: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/wals/16ec23ffe82f42bfad9cca928a92d9ab
I20260709 13:01:10.609184  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet 16ec23ffe82f42bfad9cca928a92d9ab (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:10.621804  1540 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:10.628885  2367 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.630686  1690 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:10.630642  2639 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:10.636207  2639 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:10.641585  2642 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.653463  2367 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.731341  1688 raft_consensus.cc:2955] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.735419  1435 catalog_manager.cc:5697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:10.750077  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet f38d50e761f346b8b9b49b532d70e057 with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57540
I20260709 13:01:10.771644  2650 tablet_replica.cc:333] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:01:10.772956  2650 raft_consensus.cc:2243] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:10.773669  2650 raft_consensus.cc:2272] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:10.783463  2650 ts_tablet_manager.cc:1916] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:10.821503  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f38d50e761f346b8b9b49b532d70e057 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:10.830901  2650 ts_tablet_manager.cc:1929] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:10.831435  2650 log.cc:1199] T f38d50e761f346b8b9b49b532d70e057 P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/f38d50e761f346b8b9b49b532d70e057
I20260709 13:01:10.833669  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet f38d50e761f346b8b9b49b532d70e057 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:11.901042  1614 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:01:11.931041  1579 consensus_peers.cc:597] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0843e83eb535425fa9bfac75ce544e73. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:11.934427  1536 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:11.934689  1685 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:11.936408  2651 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:11.938985  2651 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:11.951937  2579 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:11.956455  1536 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:11.957451  1682 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:11.995402  1536 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:11.997918  1435 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:12.028939  1504 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 423e376b43454bf396ca57e6aad172f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:12.032518  1614 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:12.034348  2639 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:12.035498  1685 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:12.042780  2612 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:12.090919  2663 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.099843  1614 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.112304  1685 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.147378  1688 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.160002  1439 catalog_manager.cc:5697] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:12.182780  1653 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 151c008abeca49c386849be63d874dca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:12.184541  1614 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:12.186298  1536 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:12.186764  2594 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:12.190006  2648 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:12.204548  2648 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.210342  1614 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.218889  1536 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.236274  1536 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.240950  1437 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.258985  1614 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:12.260835  2652 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:12.261966  1504 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08378fd70b734734992a8174ab0ecfc8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:12.270263  1688 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:12.276911  2663 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:12.283166  1609 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.280998  2612 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.351120  1437 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:12.359524  1685 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:12.537362  2675 ts_tablet_manager.cc:933] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:12.538636  2677 ts_tablet_manager.cc:933] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:12.559827  2675 tablet_copy_client.cc:323] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:35051
I20260709 13:01:12.560737  2677 tablet_copy_client.cc:323] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:01:12.562927  1625 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet 0843e83eb535425fa9bfac75ce544e73 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:01:12.563566  1625 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet 0843e83eb535425fa9bfac75ce544e73 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-0843e83eb535425fa9bfac75ce544e73
I20260709 13:01:12.569355  1551 tablet_copy_service.cc:140] P c98c328741aa493d87abafbf08f04944: Received BeginTabletCopySession request for tablet 423e376b43454bf396ca57e6aad172f5 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:34908)
I20260709 13:01:12.569943  1551 tablet_copy_service.cc:161] P c98c328741aa493d87abafbf08f04944: Beginning new tablet copy session on tablet 423e376b43454bf396ca57e6aad172f5 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:34908: session id = 9d926c10b90f452ba52d80dab6a50351-423e376b43454bf396ca57e6aad172f5
I20260709 13:01:12.578219  1551 tablet_copy_source_session.cc:215] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:12.582609  1625 tablet_copy_source_session.cc:215] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:12.590982  2677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0843e83eb535425fa9bfac75ce544e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.594642  2675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 423e376b43454bf396ca57e6aad172f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.630429  2675 tablet_copy_client.cc:806] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:12.631126  2675 tablet_copy_client.cc:670] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:12.637609  2677 tablet_copy_client.cc:806] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:12.638073  2675 tablet_copy_client.cc:538] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:12.640707  2677 tablet_copy_client.cc:670] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:12.644567  2677 tablet_copy_client.cc:538] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:12.650391  2675 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:12.654664  2677 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:12.676615  2675 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:12.678390  2675 tablet_bootstrap.cc:492] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:12.679566  2675 ts_tablet_manager.cc:1403] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.008s
I20260709 13:01:12.682678  2675 raft_consensus.cc:359] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.683555  2675 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:12.684202  2675 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.707867  2675 ts_tablet_manager.cc:1434] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.020s
I20260709 13:01:12.710260  1551 tablet_copy_service.cc:342] P c98c328741aa493d87abafbf08f04944: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-423e376b43454bf396ca57e6aad172f5 received from {username='slave'} at 127.0.0.1:34908
I20260709 13:01:12.710752  1551 tablet_copy_service.cc:434] P c98c328741aa493d87abafbf08f04944: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-423e376b43454bf396ca57e6aad172f5 on tablet 423e376b43454bf396ca57e6aad172f5 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:12.716236  2677 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:12.717227  2677 tablet_bootstrap.cc:492] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:12.717904  2677 ts_tablet_manager.cc:1403] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.004s
I20260709 13:01:12.721526  2677 raft_consensus.cc:359] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.722405  2677 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:12.723300  2675 ts_tablet_manager.cc:933] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:12.723052  2677 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.725492  2677 ts_tablet_manager.cc:1434] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:01:12.727435  1625 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-0843e83eb535425fa9bfac75ce544e73 received from {username='slave'} at 127.0.0.1:57944
I20260709 13:01:12.727921  1625 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-0843e83eb535425fa9bfac75ce544e73 on tablet 0843e83eb535425fa9bfac75ce544e73 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:12.736603  2675 tablet_copy_client.cc:323] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:12.738760  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet 151c008abeca49c386849be63d874dca from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:12.739403  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet 151c008abeca49c386849be63d874dca from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-151c008abeca49c386849be63d874dca
I20260709 13:01:12.749914  1700 tablet_copy_source_session.cc:215] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:12.754827  2675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 151c008abeca49c386849be63d874dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.772624  2675 tablet_copy_client.cc:806] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:12.773600  2675 tablet_copy_client.cc:670] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:12.778712  2675 tablet_copy_client.cc:538] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:12.789682  2675 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:12.836903  2675 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:12.837880  2675 tablet_bootstrap.cc:492] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:12.838649  2675 ts_tablet_manager.cc:1403] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.049s	user 0.028s	sys 0.013s
I20260709 13:01:12.841538  2675 raft_consensus.cc:359] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.842198  2675 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:12.842804  2675 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.845088  2675 ts_tablet_manager.cc:1434] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:01:12.847692  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-151c008abeca49c386849be63d874dca received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:12.848219  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-151c008abeca49c386849be63d874dca on tablet 151c008abeca49c386849be63d874dca with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:12.851244  2677 ts_tablet_manager.cc:933] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:12.854516  2677 tablet_copy_client.cc:323] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:35051
I20260709 13:01:12.856936  1551 tablet_copy_service.cc:140] P c98c328741aa493d87abafbf08f04944: Received BeginTabletCopySession request for tablet 08378fd70b734734992a8174ab0ecfc8 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:34908)
I20260709 13:01:12.857573  1551 tablet_copy_service.cc:161] P c98c328741aa493d87abafbf08f04944: Beginning new tablet copy session on tablet 08378fd70b734734992a8174ab0ecfc8 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:34908: session id = 9d926c10b90f452ba52d80dab6a50351-08378fd70b734734992a8174ab0ecfc8
I20260709 13:01:12.866151  1551 tablet_copy_source_session.cc:215] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:12.869738  2677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08378fd70b734734992a8174ab0ecfc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:12.883730  2677 tablet_copy_client.cc:806] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:12.884598  2677 tablet_copy_client.cc:670] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:12.888644  2677 tablet_copy_client.cc:538] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:12.897365  2677 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:12.914130  2677 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:12.914865  2677 tablet_bootstrap.cc:492] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:12.915406  2677 ts_tablet_manager.cc:1403] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:01:12.917711  2677 raft_consensus.cc:359] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.918309  2677 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:12.918814  2677 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:12.920838  2677 ts_tablet_manager.cc:1434] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:01:12.922971  1551 tablet_copy_service.cc:342] P c98c328741aa493d87abafbf08f04944: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-08378fd70b734734992a8174ab0ecfc8 received from {username='slave'} at 127.0.0.1:34908
I20260709 13:01:12.923393  1551 tablet_copy_service.cc:434] P c98c328741aa493d87abafbf08f04944: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-08378fd70b734734992a8174ab0ecfc8 on tablet 08378fd70b734734992a8174ab0ecfc8 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:13.030515  2367 raft_consensus.cc:1217] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:13.084784  2367 raft_consensus.cc:1217] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:13.283548  2370 raft_consensus.cc:1217] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:13.374853  2370 raft_consensus.cc:1217] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:13.482481  2663 raft_consensus.cc:1064] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:13.484721  2663 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:13.494170  2370 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.495772  2663 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:13.498589  1682 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.499460  1614 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.500525  2652 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:13.501420  2663 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:13.522024  2612 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.533597  2370 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.553058  2687 raft_consensus.cc:1064] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:13.555794  2687 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:13.570256  1439 catalog_manager.cc:5697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.578752  1614 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.597501  2370 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.602744  2653 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:13.607833  1688 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.641844  1682 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.648355  1532 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.650055  2695 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:13.659759  2687 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:13.692762  2653 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.698406  1536 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:13.706234  2370 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:13.705894  2367 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.707719  2612 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:13.719213  1614 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:13.719821  1536 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.721128  2663 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:13.722396  1688 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.723150  2663 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.725749  2648 raft_consensus.cc:1064] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:13.732679  2648 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:13.737936  1437 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.750033  1614 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.762713  2367 raft_consensus.cc:2955] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.781860  2367 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.783722  2705 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:13.785174  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 423e376b43454bf396ca57e6aad172f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:13.796375  1614 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.800545  1536 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.801841  2594 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:13.810860  1609 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:13.817270  2648 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:13.810393  1435 catalog_manager.cc:5697] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 reported cstate change: config changed from index 3 to 4, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:13.827894  1688 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:13.829804  2653 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:13.835210  2367 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:13.837594  2651 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:13.838506  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 423e376b43454bf396ca57e6aad172f5 with delete_type TABLET_DATA_TOMBSTONED (TS f6eecf73c1c24b5eb268b5088a3030d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:48350
I20260709 13:01:13.844199  2367 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.844571  2695 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.853183  2594 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.853639  1688 raft_consensus.cc:2955] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.862696  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0843e83eb535425fa9bfac75ce544e73 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:13.879037  2709 tablet_replica.cc:333] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:01:13.880218  2709 raft_consensus.cc:2243] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.883235  2709 raft_consensus.cc:2272] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.890720  1536 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.887969  1435 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 3 to 4, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.903343  2709 ts_tablet_manager.cc:1916] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:13.902797  1608 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.926589  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 0843e83eb535425fa9bfac75ce544e73 with delete_type TABLET_DATA_TOMBSTONED (TS c98c328741aa493d87abafbf08f04944 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37894
I20260709 13:01:13.930557  2712 tablet_replica.cc:333] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:01:13.934149  2712 raft_consensus.cc:2243] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:13.935433  2712 raft_consensus.cc:2272] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:13.940081  2709 ts_tablet_manager.cc:1929] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:13.940719  2709 log.cc:1199] T 423e376b43454bf396ca57e6aad172f5 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/wals/423e376b43454bf396ca57e6aad172f5
I20260709 13:01:13.943087  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 423e376b43454bf396ca57e6aad172f5 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:13.943044  2712 ts_tablet_manager.cc:1916] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:13.934405  1435 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.947712  2612 raft_consensus.cc:1064] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:13.950567  2612 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:13.959723  2371 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:13.972155  2370 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.973942  2712 ts_tablet_manager.cc:1929] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:13.974553  2712 log.cc:1199] T 0843e83eb535425fa9bfac75ce544e73 P c98c328741aa493d87abafbf08f04944: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/wals/0843e83eb535425fa9bfac75ce544e73
I20260709 13:01:13.974213  2696 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:13.978006  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet 0843e83eb535425fa9bfac75ce544e73 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:13.978842  1688 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.983997  1608 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:13.984892  2612 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:13.987480  2612 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:14.008335  1682 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:14.016695  1536 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.016012  1682 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.016094  2371 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.018884  2711 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:14.021932  1608 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.013624  2612 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.027118  2594 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.040726  1439 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.048434  2710 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.050518  2370 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.065683  2371 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.062462  1536 raft_consensus.cc:2955] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.072654  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 151c008abeca49c386849be63d874dca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:14.078251  1439 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.111161  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet 151c008abeca49c386849be63d874dca with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57540
I20260709 13:01:14.117012  2717 tablet_replica.cc:333] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:01:14.119213  1536 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:14.122737  2717 raft_consensus.cc:2243] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.128818  1688 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.130406  2371 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:01:14.131500  2663 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:14.130453  2717 raft_consensus.cc:2272] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.137941  2717 ts_tablet_manager.cc:1916] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:14.139992  2663 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:14.144771  2612 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.152900  1688 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.153101  2371 raft_consensus.cc:2955] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.171892  2717 ts_tablet_manager.cc:1929] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:14.172516  2717 log.cc:1199] T 151c008abeca49c386849be63d874dca P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/151c008abeca49c386849be63d874dca
I20260709 13:01:14.175173  1439 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 3 to 4, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:14.180768  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet 151c008abeca49c386849be63d874dca (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:01:14.186403  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08378fd70b734734992a8174ab0ecfc8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:14.192397  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet 08378fd70b734734992a8174ab0ecfc8 with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57540
I20260709 13:01:14.193442  2717 tablet_replica.cc:333] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:01:14.194648  2717 raft_consensus.cc:2243] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:14.195385  2717 raft_consensus.cc:2272] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:14.199115  2717 ts_tablet_manager.cc:1916] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:14.216596  2717 ts_tablet_manager.cc:1929] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:01:14.216964  2717 log.cc:1199] T 08378fd70b734734992a8174ab0ecfc8 P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/08378fd70b734734992a8174ab0ecfc8
I20260709 13:01:14.218397  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet 08378fd70b734734992a8174ab0ecfc8 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
W20260709 13:01:17.211236  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.000s	sys 0.009s
I20260709 13:01:17.209529  2723 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.211833  2722 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.212670  2723 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.213531  2722 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.216524  2723 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:17.217293  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.000s	sys 0.011s
I20260709 13:01:17.228793  2720 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.230600  2722 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.231434  2722 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.231313  2720 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.240558  2722 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.243378  2722 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.244019  2722 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.249522  2724 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.273762  2722 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.273798  2720 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:17.264554  2724 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.282411  2726 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.283684  2726 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.285053  2724 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.277884  2727 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.300768  2728 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.301923  2728 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.292903  2729 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.292654  2727 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.289664  2724 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.309934  2724 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.324519  2726 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.325174  2722 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.304963  2729 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.320935  2727 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.352388  2722 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.354244  2722 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.345844  2720 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.358567  2728 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.358249  2720 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.350824  2726 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.361287  2729 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:17.361096  2726 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.358258  2734 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.365221  2734 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.365242  2720 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.352913  2724 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.360205  2733 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.373993  2729 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.375097  2729 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.378343  2729 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.351408  2737 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.381114  2734 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.381279  2737 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.384703  2737 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.385418  2726 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.385649  2722 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.389022  2733 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.412320  2732 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.413172  2732 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.429353  2738 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.430315  2738 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.434438  2738 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.421479  2722 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.437062  2733 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.517859  2720 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.518451  2729 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.518981  2720 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.519368  2729 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.520998  2735 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.623083  2722 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.624776  2720 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.623123  2731 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.625634  2722 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.629426  2731 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.625921  2740 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.626407  2723 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.627146  2730 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.627257  2739 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.672905  2729 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.670233  2735 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.751291  2723 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.752645  2732 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:17.447237  2738 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.753301  2730 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.759339  2738 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.760934  2730 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.761554  2738 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.763290  2721 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.754839  2720 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.668505  2740 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.763666  2738 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.764074  2721 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.769121  2739 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.775172  2720 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.771646  2743 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.773785  2738 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.774662  2723 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.778609  2739 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.780704  2735 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.780992  2738 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.783682  2731 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.775373  2721 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.778534  2720 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:17.786505  2740 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.806272  2743 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.827261  2720 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.830029  2720 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.825632  2721 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.831089  2721 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.822414  2740 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.832590  2740 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.833207  2721 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.833695  2732 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.834365  2732 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.834775  2740 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.836441  2729 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.838179  2732 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.837749  2729 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.843133  2747 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.844780  2739 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.845592  2739 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.845391  2747 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.846836  2735 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.850088  2746 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.850620  2722 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.851372  2733 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.852125  2739 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.852310  2729 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:17.843097  2753 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.840809  2732 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.854147  2720 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:17.858342  2730 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.865322  2733 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.857385  2722 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.858560  2735 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.871279  2748 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.876523  2723 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.908169  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:17.908704  2721 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.908922  2742 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.909452  2721 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.880105  2749 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:17.872383  2730 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.882336  2720 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.880559  2732 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.909808  2742 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.919507  2723 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.923028  2743 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.872736  2746 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.925063  2723 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.906854  2741 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.887256  2753 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:17.910110  2748 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.966017  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.051903  2752 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.052309  1538 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.052723  2752 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.054749  2754 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.055258  2752 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.980681  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.055877  2754 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.987563  2749 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.986747  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:17.991910  2751 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.980298  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:17.984822  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:17.985412  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:17.978924  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:17.979573  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:17.980914  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:17.981120  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:17.985528  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.076824  1540 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:17.987339  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:17.983826  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:17.984647  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:17.995711  2733 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.918308  2755 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:17.999166  2722 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:17.981413  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:17.931587  2720 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.090621  1539 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.090282  2755 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.972986  2729 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.093921  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.094691  1541 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:17.987713  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.095263  2755 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.040576  2732 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:18.095597  1684 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.095822  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.090931  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.096534  1538 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.083215  1534 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.084164  1689 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:17.965163  2723 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.099344  1535 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.099524  2723 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.101877  2723 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.094893  2720 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.988632  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.094461  2729 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.926087  2730 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:17.966996  2747 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:18.104558  1682 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:17.986088  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.096221  2751 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.991703  2740 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.996389  2731 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:17.991474  2750 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.113879  2740 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:17.925959  2741 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.122244  1687 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.123458  2764 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.124399  2729 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.104468  2739 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.124217  2764 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.112669  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:18.114048  2731 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.128643  2329 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:18.130373  2744 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.132448  2722 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.133772  2721 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.103277  2328 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:18.129756  2764 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.125792  2739 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.137377  2744 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.145185  2721 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.126785  2752 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.133831  2749 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.143887  2720 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.148141  2733 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.160617  2758 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.147404  2760 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.171308  2687 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.171205  2721 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.171315  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:18.172003  2730 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.141328  2722 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.181414  2751 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.174003  2762 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.174919  2741 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.177963  2752 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.178714  2747 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:18.170006  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 66854.7us
I20260709 13:01:18.151906  2753 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:18.180754  2720 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:18.139791  2750 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.148370  2723 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.180964  2758 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.190742  2749 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.397117  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.397872  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.397758  2749 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.398694  1609 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.399127  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.400182  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.400000  2723 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.400481  2742 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.400847  1609 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.402551  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.402835  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.403311  1608 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.404215  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.212828  2687 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:18.404917  1616 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.405130  1614 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:18.406277  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.213244  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:18.407745  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:18.359027  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.013s	sys 0.032s
I20260709 13:01:18.408638  2371 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.303503  2771 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:18.409142  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.014s	sys 0.041s
I20260709 13:01:18.180277  2733 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.439867  2750 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.359879  2735 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.239518  2764 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.258388  2739 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.336503  2759 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.452991  2756 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.268414  2761 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.256901  2731 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.412489  2722 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.230705  2744 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.358532  2746 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.311650  2772 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:18.237341  2392 debug-util.cc:398] Leaking SignalData structure 0x7b08002e1c20 after lost signal to thread 434
I20260709 13:01:18.453023  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.255491  2740 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.449187  2751 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.441941  2754 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.249904  2763 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.445807  2733 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.321831  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:18.458580  2765 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.453781  2756 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.453518  2759 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.347945  2768 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.238070  2748 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.236068  2732 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.453478  2687 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:18.448942  2328 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:18.317245  2766 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.353478  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:18.255790  2760 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.482203  2746 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.515125  2723 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:18.522316  2392 debug-util.cc:398] Leaking SignalData structure 0x7b08002e2300 after lost signal to thread 1473
I20260709 13:01:18.454918  2747 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.517614  2749 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.455849  2730 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.515133  2769 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.533901  2773 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.526937  2732 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.505561  2764 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.520306  2768 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.465067  2767 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.528427  2761 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.525934  2751 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.552201  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.553460  2720 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:18.550897  2738 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.555297  2738 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.557410  2738 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.539496  2366 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.562945  2770 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.544627  2768 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.546180  2687 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.552793  2748 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.513872  2763 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.533106  2765 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:18.579120  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 178496us
I20260709 13:01:18.563750  2721 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.459688  2762 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:18.573195  2392 debug-util.cc:398] Leaking SignalData structure 0x7b080028cb40 after lost signal to thread 1565
I20260709 13:01:18.521576  2772 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.557961  2738 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.541550  2746 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.585178  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:18.585822  1653 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:18.597009  2367 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.459453  2771 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.598572  1653 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:18.604322  2721 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.578720  2687 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:18.600075  2392 debug-util.cc:398] Leaking SignalData structure 0x7b080032eca0 after lost signal to thread 1640
I20260709 13:01:18.550465  2766 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.615110  2721 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.618288  2731 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.622659  2764 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.571213  2767 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.625473  1653 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:18.596292  2748 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.561589  2773 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.560962  2769 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.622112  2738 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.626999  2721 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.627857  2758 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.622205  2756 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.592543  2770 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.628252  2731 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.648010  2761 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.637682  2743 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.640265  2747 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:18.649092  2392 debug-util.cc:398] Leaking SignalData structure 0x7b080031ee60 after lost signal to thread 1714
I20260709 13:01:18.650301  2731 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.651935  2730 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.653179  2743 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.655603  2746 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.654253  2732 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.670673  2763 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.672958  2771 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.635546  2774 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.665941  2743 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.661111  2767 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.665578  2751 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.680415  2687 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.684362  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.687000  2762 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:18.684372  2392 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4ea0 after lost signal to thread 2395
I20260709 13:01:18.683207  2759 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.674433  2774 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.694186  1614 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.700666  2764 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.700794  2742 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.688203  2752 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.701015  2760 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.706017  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.708653  2766 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.708879  2749 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.704658  2735 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.709455  2749 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.709827  2735 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.711535  2735 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.711573  2749 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.715372  2741 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.716692  2741 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.718349  2772 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.697669  2732 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.704523  2746 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.723225  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.723614  2765 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.726662  1535 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.701766  2722 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:18.725435  2738 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.713415  2735 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.720520  2748 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.748934  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:18.727108  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 544927us
I20260709 13:01:18.706573  2769 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.755371  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.721879  2764 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.752408  2738 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.761593  2738 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.749123  2770 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.765092  2738 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.765113  2774 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.763098  2731 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:18.769343  2731 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:18.725952  2742 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.772203  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:18.772729  2773 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.730386  2732 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.773353  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:01:18.755229  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 313451us
I20260709 13:01:18.776969  2722 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:18.758451  2741 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.781241  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.782200  1616 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.784890  2778 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.756994  2735 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.770073  2746 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.792562  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.786998  2722 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.794726  2722 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.787173  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.795221  2722 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.795476  1683 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.797899  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.798148  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:18.798557  1688 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.799425  2328 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:18.786052  2365 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.785408  2778 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:18.802851  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.804716  2764 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.808210  2779 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:18.808341  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.808794  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.810112  1614 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.809652  2778 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.820492  2780 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.820843  2370 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:18.818894  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:18.822647  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.819280  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.808887  2779 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:18.821157  2780 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:18.817670  2733 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:18.836094  1683 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:18.836248  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.837590  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.840342  1616 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.840843  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.827884  2746 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.845204  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:18.847899  2370 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.829428  2779 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:18.858675  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.872591  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.930838  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.929849  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.933282  1614 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.940927  2780 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.874779  2368 raft_consensus.cc:1240] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:18.947463  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.947474  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.948442  1610 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.949049  1611 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.818369  2781 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:18.934652  2735 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.924974  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.957525  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.958811  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.960474  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.965765  2721 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:18.966147  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.966396  2732 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.966773  2743 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:18.968317  2733 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.937776  2742 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:18.874472  2365 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:18.978032  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.983803  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.977685  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.975494  1686 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.979714  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.983856  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.991459  1689 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.990258  1688 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.990952  1690 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.977782  1683 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.994149  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.994879  1686 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.978881  1607 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.996083  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:18.991639  1681 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:18.977707  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.998684  1682 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:18.999550  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:18.999176  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:18.996706  2364 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.002314  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.002991  1535 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:19.003748  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.003865  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.004518  1536 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:19.004992  2783 raft_consensus.cc:2764] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:01:19.005916  2721 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:19.006431  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.007946  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.008292  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.008591  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.000305  2733 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.009325  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.009636  2733 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:19.010061  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.010509  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.011092  1688 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:19.011945  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.012331  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.012480  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.013494  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.010102  2733 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.016131  2743 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:18.977118  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 177765us
I20260709 13:01:19.001030  1608 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:18.998041  2781 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.021310  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.021178  2722 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:19.000752  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 229636us
I20260709 13:01:19.029191  2371 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.029709  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.026898  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.030387  1607 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:19.031275  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.031499  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.032235  1607 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:19.032791  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.033408  1686 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:19.034243  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.029068  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.031899  1689 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:19.032524  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.036298  2768 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.037678  2369 raft_consensus.cc:2393] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:19.038656  2768 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.032392  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.041270  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.032284  1579 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.044922  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.045873  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.046499  1689 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.046458  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.047585  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.049410  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.049855  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.050444  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.050606  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.051362  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.051656  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.047137  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.017261  2778 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.099864  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.111140  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.111688  2781 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.113692  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.114630  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.116667  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.053323  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.117551  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.074970  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.052652  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.128422  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.055207  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.074266  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.053654  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:19.054735  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 75194.5us
I20260709 13:01:19.054153  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.132405  1579 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.135210  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.139608  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.113752  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.140650  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.141463  1653 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.141831  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.055160  2780 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.148658  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.150398  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.153039  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.152519  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.153631  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.154309  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.150169  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.155857  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:19.159070  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.140686  2773 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.160604  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.149242  2780 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.062197  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.161998  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.164747  2780 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.165925  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.152338  2723 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:19.167361  2723 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:19.168507  2723 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.170818  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.150763  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.173437  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.174096  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.163599  2773 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.174906  2773 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.165819  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.176023  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.176738  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.166100  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:19.183655  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.184172  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.184875  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.185604  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.190454  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.192283  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:19.195784  1690 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.200592  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.175907  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.210592  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.191222  2722 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.162134  2733 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.211146  1681 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:19.162612  2738 consensus_queue.cc:1059] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:01:19.202235  2768 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.215749  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.219007  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.217604  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:19.208282  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 165797us
I20260709 13:01:19.227269  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.228377  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.218703  2768 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:19.231278  2768 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.232272  1579 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.235035  2751 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.235796  1579 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.227285  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.234975  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.222724  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.234117  2781 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.236369  2751 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.240501  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.241818  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.242053  2767 raft_consensus.cc:3055] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.251020  1682 raft_consensus.cc:2393] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:19.239854  1579 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.242409  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.242792  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.243005  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.243811  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.244217  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.244745  2738 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.243842  2780 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.257979  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.251827  1689 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:19.256034  1579 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.234675  2778 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.263173  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.263036  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.265389  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.263140  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.248994  2781 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.267880  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.249564  2733 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.251343  2751 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.251089  2767 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:19.270164  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.270459  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:19.270870  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 48624.6us
I20260709 13:01:19.271057  2767 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.271860  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.272063  2782 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.272446  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.272536  2782 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.258591  2774 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.273350  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.273416  2774 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.274055  2774 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.274359  2743 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.274474  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.267879  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.273063  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.275557  1608 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:19.275933  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.276180  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.273149  2782 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.280784  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.252525  1687 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:19.258445  2738 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.283140  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.237002  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.284305  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.272603  2767 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.285328  1579 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.274840  2743 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.288648  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.283823  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.290764  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.288341  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.274997  2781 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.275100  2687 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.297688  2687 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.298101  2687 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.298341  2780 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.295862  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.301504  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.302788  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.304591  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.294909  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.257648  2773 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.288497  2731 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.307669  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.282866  2762 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.296321  1579 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.315286  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.289155  2738 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.306584  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.311282  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.314514  1610 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.286906  2760 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.296737  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.316192  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:19.303882  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.323074  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.294818  2743 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.309624  2770 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.320578  2762 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.325953  2760 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.315881  2778 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.325371  2780 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:19.337361  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 55375.5us
I20260709 13:01:19.339048  1686 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.339215  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:19.326272  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 93903.9us
I20260709 13:01:19.315577  2328 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.334649  2760 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.334467  2762 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.348114  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.332885  2770 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.349051  1609 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.334838  2778 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:19.355980  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.338124  2780 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.366020  1612 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:19.367882  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.370066  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.370877  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.369902  2733 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:19.372219  2733 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:19.349407  2721 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.373394  2329 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.354143  2770 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.379061  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.379245  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.380472  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.380551  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.380892  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.381289  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.381448  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:19.381438  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.382017  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.383257  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.383517  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.384743  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:19.351341  2731 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:19.356153  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 61515.7us
I20260709 13:01:19.355520  2778 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.356760  2773 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.358209  2780 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.395892  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:19.423869  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 70127.5us
I20260709 13:01:19.379786  2721 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.388549  2722 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.428154  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.416002  2731 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.410087  2786 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.431048  2721 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.440980  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.451783  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:19.432358  2722 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:19.461468  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.447263  2786 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.456882  2742 consensus_queue.cc:1059] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:01:19.460754  2722 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:19.482263  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 108657us
I20260709 13:01:19.486539  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.497635  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:19.486760  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:19.487093  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.487337  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:19.486824  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:19.488576  2738 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.489450  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:19.487346  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.497905  2723 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.501354  2723 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.501811  2723 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.499708  2365 raft_consensus.cc:2393] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:19.448776  2779 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.493661  2786 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.504251  2735 raft_consensus.cc:3055] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.533380  2367 raft_consensus.cc:2393] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:19.505013  2738 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.476382  2782 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.470516  2733 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:19.472082  2785 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
W20260709 13:01:19.548864  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 113305us
I20260709 13:01:19.514076  2722 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.511734  2743 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.518671  2731 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.525225  2774 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.527554  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:19.571213  2370 raft_consensus.cc:2393] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:19.528609  2329 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.529572  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:19.539745  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:19.546952  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:19.532830  2735 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:19.539785  2760 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:19.556300  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 117911us
I20260709 13:01:19.514066  2687 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.560460  2722 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.560973  2779 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.561865  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.565392  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.567094  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.568310  2751 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.573058  1615 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.563292  2781 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:19.577868  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 182091us
W20260709 13:01:19.578786  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 156089us
I20260709 13:01:19.580554  1690 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.585273  1504 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.636135  2770 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.639166  2687 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.637709  2735 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:19.642539  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 59528.6us
I20260709 13:01:19.640343  2774 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.631395  2732 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.632670  1611 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.637226  1683 raft_consensus.cc:2393] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:19.577769  2364 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.637476  2731 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.661496  2797 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.635450  2782 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.633044  2751 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.636756  2722 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.579458  2721 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.668171  2368 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.556938  2762 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:19.659067  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 73872.7us
I20260709 13:01:19.669423  1504 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.670045  2781 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.672693  2796 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.673925  2786 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:19.660027  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 227586us
I20260709 13:01:19.661489  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.665939  2795 consensus_queue.cc:1059] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:19.676025  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.674896  2722 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:19.696255  2802 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.700909  2792 raft_consensus.cc:3055] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.709759  2792 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:19.701674  2760 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.710798  2792 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.711757  2786 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.712399  2792 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.679001  2778 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.693740  2735 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.716789  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.665932  2768 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.717190  2770 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.719169  2768 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.703390  2762 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:19.696467  1579 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.720383  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.708990  2780 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.714000  1437 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 2, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.715484  2778 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.716079  2743 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.704874  2722 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.704715  2721 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.728940  2774 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.729578  2774 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.733963  2774 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.707388  2723 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.737017  2723 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.738294  2781 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.738808  2781 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.739171  2781 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.739264  2780 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.743345  1579 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.745450  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:19.747216  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 72692.7us
I20260709 13:01:19.749011  1504 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:19.750905  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 93473us
I20260709 13:01:19.753428  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.750070  2770 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.754541  2770 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.754786  2796 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.755095  2770 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.755450  2802 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.755932  2802 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.756327  2802 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:19.696558  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 168054us
I20260709 13:01:19.759980  1504 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.760792  2796 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.762239  2368 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:19.764776  2364 raft_consensus.cc:1240] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.766789  2781 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.766904  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.760341  2800 consensus_queue.cc:1059] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:19.770143  1579 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:19.750823  2780 consensus_queue.cc:1059] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:01:19.768998  2767 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.772140  2723 consensus_queue.cc:1059] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:19.775229  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:19.775907  2723 raft_consensus.cc:3055] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.776319  2723 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:19.777217  2723 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.778393  2723 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.779564  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.774011  2731 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:01:19.772610  2687 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.781927  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.782225  2687 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.782673  2687 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.785005  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.771842  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.786124  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.786463  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.786561  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.787258  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.788547  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.789211  2751 consensus_queue.cc:1059] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:19.789762  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.790125  2778 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.771183  2796 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.790560  2778 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:19.790988  2778 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.791998  1688 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:19.788160  2781 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.794843  2769 raft_consensus.cc:3055] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.795301  2767 raft_consensus.cc:3055] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.772447  2800 raft_consensus.cc:3055] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.799566  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.797268  1504 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.798094  2769 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:19.800532  2767 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:19.802632  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.793936  2770 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.791687  2802 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.797976  2796 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.810141  2767 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.811450  2767 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.811913  2802 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.804111  2800 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:19.813876  2800 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.815179  2800 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.803260  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.809111  2769 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.809834  2770 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.806653  2742 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.818851  2802 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.805897  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.819828  2769 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.822268  2796 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.823136  1504 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.826382  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.828262  2796 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.829622  2738 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.827124  1504 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.830183  1580 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.830338  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.830688  2796 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.831455  2770 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:19.832022  1504 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.832389  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.832782  2796 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.833014  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.833942  1504 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:19.834627  1579 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 752aab0c230943e5a7d35d3d2ff9e555. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:19.834652  2796 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.835258  2368 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.836853  1504 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.837445  2770 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:19.836361  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 178432us
I20260709 13:01:19.839406  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.839310  1504 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.841646  2806 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.842664  2780 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.842775  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.844455  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.844767  1504 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.846380  1683 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:19.846871  2742 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.847668  2774 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.850021  2774 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.840106  2796 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.850485  2788 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:19.851701  2770 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.852128  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.818254  2778 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.854017  1654 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.855419  1504 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.856178  2329 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.856979  1504 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.861387  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.862694  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.864140  1504 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.865245  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:19.865607  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.866710  2802 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.867682  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.868538  2806 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.868695  2743 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.854979  2794 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.853699  2364 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.857029  2768 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.863879  2804 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.862505  2742 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.862663  2796 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:01:19.869817  2721 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.873468  1580 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.872406  2770 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.876456  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.875311  1504 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.876870  2768 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:19.876452  2743 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.883795  2732 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.873756  2805 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.877049  2804 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.881047  2780 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:19.891789  2780 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.892231  2780 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:19.892314  2804 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.881389  2721 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.881544  2796 raft_consensus.cc:3055] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.876550  2794 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.883941  2743 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.877018  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.882552  2329 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:19.884967  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.885031  1504 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.883025  2774 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.870922  2781 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.903952  2732 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.895229  2721 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.909713  2780 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.911170  2780 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.900696  2808 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:01:19.903939  2801 raft_consensus.cc:2804] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.919894  2801 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.904471  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:19.920490  2801 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.921000  2733 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:19.920951  1654 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:19.894325  2796 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:19.900401  2794 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.883795  2768 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.903034  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.921600  2733 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:19.924257  2733 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.924456  2781 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.902541  1504 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.903156  2687 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.928879  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.930781  2687 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:19.931012  2732 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.916759  2722 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:19.934734  2810 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.002s
I20260709 13:01:19.928174  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.907011  2788 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.936091  2796 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.936896  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:19.944142  1504 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.880271  2778 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.937752  2722 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:19.939009  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:19.940891  2804 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.926064  2731 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.966995  2743 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.934829  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:19.978626  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 43900.3us
I20260709 13:01:19.944110  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:19.945007  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.947583  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.947595  2732 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.950637  2805 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:19.947701  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.954661  1690 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.954944  1686 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.955482  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:19.970739  2370 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.957099  1684 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.957046  2762 raft_consensus.cc:3055] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.967942  2796 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.937707  2721 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:19.961369  1688 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.976672  2733 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.945711  2767 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.979270  2743 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.996236  2723 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:19.997483  2723 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:19.997833  2768 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.998281  2801 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:19.962047  2365 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:19.981411  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:19.980931  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.980592  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:19.985296  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:19.990707  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.003322  1608 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:19.984370  1613 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:19.980703  2722 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.008698  1436 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.014424  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.015327  2801 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:19.984774  2788 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:19.997885  2723 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.017076  2735 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.017534  2735 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.018455  2735 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.019755  2735 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.993235  2762 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.022019  2808 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:20.022604  2808 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:20.022240  2762 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.023026  2808 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:19.979175  2804 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:20.017544  2723 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.020632  2721 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:20.026171  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44848.1us
I20260709 13:01:20.028252  2768 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:20.028888  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.028910  2731 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:20.030047  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.029974  2805 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.030977  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.031286  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.032529  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.033097  2723 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.034762  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:20.035627  2804 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.036114  2804 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.037041  2804 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.038964  1538 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:20.039660  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.040225  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.040948  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.041340  2804 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.042181  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.042462  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.042778  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.043375  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.042963  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.043533  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.044363  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.044497  2733 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:20.045010  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.045244  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.046130  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.046403  1504 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.046702  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.047851  2806 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.048429  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.048631  2806 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.048955  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.051039  1688 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.051169  1686 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.051440  1690 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.052469  1682 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.023593  2762 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.060810  1609 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.063635  1609 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.064488  1614 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.060339  1610 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.060256  1613 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.059980  2797 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.066802  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.067829  1612 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.065586  1607 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.079342  1608 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.080803  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.082296  1616 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.086038  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.069536  2799 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.084105  1611 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.096675  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.116971  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:20.119958  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.067445  2794 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.092249  2742 consensus_queue.cc:1059] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:20.118089  2786 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:20.125208  2786 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:20.125629  2786 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.125700  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.098062  2792 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:20.128305  1685 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.129751  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.132340  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.127665  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.119704  2743 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.134734  2816 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.135404  2768 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.136428  2792 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:20.140497  2792 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.140309  2742 consensus_queue.cc:1059] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:20.141321  2742 raft_consensus.cc:3055] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.135880  2805 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.141705  2742 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.141973  2805 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.142752  2742 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.143832  2805 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.125928  2794 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:20.144321  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.145592  2805 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.139770  1535 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:20.149240  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.151027  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.152581  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.153475  2687 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:20.156471  2721 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.162001  2816 raft_consensus.cc:3055] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.162549  2816 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.162243  1683 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:20.162180  2808 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.137461  2799 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.128695  2797 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:01:20.162606  2732 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:01:20.182813  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.169064  2743 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.191942  2817 ts_tablet_manager.cc:933] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:20.181528  2742 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.195863  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.198266  2364 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.198073  2365 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.166880  2329 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.182935  2733 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:01:20.184302  2732 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.171293  2816 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.204691  1683 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:20.232255  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 79662.2us
I20260709 13:01:20.235503  2818 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:20.231067  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 91435.6us
I20260709 13:01:20.261089  1541 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:20.183151  2815 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:01:20.245239  2732 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.247300  2735 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.248589  2795 consensus_queue.cc:1059] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:20.249832  2808 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:20.251734  2805 consensus_queue.cc:1059] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.225328  2792 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.260468  2816 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.237471  2768 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.273442  2732 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.281710  1685 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:20.283254  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.283962  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.292340  2792 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:20.294763  2815 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.295418  2815 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.296628  2815 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.298303  2815 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.247192  2786 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.237895  2743 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:01:20.319451  2786 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:20.321166  2723 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.321714  2723 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.308995  2796 raft_consensus.cc:3055] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.311329  2781 consensus_queue.cc:1059] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.328704  2796 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.329299  2781 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.329746  2781 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:20.329640  2796 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.330739  2781 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.341046  2781 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.311981  2806 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.313475  2794 raft_consensus.cc:3055] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.344503  2794 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.345731  2794 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.347298  2794 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.314615  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.326186  2723 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:20.349009  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.349697  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.349400  2768 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.353051  2768 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.353369  2723 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.382577  2821 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.361166  2329 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.399132  2821 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.401953  1439 catalog_manager.cc:5697] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:20.423768  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 227992us
I20260709 13:01:20.407150  2768 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.433635  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.437704  2815 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:20.439132  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:20.439742  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 205406us
I20260709 13:01:20.442582  1505 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.442622  2817 tablet_copy_client.cc:323] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
W20260709 13:01:20.423159  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 56985.8us
W20260709 13:01:20.450150  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 263836us
I20260709 13:01:20.450953  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.454419  2804 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.453890  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.456199  2768 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.457033  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.458214  2329 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.460449  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.463066  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.464526  2733 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:20.460677  2815 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.468453  2822 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.450392  2821 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.469352  2786 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.471784  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.471984  2796 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.472828  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.473344  1683 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.473779  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:20.474686  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.474748  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.460098  2768 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.475749  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.474948  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.477166  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.472079  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.478928  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.452243  2826 consensus_queue.cc:1059] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:20.480342  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.465284  2733 raft_consensus.cc:697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:20.463217  2816 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:01:20.477397  2821 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.480100  2822 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.478758  2786 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.483996  1654 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.480144  2799 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.484050  2827 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.486902  2743 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.494623  2735 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.495086  2735 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.495262  1685 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.495941  2735 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.497334  2735 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.499680  2815 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.500974  2770 consensus_queue.cc:1059] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:20.502107  2770 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.502164  2732 consensus_queue.cc:1059] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:20.502525  2770 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:20.503525  2797 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.503338  2770 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.488132  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.488291  2742 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.504562  2742 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.504761  2770 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.505486  2742 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.482038  2825 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:20.506948  2742 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.507129  2825 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.509743  2826 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:20.510727  2825 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:20.510917  2826 raft_consensus.cc:3055] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.511261  2826 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.512094  2826 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.512923  2816 raft_consensus.cc:3055] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.513322  2826 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.513300  2816 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.515342  2816 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.486863  2818 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.503952  2797 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:01:20.507057  2824 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:01:20.526473  1625 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet 752aab0c230943e5a7d35d3d2ff9e555 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:01:20.527307  1625 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet 752aab0c230943e5a7d35d3d2ff9e555 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-752aab0c230943e5a7d35d3d2ff9e555
I20260709 13:01:20.528398  1685 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:20.529084  2733 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.525666  2804 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:20.534734  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.540807  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.541369  2364 raft_consensus.cc:1240] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.542585  2768 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.543015  2797 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.544486  2797 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.546854  2822 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.548856  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.549093  1611 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:20.549666  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.550002  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.551136  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.551229  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.551276  2794 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.553318  2788 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.553978  2788 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.554519  2788 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.555056  2804 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.556164  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.556207  2804 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.557264  2769 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.557708  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.559093  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:20.560637  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.561995  1580 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.563448  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:20.563764  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 44096.9us
W20260709 13:01:20.564859  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.566332  2687 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:20.568811  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.569989  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.570868  1609 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:20.568301  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.574120  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.576627  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.575256  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.554792  1625 tablet_copy_source_session.cc:215] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:20.574753  2767 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.592739  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:20.586480  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.589110  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.589574  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.596872  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.591135  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.598781  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.602171  1541 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:20.602584  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.565362  2804 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.564481  2794 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.608733  2687 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.575515  2827 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:20.573015  2743 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.613548  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.573410  2781 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.584167  2774 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.623152  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.543015  2329 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.572175  2796 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:01:20.588209  2735 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:20.598091  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.606513  2780 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.630420  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.580641  2828 consensus_queue.cc:1059] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:01:20.620707  2767 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.621666  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:20.628926  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.627310  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.638221  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.628306  2827 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.640326  2762 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.640937  2827 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.642059  2762 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.642706  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.644300  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.645421  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.649058  1534 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:20.650470  2762 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.650966  2781 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.651297  2721 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.652282  2808 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.653898  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.631054  2816 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.633756  2735 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.654808  2762 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.659973  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.663080  2735 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:20.659533  2808 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:01:20.669624  2821 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:01:20.670346  1607 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:20.672464  2818 raft_consensus.cc:3055] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.673007  2818 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.674786  2818 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.676415  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:20.677172  2721 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:20.677628  2721 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.678467  2721 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.636067  2801 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:20.691905  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:20.693476  1534 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:20.693161  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.693954  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:20.695544  1611 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:20.697137  1654 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.687222  2781 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.697937  2808 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.707353  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:20.709442  2743 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:01:20.659315  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 116395us
I20260709 13:01:20.700145  2767 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.701077  2818 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.730633  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:20.731581  1611 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:20.715466  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:20.732895  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:20.737192  1537 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:20.737898  2816 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:20.738400  2816 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:20.739591  2816 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.732999  2786 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:20.744455  2786 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.745754  2786 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.713409  2799 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:20.750905  1683 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:20.761408  1533 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:20.761545  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.732882  2329 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:20.773996  2801 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:20.774161  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50183us
I20260709 13:01:20.774804  2822 raft_consensus.cc:3055] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.775233  2822 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.796497  2817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752aab0c230943e5a7d35d3d2ff9e555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:20.780786  2822 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.807363  2822 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.820420  1613 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:20.777275  2743 raft_consensus.cc:697] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:20.836990  2329 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.838112  2768 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.838312  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:20.834313  2821 consensus_queue.cc:1059] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:01:20.841975  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:20.842217  1537 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:20.842455  2742 raft_consensus.cc:3055] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.842796  2365 raft_consensus.cc:2393] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:20.842825  2742 raft_consensus.cc:740] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:20.844076  2742 consensus_queue.cc:260] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.845692  2742 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.840207  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:20.846716  2364 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:20.840847  2768 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:20.847071  1436 catalog_manager.cc:5697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 2, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.880373  2816 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.883682  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:20.883250  2743 consensus_queue.cc:237] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.890818  2768 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:20.897974  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:20.917860  1684 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:20.922549  1653 consensus_peers.cc:597] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a93cfc3bb7634fb1b78c60f120616d9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:20.919952  1534 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:20.933362  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 226110us
I20260709 13:01:20.900893  2742 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:20.939157  1611 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:20.946668  2834 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:20.947813  2834 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:20.948176  2834 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:20.948967  2834 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:20.923729  2762 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:20.940240  2742 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:20.950560  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:20.941568  2816 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:20.965283  2762 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:20.977242  2762 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:20.978108  2365 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:20.965266  2742 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:20.953109  1613 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:20.996424  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:20.973379  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:21.000231  2818 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:21.004364  2827 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:21.004730  2818 raft_consensus.cc:697] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:21.004861   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:21.004920  2827 raft_consensus.cc:697] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:21.005702  2818 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.006762  2827 consensus_queue.cc:237] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:21.003603  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.010855  2365 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:21.012152  1653 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:21.012955  2808 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:21.013317  2808 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.013662  2808 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.014457  2742 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.019349  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:21.020309  2365 raft_consensus.cc:2393] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:21.003824  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:21.023062  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:21.036233  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:21.027529  2742 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.032966  2721 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:21.043941  2840 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:21.056492  2721 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:21.046985  2786 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:01:21.074579  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:21.075279  1540 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:21.062491  2840 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:21.088773  2840 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:21.098737  2849 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.073s	user 0.003s	sys 0.000s
I20260709 13:01:21.100834  2834 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.083863  2721 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:21.085304  2817 tablet_copy_client.cc:806] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:21.117040  2817 tablet_copy_client.cc:670] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:21.119109  1686 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:21.124747  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:21.146440  1533 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:21.150590  1616 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.143945  1436 catalog_manager.cc:5697] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.139221  2817 tablet_copy_client.cc:538] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:21.152559  1436 catalog_manager.cc:5697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.155061  1436 catalog_manager.cc:5697] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.161717  2768 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:21.167922  1616 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.167479  1436 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.135358  2818 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:21.187857  1533 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.179920  2799 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:21.142310  2808 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.195631  1686 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:21.197355  2808 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.197608  2801 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:21.199009  2804 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:21.201014  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:21.201691  2365 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.207181  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:21.207839  1534 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.207670  1538 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:21.218104  1534 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:21.219390  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:21.221741  1532 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.217092  2818 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:21.225240  2799 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:21.249256  2804 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.229903  2808 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:21.260921  2804 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.269906  1538 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.278529  2818 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.281132  1532 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.262509  2799 raft_consensus.cc:697] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:21.294926  1533 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.331492  2804 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.339545  1616 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.344071  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:21.345017  1538 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:21.321542  2794 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:21.325608  2743 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:01:21.341104  2808 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:01:21.349967  2799 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.360831  2839 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:21.366025  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:21.343268  2774 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.350890  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.370136  2364 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:21.375988  2786 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:21.371563  2760 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:21.378762  2760 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.379174  2760 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.385406  2817 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:21.390625  2365 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:21.372169  2774 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.405906  2774 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:21.407701  2855 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:01:21.415288  2864 ts_tablet_manager.cc:933] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:21.418859  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:21.421675  1616 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:21.458631  1613 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.462981  2788 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:21.476999  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.500731  2795 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:21.479866  2760 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.515650  1534 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.520534  1534 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.523675  2687 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:21.524430  2687 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.525250  1615 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:21.500450  2864 tablet_copy_client.cc:323] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:21.504225  2365 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:21.534534  2786 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:21.535878  1579 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:21.536707  2742 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:21.537151  2770 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:21.537693  2770 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.538093  2770 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.538154  2760 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.520324  2780 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.497838  2788 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.564807  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:21.566425  1684 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:21.568948  2687 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.550607  2804 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.579655  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.585466  2365 raft_consensus.cc:2393] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:21.589876  2788 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.581481  2804 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.593815  2804 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.557304  2780 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.595872  2780 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.601528  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:21.604571  1688 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:21.606338  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:21.608618  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.609654  2370 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:21.607105  1683 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:21.618286  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:21.605759  2780 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.619140  2742 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.621248  2818 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.623121  2742 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:21.636382  2370 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:21.637532  2742 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:21.641378  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:21.642052  2370 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.643055  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:21.643914  1686 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:21.633188  2781 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:21.647708  2781 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.647758  1504 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:21.648218  2781 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.621774  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.646729  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:21.649003  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:21.655040  1608 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:21.657497  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:21.674340  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.666700  2774 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:21.627750  2780 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.681492  2365 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:21.665622  2742 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:21.696023  2878 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:21.696226  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 48552.9us
I20260709 13:01:21.673270  2788 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:21.634044  2818 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:21.707270  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 164807us
I20260709 13:01:21.677265  2364 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:21.678496  2774 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:21.698338  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet a93cfc3bb7634fb1b78c60f120616d9d from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:21.702915  2788 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:21.699949  2878 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.729203  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:21.721818  2774 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.737272  2370 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:21.733217  1435 catalog_manager.cc:5697] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.702306  2742 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.745393  1613 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.727526  2788 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:21.730038  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet a93cfc3bb7634fb1b78c60f120616d9d from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-a93cfc3bb7634fb1b78c60f120616d9d
I20260709 13:01:21.753783  1653 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:21.728940  2878 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.734304  1615 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:21.740587  2879 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.758441  1435 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.758874  2879 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:21.714607  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "9d926c10b90f452ba52d80dab6a50351"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:01:21.747008  2799 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:21.760919  1435 catalog_manager.cc:5697] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.766589  1435 catalog_manager.cc:5697] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.764554  2799 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:21.772433  2799 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.776312  2780 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.789039  2872 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:21.789827  2872 raft_consensus.cc:697] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:21.791030  2872 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.801088  2839 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:21.801975  2818 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:21.809141  2742 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.768736  1435 catalog_manager.cc:5697] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:21.761816  2879 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:21.826941  1700 tablet_copy_source_session.cc:215] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:21.826822  2788 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:21.839953  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 107038us
I20260709 13:01:21.833706  2879 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:21.846321  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 145760us
I20260709 13:01:21.825477  2781 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.833384  2818 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 13:01:21.852639  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 120509us
W20260709 13:01:21.847988  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 126906us
I20260709 13:01:21.849232  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:21.859500  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.860361  2370 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:21.865000  1538 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.867728  1609 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.868793  1608 raft_consensus.cc:606] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Received request to transfer leadership to TS 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:21.869309  1608 raft_consensus.cc:614] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:21.869408  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:21.870131  1537 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.870787  2864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93cfc3bb7634fb1b78c60f120616d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:21.875140  2774 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.877496  2774 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.881932  2799 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.884495  2878 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:21.884642  2770 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.885111  2788 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.886066  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:21.886771  1539 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:21.853163  2882 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.896965  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:21.898132  2370 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:21.871431  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:21.847420  2879 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:21.913861  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:21.909505  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:21.917686  2370 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:21.918138  1540 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:21.913383  1607 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:21.908790  2882 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:21.939414  2882 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:21.933073  2885 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:21.942250  2885 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.944836  2781 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.947043  2879 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:21.910589  2799 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.912642  2875 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.948457  2875 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.949309  2768 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.950058  2768 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:21.950862  2875 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:21.951978  2760 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:21.953101  2770 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:21.953150  2364 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:21.930596  1684 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:21.912163  2878 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:21.957110  2795 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:21.906052  2721 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:01:21.977746  2370 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:21.984676  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:21.985659  1615 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:21.987303  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:21.985411  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:21.991487  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.007364  2839 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:22.007568  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:22.008793  1612 raft_consensus.cc:2368] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:22.010859  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:22.011523  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.012707  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:22.011511  1609 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:22.013465  1532 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.014657  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.015709  2884 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:22.016188  2884 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.005291  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:22.016593  2884 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.017800  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:22.018499  1609 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:22.021739  1539 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.021623  1538 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:22.022596  1505 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.008499  2839 raft_consensus.cc:697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:22.017733  2774 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.017524  2880 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:22.043006  2768 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.021803  2879 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:22.047353  1505 leader_election.cc:400] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:22.055886  1505 leader_election.cc:403] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:22.059226  2882 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.059839  2882 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.062088  2882 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.063580  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:22.065707  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:22.066552  1609 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:22.068271  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.083139  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:22.039266  2878 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:22.084002  1615 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.092178  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:22.096966  1682 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.085487  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:22.086411  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:22.099864  2370 raft_consensus.cc:2393] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:22.109900  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:22.119438  2370 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.048748  2880 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.038230  2885 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:22.158957  1538 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:22.066434  2879 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.107381  1683 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:01:22.172385  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:22.201776  1539 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.044905  2833 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 13:01:22.064672  2774 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.094933  2878 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.076591  2808 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.202930  2885 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:22.212306  1615 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:22.071398  2882 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.111050  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:22.163946  2880 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.222661  2370 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:22.201078  2879 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.204363  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:22.230311  1686 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:22.176973  2760 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.193439  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:22.179563  1532 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:22.256114  2878 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.246837  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:22.295491  2769 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:22.296413  1579 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71e3bb6ac3eb408ba9c57b48de886d65. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:22.296207  2769 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:22.296900  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 197610us
I20260709 13:01:22.298318  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.298833  2769 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:22.301759  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:22.301841  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:22.302796  1686 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:22.271199  2885 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.310721  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:22.310887  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:22.311571  1690 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:22.312084  2370 raft_consensus.cc:2393] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:22.313149  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:22.313915  1688 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:22.286985  2818 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:22.322842  1686 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:22.266471  2808 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.333369  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:22.308682  2368 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.344024  2687 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:22.255610  2839 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.313515  2885 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.329991  2365 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:22.347663  2687 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:22.312906  2781 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:22.282719  2882 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.357543  2882 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.340292  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.313277  2887 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.360185  2887 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.292141  2760 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.329525  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:22.373416  1683 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.308187  2795 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:22.376781  1539 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:22.380414  2687 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.384852  2774 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.375435  2884 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:22.415022  2867 log.cc:927] Time spent T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:01:22.425143  2367 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:22.406144  2774 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:22.404779  2781 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:22.390501  2881 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:01:22.442346  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:22.445086  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:22.445808  2774 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:22.434345  2875 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:22.467298  1537 consensus_meta.cc:287] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.597s	user 0.008s	sys 0.005s
I20260709 13:01:22.447669  2781 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.499047  2774 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.476621  2875 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.507727  2887 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.512303  2899 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.474385  2760 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:22.492334  2365 raft_consensus.cc:2368] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:22.483302  1537 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:22.541338  2899 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.541505  2880 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:22.493343  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51130.5us
I20260709 13:01:22.546905  2808 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:22.548260  2890 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:22.549276  2891 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.570426  2891 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.549685  2875 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.560695  1682 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:22.533846  2818 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.567529  2899 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:22.569568  2880 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:22.642261  2368 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:22.648581  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:22.589429  2890 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.623968  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:22.572796  2891 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:22.661367  2875 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.636981  2884 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.667855  1683 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:22.681425  2881 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.654115  2885 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.572350  2879 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.562486  2887 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.735082  2887 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.736207  2884 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:22.736756  2884 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.737375  2887 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.564411  1684 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
W20260709 13:01:22.690260  2817 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.053s	sys 0.092s
I20260709 13:01:22.738755  2884 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:22.691077  2742 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.019s	sys 0.023s
I20260709 13:01:22.490075  2878 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.608215  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:22.691509  2901 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:22.692988  2902 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:22.693679  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 389623us
I20260709 13:01:22.695113  1504 leader_election.cc:400] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:22.696650  2864 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53388 (request call id 231) took 1342 ms. Trace:
W20260709 13:01:22.697880  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 357708us
I20260709 13:01:22.826228  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.719034  2367 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:22.720295  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:22.827929  1682 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:22.723592  2899 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.724499  2808 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.800012  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:22.832412  1686 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:22.801079  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:22.802129  1608 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
W20260709 13:01:22.762957  2817 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.053s	sys 0.092s
I20260709 13:01:22.820662  1504 leader_election.cc:403] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:22.830684  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:22.825218  2364 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.836220  1579 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:22.794682  2795 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:22.808679  2792 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.727202  2875 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.841388  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:22.850555  1539 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:22.844822  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:22.823515  2781 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.846468  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:22.853391  1536 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:22.823081  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:22.723304  2818 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:22.849262  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 154339us
I20260709 13:01:22.898552  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:22.899016  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:22.899950  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:22.900583  1611 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.901576  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:22.851277  1579 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:22.851501  1538 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.852097  2687 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:22.903707  2687 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.904238  2687 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.908756  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:22.809319  2884 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:01:22.909675  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:22.914876  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 63720us
I20260709 13:01:22.838215  2768 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:22.829747  2902 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.740073  2881 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.845981  2808 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.841482  2899 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.843513  2365 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:22.844434  2774 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:22.921527  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:22.825182  2864 rpcz_store.cc:276] 0709 13:01:21.354589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.354835 (+   246us) service_pool.cc:224] Handling call
0709 13:01:21.415814 (+ 60979us) ts_tablet_manager.cc:934] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
0709 13:01:21.847756 (+431942us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:22.451988 (+604232us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:22.465037 (+ 13049us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:22.693493 (+228456us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:22.696059 (+  2566us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:22.696457 (+   398us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:22.696552 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":12596,"tablet-copy.queue_time_us":59757,"thread_start_us":65058,"threads_started":2}
I20260709 13:01:22.902096  2742 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.929710  1611 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:22.847757  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:22.935060  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:22.973661  1612 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:22.973830  1682 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:22.934278  1538 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:22.847676  2792 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.849488  2905 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.979202  2863 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.979008  2905 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.979822  2863 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:22.950532  2687 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.924374  2770 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:22.981383  2770 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:22.981809  2770 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:22.982034  2863 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.928398  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:22.979058  2916 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:22.983359  1533 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:22.925128  2368 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:22.825525  2901 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.985672  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1224) took 1121 ms. Trace:
I20260709 13:01:22.954263  1535 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:22.853188  2795 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.982579  2687 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:22.983619  2898 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:01:22.908779  2781 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:22.971927  2915 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:22.968798  2885 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:22.986092  1614 rpcz_store.cc:276] 0709 13:01:21.864397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.864514 (+   117us) service_pool.cc:224] Handling call
0709 13:01:21.864825 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:22.348934 (+484109us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:22.348962 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:22.370580 (+ 21618us) log.cc:844] Serialized 26 byte log entry
0709 13:01:22.761149 (+390569us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:22.761210 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.761311 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:22.985426 (+224115us) raft_consensus.cc:1685] finished
0709 13:01:22.985454 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:22.985590 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23218,"raft.queue_time_us":36145,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6625,"thread_start_us":850511,"threads_started":2,"wal-append.queue_time_us":482785}
I20260709 13:01:23.025908  1615 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:22.973093  2774 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:23.031216  1689 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:22.985672  2844 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:01:23.036425  2885 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:23.000447  1537 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:23.024690  2887 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:22.983731  2916 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:23.039793  2884 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:23.038321  2774 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:23.047816  2915 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:23.046109  2906 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:23.072513  2878 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.072345  2890 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:23.086774  2879 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.163897  2915 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.165760  2916 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:23.166920  2916 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:23.167392  2916 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.149106  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1233) took 1181 ms. Trace:
W20260709 13:01:23.156874  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 69205.1us
I20260709 13:01:23.053525  2887 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:23.094031  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 172604us
I20260709 13:01:23.174479  2328 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:23.175359  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:23.176555  2368 raft_consensus.cc:2393] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:23.178066  2923 ts_tablet_manager.cc:933] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:23.178426  2365 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:23.095153  2875 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:23.197028  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 251947us
W20260709 13:01:23.184247  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 272769us
W20260709 13:01:23.189795  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 247910us
I20260709 13:01:23.169713  1613 rpcz_store.cc:276] 0709 13:01:21.967473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.969171 (+  1698us) service_pool.cc:224] Handling call
0709 13:01:21.969554 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:21.969950 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:21.969987 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:22.013734 (+ 43747us) log.cc:844] Serialized 26 byte log entry
0709 13:01:22.475073 (+461339us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:22.475135 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:22.475240 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:23.096333 (+621093us) raft_consensus.cc:1685] finished
0709 13:01:23.148823 (+ 52490us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:23.149028 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6108,"raft.queue_time_us":3012,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":15079,"thread_start_us":430305,"threads_started":1,"wal-append.queue_time_us":653326}
I20260709 13:01:23.066942  2742 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.205758  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:23.206575  1686 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:23.190913  2781 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.192629  2795 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:23.193740  2913 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:01:23.095654  2883 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.260200  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:23.194315  2808 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:23.172122  2887 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.178772  2687 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:23.167788  2916 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.208388  1688 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:01:23.209744  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:23.210173  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:23.275866  1682 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:23.211737  1690 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:23.259723  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:23.277344  1615 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:23.261037  1538 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:23.279543  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:23.266132  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:23.281690  1539 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:23.280889  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:23.283545  2928 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.291786  1538 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:23.293912  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:01:23.239620  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 329454us
I20260709 13:01:23.295475  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:23.299372  1681 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.301005  1580 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:23.240600  2839 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:01:23.261062  2799 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:01:23.295082  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:23.296218  2881 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.306527  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:23.314065  2899 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.329267  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:23.306022  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 131626us
I20260709 13:01:23.331491  1685 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:23.313097  2364 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:23.333195  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:23.315196  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:23.335150  1685 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.339295  1607 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:23.339356  2889 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:23.339601  2929 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.340314  2929 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:23.350907  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:23.348986  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:23.332334  1683 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.327845  1687 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:23.351673  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:23.425028  1610 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:23.430684  2742 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.431458  2927 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:23.431975  2927 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.432420  2927 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.338857  2923 tablet_copy_client.cc:323] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
W20260709 13:01:23.355026  2912 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:01:23.340819  2872 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.483928  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:23.342259  2889 raft_consensus.cc:697] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:23.509323  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:23.435356  2817 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:01:23.499607  2907 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.277071  2883 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.510223  1686 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.484576  2899 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.309448  2928 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.486557  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:23.469487  2742 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.559192  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:23.725903  1615 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 1.
I20260709 13:01:23.567152  1681 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:23.721238  1685 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
W20260709 13:01:23.684544  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 83650.1us
I20260709 13:01:23.605604  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:23.564606  2917 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.489s	user 0.004s	sys 0.000s
I20260709 13:01:23.750185  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:23.750918  1537 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
W20260709 13:01:23.653700  2817 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:23.725395  2742 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.555204  1607 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:23.487300  2878 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.767724  2329 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:23.761359  2364 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:23.511165  2879 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.569873  2929 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.723552  2901 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.792771  2879 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.793648  2901 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.794142  2901 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.795130  2879 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.795681  2879 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.553681  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:23.605481  2936 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:23.520678  2884 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:23.520062  2921 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.824944  2924 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:23.791304  2909 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:23.805828  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:23.744735  2899 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.792050  1686 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:23.823909  2936 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.806263  2879 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.805369  2901 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:23.830364  2770 consensus_meta.cc:287] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.848s	user 0.012s	sys 0.005s
I20260709 13:01:23.510766  2872 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.845295  2817 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:23.825645  2924 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:23.867252  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.022s	sys 0.025s
W20260709 13:01:23.865921  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.025s	sys 0.023s
I20260709 13:01:23.866748  2932 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.875589  2931 raft_consensus.cc:2804] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:23.876291  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.023s	sys 0.025s
W20260709 13:01:23.874783  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.026s	sys 0.023s
W20260709 13:01:23.877584  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 634941us
I20260709 13:01:23.878562  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:23.787947  2878 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.876096  2879 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.784965  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:23.885429  1681 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:23.872195  2937 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:23.887264  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.013s	sys 0.003s
I20260709 13:01:23.898168  2795 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:23.962821  2795 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.762494  2907 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:23.876688  2770 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:23.888337  2881 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.875957  2817 tablet_bootstrap.cc:492] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:23.790417  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:23.824314  2884 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:23.867632  2936 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:23.963267  2883 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.875496  2932 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:23.963759  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.003s
I20260709 13:01:23.907485  2899 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.889722  2931 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:23.976073  2928 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:23.976608  2864 tablet_copy_client.cc:806] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:23.980805  2879 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:23.916531  2804 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.010s
I20260709 13:01:23.569144  2889 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.013652  1616 raft_consensus.cc:2393] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:23.915323  1683 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:23.915658  1684 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:23.845809  2909 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:24.026415  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.038s	sys 0.047s
W20260709 13:01:24.028488  1506 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.008s	sys 0.019s
I20260709 13:01:24.005237  2901 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:23.843961  2921 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.017944  2931 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:24.035810  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.038s	sys 0.048s
W20260709 13:01:24.027038  2804 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.003s	sys 0.010s
I20260709 13:01:24.016894  2883 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.018785  2906 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.034878  2817 ts_tablet_manager.cc:1403] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 2.647s	user 0.085s	sys 0.117s
W20260709 13:01:24.049947  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 548624us
I20260709 13:01:23.984853  2881 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.028066  2928 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.031958  2864 tablet_copy_client.cc:670] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:24.055208  1685 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
W20260709 13:01:24.047030  2935 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
W20260709 13:01:24.050997  2916 consensus_meta.cc:287] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.755s	user 0.012s	sys 0.001s
I20260709 13:01:23.983448  2937 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.061002  2924 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:24.061064  2944 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:24.062974  2881 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.053032  2742 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.029204  2879 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.067433  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:24.052336  2899 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.057963  2883 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:24.050635  2901 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.084951  2882 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.096460  2932 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.095841  2882 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.059734  2928 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.088054  2760 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:24.103637  2882 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.107182  2882 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.108374  2882 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.109596  2905 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.110229  2905 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.067569  2916 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.110716  2905 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.112417  2916 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.112833  2760 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.113248  2371 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:01:24.113509  2760 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.114665  2882 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.090425  1687 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.091192  2742 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.093144  2878 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.121527  2907 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.128695  2937 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:24.093823  2899 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.091786  2944 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.123287  2742 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:24.132593  2938 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.303s	user 0.001s	sys 0.001s
I20260709 13:01:24.056756  2906 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.098441  2951 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.164374  2742 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.139753  2944 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:24.140236  2795 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:24.153322  2921 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.155493  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1217) took 1358 ms. Trace:
I20260709 13:01:24.153383  1504 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:24.155171  2936 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.162766  2884 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.133177  2770 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:24.138451  2872 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:24.157526  2901 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.162263  2928 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.164414  2931 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.177969  2905 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:24.178382  2936 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.197710  2817 raft_consensus.cc:359] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:24.198925  2817 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:24.199963  2817 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:24.201920  2818 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:24.168725  1684 rpcz_store.cc:276] 0709 13:01:22.796658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.808374 (+ 11716us) service_pool.cc:224] Handling call
0709 13:01:23.348765 (+540391us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:01:24.155192 (+806427us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b540015bb54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:24.155371 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299033728}
I20260709 13:01:24.178548  1435 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 182) took 2651 ms. Trace:
I20260709 13:01:24.179296  2879 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:24.182031  2927 consensus_meta.cc:287] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.749s	user 0.007s	sys 0.005s
I20260709 13:01:24.183245  1437 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:24.181952  2760 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.213238  2927 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.185927  1687 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:24.187461  2883 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.188107  2899 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.198082  2931 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:24.167273  2909 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:24.164659  2951 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.216535  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:24.216991  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1092) took 1311 ms (client timeout 1524 ms). Trace:
I20260709 13:01:24.204268  2817 ts_tablet_manager.cc:1434] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.144s	user 0.002s	sys 0.009s
I20260709 13:01:24.228914  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1223) took 1428 ms. Trace:
I20260709 13:01:24.231248  2368 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:24.235725  2370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 243) took 1169 ms. Trace:
I20260709 13:01:24.234280  1689 rpcz_store.cc:276] 0709 13:01:22.800773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.800876 (+   103us) service_pool.cc:224] Handling call
0709 13:01:24.228704 (+1427828us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540015c554. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:24.228832 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454846848}
W20260709 13:01:24.231431  1616 rpcz_store.cc:269] 0709 13:01:22.898961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.899455 (+   494us) service_pool.cc:224] Handling call
0709 13:01:24.209655 (+1310200us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003a2fd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:24.209881 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506390912}
I20260709 13:01:24.208124  1435 rpcz_store.cc:276] 0709 13:01:21.526921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.527111 (+   190us) service_pool.cc:224] Handling call
0709 13:01:24.178397 (+2651286us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:22.060485 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:22.061102 (+   617us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:22.061137 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:22.061158 (+    21us) tablet.cc:662] Decoding operations
0709 13:01:22.061866 (+   708us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:22.061953 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:22.061983 (+    30us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:01:22.177907 (+115924us) tablet.cc:701] Row locks acquired
0709 13:01:22.193980 (+ 16073us) write_op.cc:260] PREPARE: finished
0709 13:01:22.220646 (+ 26666us) write_op.cc:270] Start()
0709 13:01:22.259790 (+ 39144us) write_op.cc:276] Timestamp: P: 1783602082215070 usec, L: 0
0709 13:01:22.267216 (+  7426us) op_driver.cc:348] REPLICATION: starting
0709 13:01:22.377823 (+110607us) log.cc:844] Serialized 2142 byte log entry
0709 13:01:22.695070 (+317247us) op_driver.cc:464] REPLICATION: finished
0709 13:01:23.282825 (+587755us) write_op.cc:301] APPLY: starting
0709 13:01:23.297509 (+ 14684us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:23.321265 (+ 23756us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:23.329847 (+  8582us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:23.562645 (+232798us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:23.562874 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:01:23.562923 (+    49us) write_op.cc:312] APPLY: finished
0709 13:01:23.563209 (+   286us) log.cc:844] Serialized 46 byte log entry
0709 13:01:23.563416 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:23.563603 (+   187us) write_op.cc:454] Released schema lock
0709 13:01:23.563654 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:23.654284 (+ 90630us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:23.655663 (+  1379us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5556,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":506299,"apply.run_cpu_time_us":4569,"apply.run_wall_time_us":334542,"num_ops":5,"prepare.queue_time_us":215647,"prepare.run_cpu_time_us":6113,"prepare.run_wall_time_us":317700,"replication_time_us":427675,"thread_start_us":251282,"threads_started":2}]]}
I20260709 13:01:24.236513  2909 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.237107  2370 rpcz_store.cc:276] 0709 13:01:23.066900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.067242 (+   342us) service_pool.cc:224] Handling call
0709 13:01:23.095018 (+ 27776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.274917 (+179899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.274954 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.275399 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:01:23.324954 (+ 49555us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:23.324990 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:23.325057 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.235492 (+910435us) raft_consensus.cc:1685] finished
0709 13:01:24.235510 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.235642 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18215,"raft.queue_time_us":105120,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":23184,"thread_start_us":228545,"threads_started":2,"wal-append.queue_time_us":392577}
I20260709 13:01:24.242537  2906 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.243088  2792 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:24.248829  2927 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.218501  2760 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:24.258584  2951 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.259162  2902 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.253024  2909 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.260673  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1249) took 1419 ms. Trace:
I20260709 13:01:24.261762  2909 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:24.262569  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 88) took 1600 ms. Trace:
I20260709 13:01:24.262990  1436 rpcz_store.cc:276] 0709 13:01:22.662171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.662426 (+   255us) service_pool.cc:224] Handling call
0709 13:01:24.262454 (+1600028us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:01:24.265933  2944 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.261124  1540 rpcz_store.cc:276] 0709 13:01:22.841158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.843663 (+  2505us) service_pool.cc:224] Handling call
0709 13:01:22.848261 (+  4598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:23.080617 (+232356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:23.080654 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:23.273517 (+192863us) log.cc:844] Serialized 506 byte log entry
0709 13:01:24.008959 (+735442us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:24.009028 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.256905 (+247877us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001df6d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:24.256968 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:24.257028 (+    60us) raft_consensus.cc:1685] finished
0709 13:01:24.257045 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:24.260569 (+  3524us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320076544,"thread_start_us":702756,"threads_started":1,"wal-append.queue_time_us":603134}
W20260709 13:01:24.273635  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 120338us
I20260709 13:01:24.277230  2884 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:24.277431  2939 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.277945  2884 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.278211  2939 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.278816  2884 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.280413  1625 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet 71e3bb6ac3eb408ba9c57b48de886d65 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:01:24.281265  1625 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet 71e3bb6ac3eb408ba9c57b48de886d65 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-71e3bb6ac3eb408ba9c57b48de886d65
I20260709 13:01:24.281670  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:24.284628  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:24.285512  1616 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.289376  1626 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-752aab0c230943e5a7d35d3d2ff9e555 received from {username='slave'} at 127.0.0.1:57944
I20260709 13:01:24.289965  1626 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-752aab0c230943e5a7d35d3d2ff9e555 on tablet 752aab0c230943e5a7d35d3d2ff9e555 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:24.291505  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:24.292594  2370 raft_consensus.cc:2393] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:24.292870  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:24.293627  1608 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.295594  1504 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:24.297394  1504 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:24.299348  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 420922us
I20260709 13:01:24.310581  2890 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:24.310751  2371 raft_consensus.cc:1217] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:24.311825  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:24.312779  2368 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.317005  2788 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:24.320459  2788 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:24.322567  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:24.323486  2788 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:24.323999  2788 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.324498  2788 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.332542  1579 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:24.333330  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 96578.7us
I20260709 13:01:24.337549  2788 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.341117  2788 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.343761  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1066) took 1123 ms. Trace:
I20260709 13:01:24.344702  1687 rpcz_store.cc:276] 0709 13:01:23.220118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.512236 (+292118us) service_pool.cc:224] Handling call
0709 13:01:24.343440 (+831204us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54000d4dd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:24.343659 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520715136}
I20260709 13:01:24.360569  2370 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:01:24.350075  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52767.3us
I20260709 13:01:24.364825  1504 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:24.352387  2774 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.051s	sys 0.106s
I20260709 13:01:24.352671  2958 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:24.352851  2743 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.016s	sys 0.040s
W20260709 13:01:24.353201  2904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.009s	sys 0.025s
I20260709 13:01:24.358807  1653 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:24.273476  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 403649us
I20260709 13:01:24.397397  1616 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:24.402698  1608 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:24.299340  2885 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:24.398912  1504 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:24.405548  2943 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.405126  2788 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:01:24.358848  2951 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.358584  2906 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.359302  2902 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:24.748937  2906 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.728505  2945 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.750573  2945 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.751370  2957 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:24.751809  2904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.012s	sys 0.041s
I20260709 13:01:24.752132  2957 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.754413  2902 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:24.754751  2957 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:24.756975  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 358176us
I20260709 13:01:24.757364  2915 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:24.758350  2818 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:24.759210  2818 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:24.694650  1507 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.050s	sys 0.071s
W20260709 13:01:24.761385  1507 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.055s	sys 0.072s
I20260709 13:01:24.524020  2880 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.762305  2880 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.762708  2948 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.763275  2948 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.561008  2792 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.765041  2792 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.765529  2948 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:24.440616  2927 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.767592  2792 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:24.768366  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 409656us
I20260709 13:01:24.769052  2329 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:24.769945  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.770519  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.770675  1687 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:24.771291  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.771514  1685 raft_consensus.cc:2410] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:24.773424  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:24.774716  2743 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.018s	sys 0.063s
I20260709 13:01:24.774875  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.444366  2932 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:24.627516  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.051s
W20260709 13:01:24.408663  2774 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.051s	sys 0.107s
W20260709 13:01:24.787001  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.006s	sys 0.058s
I20260709 13:01:24.446949  2953 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:24.626111  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.324s	user 0.012s	sys 0.074s
W20260709 13:01:24.788393  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.486s	user 0.018s	sys 0.077s
W20260709 13:01:24.788827  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 1.48791e+06us
I20260709 13:01:24.789512  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:24.768608  2948 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:24.767261  2927 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.795635  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:24.761479  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.004s	sys 0.006s
I20260709 13:01:24.784502  2329 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:24.786471  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:24.797449  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.004s	sys 0.006s
W20260709 13:01:24.760730  1437 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.009s
I20260709 13:01:24.755683  2902 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.759999  2915 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:01:24.797894  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 706642us
W20260709 13:01:24.761308  2889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.005s
I20260709 13:01:24.759560  2944 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:24.837955  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:24.790104  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.776024  2885 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.434551  2950 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:24.563019  2939 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.818616  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.907857  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:24.439560  2941 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.802436  2916 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:24.760178  2883 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.825907  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.443466  2884 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.559703  2891 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:24.435452  2890 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:24.440832  2958 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:24.793174  2364 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.004s	sys 0.007s
I20260709 13:01:24.901645  2905 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.759543  2957 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:24.818359  1437 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.000s	sys 0.010s
I20260709 13:01:24.434392  2368 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:24.786501  2781 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.759699  2818 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.802423  2948 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:24.786914  2936 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.904235  1540 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:24.793466  2788 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:24.905056  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 120678us
W20260709 13:01:24.832162  2889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.005s	sys 0.006s
W20260709 13:01:24.759618  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.011s	sys 0.015s
I20260709 13:01:24.935786  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:01:24.936233  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.011s	sys 0.015s
I20260709 13:01:24.908648  1685 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:24.914955  2955 raft_consensus.cc:2804] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:24.901633  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 71773us
I20260709 13:01:24.821110  2878 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:24.913394  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.794131  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.829224  2774 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.776155  2943 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:24.829836  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:24.778474  2951 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.903031  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.834031  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.839922  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.840323  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.835085  2953 raft_consensus.cc:697] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:24.903402  2885 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.782292  2899 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:24.903605  2879 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:24.817654  2932 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.915275  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.921629  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.044130  1686 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:24.914062  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:25.045853  1538 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:24.912271  2939 raft_consensus.cc:2764] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:01:24.928498  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.051718  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:24.931865  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 142443us
W20260709 13:01:24.905511  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 141115us
I20260709 13:01:24.935279  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:24.939971  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:25.055053  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 119881us
I20260709 13:01:25.009347  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.010545  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:25.056576  1688 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.058063  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:24.919762  2364 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.004s	sys 0.007s
I20260709 13:01:25.026564  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:24.928372  2948 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.035511  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:24.908612  2944 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.923470  2880 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.930657  1579 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:25.074337  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 143751us
I20260709 13:01:25.051525  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.075395  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.052623  1686 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:24.998900  2788 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.025122  2889 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:24.904356  2945 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:24.927731  2781 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.062578  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.081885  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.082726  1616 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:25.018357  2878 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.071035  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:25.095192  2962 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:25.095325  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:25.097223  2904 raft_consensus.cc:2764] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:25.097982  2964 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.164s	user 0.002s	sys 0.000s
I20260709 13:01:25.097762  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:25.099923  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.100677  1685 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:25.072002  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:24.930847  2905 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.037426  2960 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.073238  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.102422  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:24.940284  2936 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.919795  2891 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.115561  2891 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.029116  2915 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.116537  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:25.073824  2687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.588s	user 0.015s	sys 0.024s
W20260709 13:01:25.119141  2687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.664s	user 0.016s	sys 0.024s
I20260709 13:01:25.119702  2687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57934 (request call id 6) took 3702 ms. Trace:
I20260709 13:01:25.120085  2687 rpcz_store.cc:276] 0709 13:01:21.417216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.417341 (+   125us) service_pool.cc:224] Handling call
0709 13:01:21.485164 (+ 67823us) log.cc:844] Serialized 506 byte log entry
0709 13:01:21.847192 (+362028us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b1800359020. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02ea61b0b 00007fd02eae6b63 00007fd02eb0e752 00007fd033aced29
0709 13:01:25.119607 (+3272415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147821,"raft.queue_time_us":185961,"raft.run_cpu_time_us":2375,"raft.run_wall_time_us":100813,"spinlock_wait_cycles":5767040,"thread_start_us":638060,"threads_started":2,"wal-append.queue_time_us":223050,"wal-append.run_cpu_time_us":5759,"wal-append.run_wall_time_us":1067997}
I20260709 13:01:25.075140  1579 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:25.122646  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:25.124286  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 49238.3us
I20260709 13:01:24.925140  2957 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.916350  2883 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:25.039556  2899 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:24.919868  2941 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:24.916227  2950 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:24.922123  2890 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:25.057654  2961 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:25.026293  2774 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.072592  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:25.101380  1612 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:25.076694  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.103178  1611 raft_consensus.cc:2393] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:25.067245  1538 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:25.106226  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.062016  2921 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:25.062980  2906 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.074551  2743 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:25.109369  2959 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
W20260709 13:01:25.109745  2968 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:01:25.099126  2943 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:25.110527  2951 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.111645  2781 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:25.112476  2965 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:01:25.079380  2944 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.099225  2904 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:25.051895  2879 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:25.071848  2929 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:25.099367  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.104841  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.100492  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:25.102670  2939 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:25.164520  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 67114.3us
I20260709 13:01:25.194689  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.305959  1685 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:25.202487  1688 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:25.306509  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:25.167520  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.099174  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1242) took 1842 ms. Trace:
I20260709 13:01:25.196883  2905 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.269294  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.165036  2973 raft_consensus.cc:1064] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:25.299352  1690 raft_consensus.cc:2368] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3.
I20260709 13:01:25.300930  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:25.334672  1682 raft_consensus.cc:606] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:25.201319  2936 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.325510  1689 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:25.335099  1540 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:25.206650  2942 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.136060  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:25.263741  2743 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.194980  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:25.154152  2938 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:01:25.073582  2958 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.202167  2878 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.136387  2927 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.154277  2974 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:25.203905  2818 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.100957  2889 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.164847  2960 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.333065  1690 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:25.324641  2939 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.365837  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.337312  2932 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:25.270793  2929 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.342013  2916 raft_consensus.cc:697] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:25.369413  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:25.382236  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.296416  2921 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.356630  2844 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:25.354583  2884 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:25.362506  2743 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.361222  2905 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.398644  1504 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:25.402416  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:25.411338  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 358487us
I20260709 13:01:25.286386  2961 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.397446  2939 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.154723  2953 consensus_queue.cc:237] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.415055  1504 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:25.393051  2974 raft_consensus.cc:697] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:25.405850  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.405426  2844 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.406091  2818 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:25.398589  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.524s (SENT)
I20260709 13:01:25.442704  1504 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:25.422827  2927 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:25.361413  2899 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:25.366497  2942 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.434230  2955 raft_consensus.cc:697] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:25.425535  2905 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:25.583506  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.539712  2370 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:01:25.738689  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.468525  2687 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:25.421375  2902 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:25.740546  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:25.740816  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:25.729876  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 423426us
I20260709 13:01:25.753814  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:25.808262  1615 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.487088  2948 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:25.809299  1682 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:01:25.620258  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 543702us
I20260709 13:01:25.810824  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:25.481817  2880 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.811810  2863 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:25.812319  2880 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.812563  2863 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:25.813280  2863 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.814324  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.815652  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.536731  2818 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:25.811017  2948 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:25.443279  2788 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.607692  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:25.817106  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.763832  1579 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:25.886622  1686 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:25.750332  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.826910  1612 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.453675  2844 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.857023  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:25.807076  2687 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.005998  1539 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:25.846405  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:25.936746  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 121445us
I20260709 13:01:26.007513  1690 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:26.008519  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.817619  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:25.988463  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 224758us
I20260709 13:01:26.009498  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.009640  1579 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:25.988318  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.799997  1611 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.009804  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.010473  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:25.842379  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.011432  1614 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:26.011528  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.011528  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.012427  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.929232  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:25.995679  1615 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:25.986555  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:25.482657  2943 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:25.483875  2941 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:26.014335  1540 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:25.476197  2946 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:25.695662  2879 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.016080  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:25.448974  2884 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.696408  2365 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:01:25.488897  2889 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.476554  2972 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:25.478609  1625 tablet_copy_source_session.cc:215] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:26.173511  2687 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.489311  2878 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:25.683940  2956 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:25.481841  2899 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.313578  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:25.742304  2915 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.017464  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.313799  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1092) took 1412 ms. Trace:
I20260709 13:01:26.392812  1685 rpcz_store.cc:276] 0709 13:01:24.901852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.331697 (+429845us) service_pool.cc:224] Handling call
0709 13:01:25.352749 (+ 21052us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.356839 (+  4090us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.356870 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.488108 (+131238us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b2c00142518. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:01:25.488494 (+   386us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.729353 (+240859us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:25.729396 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.729463 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.313508 (+584045us) raft_consensus.cc:1685] finished
0709 13:01:26.313525 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.313732 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3677,"raft.queue_time_us":23085,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8746,"spinlock_wait_cycles":4974976,"thread_start_us":240470,"threads_started":1,"wal-append.queue_time_us":766623}
I20260709 13:01:25.991799  2902 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.319636  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1249) took 1381 ms. Trace:
I20260709 13:01:26.327869  1612 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:26.302222  1611 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:26.199136  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1250) took 1135 ms. Trace:
I20260709 13:01:26.340775  1504 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:26.310973  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:26.070415  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 61322.4us
W20260709 13:01:26.398757  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58077.8us
I20260709 13:01:26.398952  1536 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:26.400676  1504 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:26.202672  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1257) took 1205 ms. Trace:
I20260709 13:01:26.312243  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.201484  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.402068  1534 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:26.268649  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:26.231488  2985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.022s	sys 0.025s
W20260709 13:01:26.353096  2904 consensus_meta.cc:287] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.082s	user 0.003s	sys 0.010s
I20260709 13:01:26.223788  2883 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.020720  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.588464  2932 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:25.480742  2927 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:25.488787  2916 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:25.738394  2929 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.486388  2890 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:25.744263  2960 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.404487  2902 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:25.737867  2975 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:25.478338  2961 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.738209  2774 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:25.719913  2364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 244) took 1514 ms. Trace:
I20260709 13:01:25.740597  2957 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:26.278291  2978 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.586s	user 0.001s	sys 0.000s
I20260709 13:01:26.302024  2936 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:25.884403  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:26.455238  2942 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:26.455753  2368 raft_consensus.cc:2393] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:26.457480  2939 consensus_meta.cc:287] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.011s	user 0.010s	sys 0.000s
I20260709 13:01:26.457768  2950 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.457926  2939 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:26.459125  2885 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.411s	user 0.010s	sys 0.000s
I20260709 13:01:26.437721  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:26.459511  2885 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.450167  2989 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:26.321847  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:26.460580  2989 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.461853  2885 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.462766  2989 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.463481  2939 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:26.310729  2992 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.296s	user 0.000s	sys 0.000s
I20260709 13:01:26.314118  2880 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.336175  2998 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:25.899410  2945 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.516s
I20260709 13:01:26.359086  2792 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.354668  2878 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:26.464830  2998 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:26.465268  2792 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.466027  2998 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:26.467556  2995 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:01:26.344494  2884 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:26.410964  2985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.027s	sys 0.029s
I20260709 13:01:26.052852  2921 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.353055  2972 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.416324  2879 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:26.406610  2977 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:26.425513  2904 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:26.433899  2927 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.164637  2943 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:25.690354  2974 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.453383  2936 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.439002  2948 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:26.449682  2975 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.154453  2973 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.480259  2977 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:26.490805  2977 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:26.498392  2988 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:01:26.404013  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:26.416880  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:26.531941  1505 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.001s	sys 0.009s
W20260709 13:01:26.379259  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.001s	sys 0.052s
W20260709 13:01:26.124166  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.405695  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.378652  1538 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:25.323896  1533 rpcz_store.cc:276] 0709 13:01:23.256453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:23.261328 (+  4875us) service_pool.cc:224] Handling call
0709 13:01:24.132639 (+871311us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800001298. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3eee 0000000000375939 00007fd033a571e0 00007fd033b200c4 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:01:24.136810 (+  4171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.137228 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.137257 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.176206 (+ 38949us) log.cc:844] Serialized 26 byte log entry
0709 13:01:24.936696 (+760490us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:24.936752 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:24.936834 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:25.097366 (+160532us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:01:25.098899 (+  1533us) raft_consensus.cc:1685] finished
0709 13:01:25.098943 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.099103 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":21078656,"thread_start_us":759846,"threads_started":1,"wal-append.queue_time_us":660555}
W20260709 13:01:26.533207  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.002s	sys 0.052s
I20260709 13:01:26.534968  1534 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:26.538662  1534 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:01:26.538453  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 134481us
I20260709 13:01:26.227274  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:26.415814  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:26.540879  1504 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:26.542436  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.008s
I20260709 13:01:26.409361  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:26.543071  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.000s	sys 0.008s
I20260709 13:01:26.269191  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:26.532760  1505 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.001s	sys 0.010s
I20260709 13:01:26.409281  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:26.543828  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 534309us
I20260709 13:01:26.016790  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.428340  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:25.922928  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.405359  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.571168  1611 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:26.450162  2364 rpcz_store.cc:276] 0709 13:01:24.205500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.206073 (+   573us) service_pool.cc:224] Handling call
0709 13:01:24.206492 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:24.206801 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:01:25.080273 (+873472us) log.cc:844] Serialized 14 byte log entry
0709 13:01:25.467879 (+387606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.538066 (+ 70187us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:25.589518 (+ 51452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.619680 (+ 30162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:25.687650 (+ 67970us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":713465,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":37689,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":1204247,"threads_started":2,"wal-append.queue_time_us":518242}
I20260709 13:01:26.572892  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:26.544425  1614 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:26.398069  1681 rpcz_store.cc:276] 0709 13:01:24.937993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.351326 (+413333us) service_pool.cc:224] Handling call
0709 13:01:25.351563 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.361376 (+  9813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.361412 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.364077 (+  2665us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.608918 (+244841us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:25.608955 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.609021 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.319331 (+710310us) raft_consensus.cc:1685] finished
0709 13:01:26.319361 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.319553 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4829,"raft.queue_time_us":5388,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6312,"thread_start_us":202199,"threads_started":1,"wal-append.queue_time_us":814282}
I20260709 13:01:26.553710  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.401605  1686 rpcz_store.cc:276] 0709 13:01:24.997150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.268914 (+271764us) service_pool.cc:224] Handling call
0709 13:01:26.202406 (+933492us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54000d66d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:26.202585 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292963200}
I20260709 13:01:26.544831  1625 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:57944 (request call id 41) took 2267 ms. Trace:
I20260709 13:01:26.290495  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1254) took 1351 ms. Trace:
I20260709 13:01:26.577811  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:25.986132  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 175346us
I20260709 13:01:25.817262  2818 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.578919  1613 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:26.579816  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:26.547494  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 1.14895e+06us
I20260709 13:01:26.581040  1607 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:26.549651  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.569507  2366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 249) took 1641 ms. Trace:
I20260709 13:01:26.577864  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.584822  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.398355  1682 rpcz_store.cc:276] 0709 13:01:24.938349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.355550 (+417201us) service_pool.cc:224] Handling call
0709 13:01:25.355921 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.809654 (+453733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.073435 (+263781us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400078d54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:26.073775 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1042260224}
I20260709 13:01:26.550630  1608 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
W20260709 13:01:26.571776  2743 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.146s	user 0.009s	sys 0.002s
I20260709 13:01:25.823495  2863 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.629911  2975 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.355219  2946 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.479275  2879 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:26.632266  2879 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.633548  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1096) took 1164 ms. Trace:
I20260709 13:01:26.634141  2946 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.635399  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.587986  2950 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:26.489094  2936 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.589461  2953 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:26.302768  2955 consensus_queue.cc:237] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.453691  2905 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.408913  2915 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.656194  2371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 147) took 1877 ms. Trace:
I20260709 13:01:26.490831  2948 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.578547  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.471024  2878 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.551337  1579 leader_election.cc:400] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3.
I20260709 13:01:26.591388  2990 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:26.547092  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.475497  2792 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:26.608472  2921 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.602337  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.578012  1687 rpcz_store.cc:276] 0709 13:01:24.939487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.434386 (+494899us) service_pool.cc:224] Handling call
0709 13:01:25.806228 (+371842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:25.925240 (+119012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.942713 (+ 17473us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:25.966382 (+ 23669us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:26.013609 (+ 47227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.121939 (+108330us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.268050 (+146111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:26.613790  2943 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:26.615540  3016 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:01:26.671147  2921 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.553246  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:26.673794  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 120990us
I20260709 13:01:26.674235  2921 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.674615  2879 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:26.675951  2972 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.676456  2792 raft_consensus.cc:2764] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:01:26.679065  1536 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:26.625391  2961 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:26.679557  2948 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.680135  2961 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:26.680788  2990 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.577226  1625 rpcz_store.cc:276] 0709 13:01:24.276315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.280206 (+  3891us) service_pool.cc:224] Handling call
0709 13:01:25.478215 (+1198009us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540030d754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb123f7 00007fd033aa8036 00007fd033ab1a3e 00007fd02b37527b 00007fd033ab19ba 00007fd033aacacc 00007fd033aa7c7b 00007fd033a9c8d1 00007fd032b504b4 00007fd032b50442
0709 13:01:26.543821 (+1065606us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862606208}
W20260709 13:01:26.621507  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 79205us
I20260709 13:01:26.688324  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:26.610564  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.585007  2366 rpcz_store.cc:276] 0709 13:01:24.927450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.931555 (+  4105us) service_pool.cc:224] Handling call
0709 13:01:24.937954 (+  6399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:24.938261 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:24.938289 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:24.938834 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.358256 (+419422us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:25.364742 (+  6486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:25.371968 (+  7226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.568598 (+1196630us) raft_consensus.cc:1685] finished
0709 13:01:26.568680 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.569155 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":397227,"threads_started":1,"wal-append.queue_time_us":509651}
I20260709 13:01:26.642935  1610 raft_consensus.cc:2393] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:26.471791  2884 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.695511  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.697022  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:26.646467  2953 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:26.648659  2370 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:26.692370  2961 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.634037  1612 rpcz_store.cc:276] 0709 13:01:25.469558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.753483 (+283925us) service_pool.cc:224] Handling call
0709 13:01:26.632999 (+879516us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b54002260d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:26.633302 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45262592}
I20260709 13:01:26.700925  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.701689  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.631059  2863 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.658736  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.659863  1579 leader_election.cc:403] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:26.704120  1685 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:26.704701  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 153813us
I20260709 13:01:26.668773  1681 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:26.706429  2998 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3.
I20260709 13:01:26.670905  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.672969  1534 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:26.702236  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:26.689041  1686 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:26.638281  2743 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.711149  1684 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:26.691628  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.693426  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.693723  2923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e3bb6ac3eb408ba9c57b48de886d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:26.693537  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.694329  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.698261  2953 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.667874  1609 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:26.710251  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.648566  2956 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:26.770540  2863 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.771435  2863 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.774053  2863 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:26.776139  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:26.656854  2371 rpcz_store.cc:276] 0709 13:01:24.778283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.778459 (+   176us) service_pool.cc:224] Handling call
0709 13:01:24.778778 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:25.077967 (+299189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:25.078006 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:25.126097 (+ 48091us) log.cc:844] Serialized 26 byte log entry
0709 13:01:25.545953 (+419856us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:25.545995 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.161775 (+615780us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54004f3b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:26.161852 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.655433 (+493581us) raft_consensus.cc:1685] finished
0709 13:01:26.655487 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.655922 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4949,"raft.queue_time_us":328637,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":5244,"spinlock_wait_cycles":675793152,"thread_start_us":345295,"threads_started":1,"wal-append.queue_time_us":1212139}
I20260709 13:01:26.713054  1682 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:26.752632  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.775267  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:26.781507  1681 raft_consensus.cc:2393] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:01:26.779325  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 72685.6us
I20260709 13:01:26.785534  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.788961  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:26.790920  3021 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
W20260709 13:01:26.757061  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 50718.7us
I20260709 13:01:26.796737  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.786667  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:26.791169  2367 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 247) took 1871 ms (client timeout 1622 ms). Trace:
W20260709 13:01:26.756680  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 53544.7us
I20260709 13:01:26.791872  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.765878  2927 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:26.798362  2367 rpcz_store.cc:269] 0709 13:01:24.920029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.920295 (+   266us) service_pool.cc:224] Handling call
0709 13:01:26.790688 (+1870393us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54004de254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:26.790946 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3826964736}
I20260709 13:01:26.810904  2936 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.810393  2927 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.765470  2944 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.816916  2932 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:26.817605  2932 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.818248  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1253) took 1017 ms. Trace:
I20260709 13:01:26.818734  1532 rpcz_store.cc:276] 0709 13:01:25.800718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.801594 (+   876us) service_pool.cc:224] Handling call
0709 13:01:25.801849 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:26.347340 (+545491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:26.347377 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:26.347844 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:01:26.620085 (+272241us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:26.620198 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:26.620288 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:26.817820 (+197532us) raft_consensus.cc:1685] finished
0709 13:01:26.817841 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:26.818077 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43812,"raft.queue_time_us":202752,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":107,"thread_start_us":444857,"threads_started":2,"wal-append.queue_time_us":264094}
I20260709 13:01:26.824191  1609 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:26.824939  2879 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.825516  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.826407  1610 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:26.827545  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.830384  2977 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.831434  2884 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.833316  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1101) took 1090 ms. Trace:
I20260709 13:01:26.833997  2884 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.833751  1614 rpcz_store.cc:276] 0709 13:01:25.742725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.012131 (+269406us) service_pool.cc:224] Handling call
0709 13:01:26.833084 (+820953us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b540009e054. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:26.833247 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1218730112}
W20260709 13:01:26.746798  1505 connection.cc:256] RPC call timeout handler was delayed by -1.2122944849999726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260709 13:01:26.838047  1505 connection.cc:256] RPC call timeout handler was delayed by -1.1699944850000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
W20260709 13:01:26.838409  1505 connection.cc:256] RPC call timeout handler was delayed by -1.1528944849999903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 13:01:26.838716  1505 connection.cc:256] RPC call timeout handler was delayed by -1.1087944849999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 13:01:26.838969  1505 connection.cc:256] RPC call timeout handler was delayed by -1.058394485000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:01:26.839222  1505 connection.cc:256] RPC call timeout handler was delayed by -1.0430944849999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 13:01:26.839468  1505 connection.cc:256] RPC call timeout handler was delayed by -1.038594484999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
I20260709 13:01:26.751714  2743 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:26.801465  2956 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:26.842485  1610 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:26.845045  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.815052  1683 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:26.850826  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.775267  2902 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.853963  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:26.867877  2864 tablet_copy_client.cc:538] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:26.868638  1612 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:26.909333  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.909713  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:26.910176  1612 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:26.911326  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.869066  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:26.870064  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.873380  2936 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.874908  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:26.922396  1686 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:26.876210  2905 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.876603  1608 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:26.877135  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.884868  2963 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:26.886137  2941 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:26.887593  2909 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:26.889910  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:26.890403  2878 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.909355  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.927498  2909 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:26.928646  2844 consensus_meta.cc:287] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.756s	user 0.015s	sys 0.002s
I20260709 13:01:26.928813  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:26.929790  2743 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:26.945535  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:26.850004  1607 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:26.940523  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:26.944015  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 50043.1us
I20260709 13:01:26.949813  1538 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:26.951638  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:26.952527  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:26.953624  1682 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:26.932142  2743 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:26.958668  1532 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:26.960681  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 86103.5us
I20260709 13:01:26.947710  2977 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.958554  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:26.963426  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:26.963718  2364 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:26.964291  2792 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:26.964389  3022 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:26.964891  2941 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:26.965394  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:26.960779  2915 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:26.966497  1533 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:26.967273  2941 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:26.967926  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.968864  1533 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:26.969056  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:26.969554  3022 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:26.969990  1535 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:26.970238  1541 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:26.971045  2963 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:26.972436  2899 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:26.973055  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:26.973354  2977 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:26.973651  2963 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:26.973812  2977 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:26.974514  1537 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:26.974337  2977 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.975793  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.974946  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:26.977200  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.978538  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.979235  2371 raft_consensus.cc:2410] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:26.969012  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:26.982185  1532 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:26.983307  3022 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:26.984082  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:26.984428  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:26.985244  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:26.987388  2743 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:26.987476  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:26.933137  2990 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.974296  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:26.990455  1504 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:26.995115  1541 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:26.998848  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:26.943663  2844 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.003611  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:27.004578  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1103) took 1261 ms. Trace:
I20260709 13:01:27.004758  1609 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:27.004974  1615 rpcz_store.cc:276] 0709 13:01:25.743175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.555256 (+812081us) service_pool.cc:224] Handling call
0709 13:01:27.003271 (+448015us) spinlock_profiling.cc:243] Waited 9.78 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:01:27.004519 (+  1248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22501248}
I20260709 13:01:26.993376  2909 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:27.009346  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.011996  2948 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.012496  2948 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:27.012619  2902 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.012991  2948 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.013701  2878 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:26.934329  2905 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:26.950527  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:26.964931  2792 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:27.015941  2792 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.016728  2915 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:27.014396  2944 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:27.017748  2944 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.018256  2944 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.019390  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.020651  1608 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:27.021796  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1261) took 1213 ms. Trace:
I20260709 13:01:27.009426  2909 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.024065  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.025569  1682 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:26.970018  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.022269  1535 rpcz_store.cc:276] 0709 13:01:25.807883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.855984 (+ 48101us) service_pool.cc:224] Handling call
0709 13:01:27.021518 (+1165534us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400067a54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:27.021709 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113173376}
I20260709 13:01:27.033913  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.025151  2909 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:27.019447  2844 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:27.039220  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.040720  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.041993  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.042516  1579 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:27.045001  2956 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:27.047501  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.048089  2963 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:27.048451  3020 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.052228  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.052366  3020 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:27.053007  3020 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.048471  1686 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.050192  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.053663  2915 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.053188  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.056062  2899 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:27.059564  2827 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.059700  2899 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.060113  2827 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:27.060410  2899 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.062904  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:27.063386  2990 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:27.065102  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:27.065901  1535 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:27.066699  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.067414  1535 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:27.068202  1532 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:27.050060  2909 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.074517  2905 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:27.077028  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:27.078034  2367 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:27.060592  2827 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.080870  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.081766  1541 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:27.083127  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.083839  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:01:27.084867  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 166350us
I20260709 13:01:27.088681  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.066601  2956 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.090231  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.091288  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.091312  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.096076  2973 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:27.093720  2972 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:27.099354  2942 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.089957  2905 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:27.102342  2905 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.102943  2932 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:27.097034  2977 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:27.105721  3026 log.cc:927] Time spent T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.151s	user 0.003s	sys 0.000s
I20260709 13:01:27.107034  2932 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:27.107805  2891 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.404s	user 0.005s	sys 0.014s
W20260709 13:01:27.108671  2891 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.499s	user 0.005s	sys 0.015s
I20260709 13:01:27.109871  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:27.111107  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.111253  2932 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:27.112551  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1251) took 2173 ms (client timeout 2029 ms). Trace:
W20260709 13:01:27.113109  1684 rpcz_store.cc:269] 0709 13:01:24.938631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:25.093199 (+154568us) service_pool.cc:224] Handling call
0709 13:01:27.112235 (+2019036us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400079754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:27.112462 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3104212224}
I20260709 13:01:27.113627  2953 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.116709  1505 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.117252  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:27.115029  2932 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:27.119288  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.114944  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:27.121402  2923 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46602 (request call id 139) took 4289 ms. Trace:
I20260709 13:01:27.102932  2905 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.123175  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.099570  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.121425  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 167) took 5240 ms. Trace:
I20260709 13:01:27.128635  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.125852  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:27.132699  1538 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:27.135008  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:27.136672  2878 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.102527  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.137646  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:27.137905  2972 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:27.126706  2953 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.100494  2973 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.140502  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:27.141737  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:27.144789  1541 raft_consensus.cc:2393] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:27.137807  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:27.100188  1533 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:27.121646  2977 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.154201  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:27.162184  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 84987.3us
I20260709 13:01:27.163497  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:27.159438  1538 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:27.159394  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.126336  2792 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.168576  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.166239  1535 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:27.151803  2972 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:27.155637  2973 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.155189  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:27.174218  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.175112  2963 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:27.176333  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.176146  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:27.162732  2915 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:27.158337  2948 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.185757  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:27.188782  1608 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:27.194521  2329 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.178087  2963 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.198935  1612 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.194747  1610 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:27.202541  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.195544  2977 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.197774  2844 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:27.210937  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:27.202647  2955 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:27.201308  2963 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.201141  3013 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:27.121868  2923 rpcz_store.cc:276] 0709 13:01:22.832140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:22.833087 (+   947us) service_pool.cc:224] Handling call
0709 13:01:23.178505 (+345418us) ts_tablet_manager.cc:934] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
0709 13:01:26.687652 (+3509147us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:26.871743 (+184091us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:26.871974 (+   231us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:27.098401 (+226427us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:27.120724 (+ 22323us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:27.121131 (+   407us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:27.121253 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":12110,"tablet-copy.queue_time_us":186615,"thread_start_us":210307,"threads_started":2}
W20260709 13:01:27.219626  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 49944.5us
I20260709 13:01:27.217792  2844 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.205696  2932 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:27.224232  2371 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.225548  1436 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:27.233836  1541 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.199949  2743 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.237330  2844 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.253759  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:27.254967  1536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
mode: GRACEFUL
new_leader_uuid: "9d926c10b90f452ba52d80dab6a50351"
 from {username='slave'} at 127.0.0.1:52590
I20260709 13:01:27.255705  1536 raft_consensus.cc:606] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Received request to transfer leadership to TS 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:27.241540  1653 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:27.220242  2899 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:27.256814  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 137979us
I20260709 13:01:27.258286  3012 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.258720  2899 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:27.219738  3013 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:27.261521  1536 raft_consensus.cc:614] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:27.249513  1615 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.249938  1436 catalog_manager.cc:5697] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:27.251562  3031 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:27.251232  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:27.281368  1536 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:27.252048  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:27.285728  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47147.1us
I20260709 13:01:27.286614  1536 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:27.247450  2366 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:27.263988  2990 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:27.288254  2915 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.260856  2972 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:27.272710  2371 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:27.219568  2955 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:27.291563  2955 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.273409  1540 raft_consensus.cc:2393] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:27.295326  1534 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:27.274462  2792 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:27.297801  1538 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:27.276196  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:27.260628  1533 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.279932  1532 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:27.281337  3027 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.108s	user 0.000s	sys 0.002s
I20260709 13:01:27.283525  2956 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:27.286561  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.263576  1535 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:27.275594  3013 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.300309  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.362339  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:27.363692  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.127040  1437 rpcz_store.cc:276] 0709 13:01:21.880978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.881161 (+   183us) service_pool.cc:224] Handling call
0709 13:01:27.116157 (+5234996us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:25.120110 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:25.120755 (+   645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:25.120792 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:01:25.120810 (+    18us) tablet.cc:662] Decoding operations
0709 13:01:25.121177 (+   367us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:25.121234 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:25.121263 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:25.121453 (+   190us) tablet.cc:701] Row locks acquired
0709 13:01:25.121472 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:25.121622 (+   150us) write_op.cc:270] Start()
0709 13:01:25.121744 (+   122us) write_op.cc:276] Timestamp: P: 1783602085121575 usec, L: 0
0709 13:01:25.121766 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:01:25.122533 (+   767us) log.cc:844] Serialized 535 byte log entry
0709 13:01:26.456721 (+1334188us) op_driver.cc:464] REPLICATION: finished
0709 13:01:26.500481 (+ 43760us) write_op.cc:301] APPLY: starting
0709 13:01:26.501242 (+   761us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:26.501395 (+   153us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:26.501572 (+   177us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:26.501874 (+   302us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:26.502031 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:26.502073 (+    42us) write_op.cc:312] APPLY: finished
0709 13:01:26.502319 (+   246us) log.cc:844] Serialized 22 byte log entry
0709 13:01:26.502543 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:26.502609 (+    66us) write_op.cc:454] Released schema lock
0709 13:01:26.502638 (+    29us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:26.828169 (+325531us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:26.828245 (+    76us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16185,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":43481,"apply.run_cpu_time_us":2434,"apply.run_wall_time_us":182921,"num_ops":1,"prepare.queue_time_us":856628,"prepare.run_cpu_time_us":32622,"prepare.run_wall_time_us":361957,"raft.queue_time_us":752516,"raft.run_cpu_time_us":10223,"raft.run_wall_time_us":38746,"replication_time_us":1334798,"thread_start_us":1823679,"threads_started":4,"wal-append.queue_time_us":361754}]]}
I20260709 13:01:27.382054  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.340224  2923 tablet_copy_client.cc:806] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
W20260709 13:01:27.384833  3032 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:01:27.407019  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 169520us
I20260709 13:01:27.390530  2981 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.377688  3022 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:27.408964  2958 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.703s	user 0.024s	sys 0.019s
I20260709 13:01:27.390831  2948 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:27.387533  2990 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:27.421268  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:01:27.417366  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 159464us
I20260709 13:01:27.429191  1653 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:27.431056  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 144602us
W20260709 13:01:27.418692  2958 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.727s	user 0.024s	sys 0.019s
I20260709 13:01:27.418102  2953 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.462067  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.472733  1536 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.453821  2953 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:27.464293  2923 tablet_copy_client.cc:670] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:27.488600  2370 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:27.492352  2774 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:01:27.501367  2944 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.504226  1609 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:27.504565  2743 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:27.488503  2953 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.476341  3000 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:27.472929  2864 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:27.514855  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.488590  2977 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.527915  1541 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
W20260709 13:01:27.523075  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 93969.5us
I20260709 13:01:27.504017  2944 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.499574  2905 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:27.533183  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.535120  2953 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.536796  2899 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.541590  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:27.541680  3020 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.542265  2878 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:27.519997  2941 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:27.551421  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 94052.8us
I20260709 13:01:27.511849  2909 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.577553  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:01:27.578540  1613 raft_consensus.cc:606] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:27.517377  2963 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.555670  2915 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:01:27.581707  2977 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.590318  2899 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:27.577939  2932 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:01:27.643558  2899 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:27.644098  2899 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:27.644894  3000 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:27.645514  3000 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.647750  3000 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.632695  2941 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:27.640815  2923 tablet_copy_client.cc:538] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:01:27.637943  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 104851us
I20260709 13:01:27.658595  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:27.661629  2909 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:27.662734  2981 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:27.663693  2953 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.665336  2905 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:27.666429  2955 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:27.666863  3020 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:27.668393  2963 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:27.669040  2827 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.004s
I20260709 13:01:27.577430  2973 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.590554  2844 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.636906  2977 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:27.672688  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:27.673269  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:27.675038  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "9d926c10b90f452ba52d80dab6a50351"
 from {username='slave'} at 127.0.0.1:45544
W20260709 13:01:27.676255  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 118948us
I20260709 13:01:27.691154  2944 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:27.718292  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.704486  2977 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.719776  1682 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:27.724172  3000 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.724743  3000 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.726039  2956 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:27.708515  1616 raft_consensus.cc:606] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Received request to transfer leadership to TS 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:27.714287  2990 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:27.696461  2827 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.717962  2364 raft_consensus.cc:1240] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:27.722471  2972 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:27.754045  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 212541us
I20260709 13:01:27.749698  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.727702  3000 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.758991  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.711717  3013 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.716646  2963 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:27.740803  2944 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:27.766014  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.748209  2905 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:27.782071  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:27.784484  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:27.785272  2363 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:27.788823  2899 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:27.790656  2371 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:27.783628  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:27.799616  3046 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:01:27.765012  2990 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:27.808636  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:27.970820  1532 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:27.971304  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:27.860554  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 56854.2us
I20260709 13:01:27.973272  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:27.970472  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:01:27.861693  2944 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.779460  2905 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:27.854768  2844 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:28.013989  2905 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.954838  3052 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.014784  3052 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:28.015206  3052 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:27.815224  2963 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.018837  2963 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:27.814005  3012 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:28.020383  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 236903us
I20260709 13:01:27.814787  3000 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.208s
I20260709 13:01:28.022203  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.022732  3000 consensus_queue.cc:1243] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer 9d926c10b90f452ba52d80dab6a50351 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:01:28.023361  3000 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:28.023676  3000 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:28.024715  3049 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:01:28.024874  3000 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.026567  3000 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.024720  2990 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:28.028179  3012 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:28.029067  3047 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:01:28.030514  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 58219.3us
I20260709 13:01:28.043351  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:28.044052  1538 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:28.034052  2367 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:01:28.046499  1504 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:28.035848  1616 raft_consensus.cc:606] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
W20260709 13:01:27.847013  3032 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:01:28.049139  1616 raft_consensus.cc:614] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:27.855000  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:27.853055  2366 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:28.052810  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 79678.2us
I20260709 13:01:27.843649  3038 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.820194  2915 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:27.802750  2899 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:27.853752  2955 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:27.909483  2878 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.063340  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:27.870903  3013 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:28.067056  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.069861  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:28.042078  3053 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.053035  2953 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:28.072947  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:28.075786   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:28.075233  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.064349  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.036245  2956 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:01:28.111677  1686 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:01:28.104667  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 57103.9us
I20260709 13:01:28.063328  2963 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:28.068600  2973 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:28.114017  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44256.1us
I20260709 13:01:28.114905  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.117532  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.119335  1688 raft_consensus.cc:2368] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:28.080812  2368 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:01:28.117774  2948 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:28.117555   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:28.134778  2328 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.119951  1684 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:01:28.137126  1684 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.134894  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.124279  2899 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.141264  2827 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:28.142128  2363 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:28.148387  2944 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:28.150185  2944 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:28.150555  2944 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:28.143476  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.152680  1681 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.143972  3058 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.146184  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.151604  2944 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.157526  2944 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.147990  2923 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:28.139786  1684 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.148350  2891 consensus_queue.cc:1059] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:28.115854  2963 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:28.163216  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:28.120263  1683 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.165318  3041 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:28.174202  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 105525us
I20260709 13:01:28.123548  2953 raft_consensus.cc:697] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:28.169302  2956 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:28.171743  2963 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.172138  2955 raft_consensus.cc:3055] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:28.187784  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.192162  1689 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:28.180909  3053 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:28.209383  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.209504  2891 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:28.226270  1538 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:28.227437  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.229081  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.228786  2953 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.250417  2905 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.252701  2905 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:28.191045  2955 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:01:28.240595  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 43789.6us
I20260709 13:01:28.242020  2973 raft_consensus.cc:3055] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:28.208343  2956 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:28.249194  1681 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:28.230744  1505 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:28.254978  1686 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:01:28.254124  2977 consensus_meta.cc:287] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
W20260709 13:01:28.263754  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 76250.4us
I20260709 13:01:28.263669  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:28.264596  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.264858  2956 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.265957  3056 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:01:28.265643  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.247308  3053 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:28.267716  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.268983  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.263562  3013 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:28.275002  1579 leader_election.cc:400] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:28.254510  3052 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.269022  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.291870  1579 leader_election.cc:403] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:28.259858  2973 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:28.279836  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.292064  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.305598  1609 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:01:28.277407  1685 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:28.307556  1609 pending_rounds.cc:85] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 4
I20260709 13:01:28.307668  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.309870  2365 raft_consensus.cc:1240] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:28.311424  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.312806  1609 pending_rounds.cc:107] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:01:28.313421  1609 raft_consensus.cc:2889] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:28.314651  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 49110.2us
I20260709 13:01:28.317914  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:28.324299  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.325068  1682 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.291173  2844 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.264971  2905 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.350095  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.351114  1688 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:28.354599  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.323689  3053 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.352258  3000 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:28.364121  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 46286.3us
I20260709 13:01:28.359791  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.364898  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.276171  2977 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.359072  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.345829  2899 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.363920  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.378768  1682 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:28.380051  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.381431  1541 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.382091  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.382246  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.383157  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.368247  1684 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:28.385408  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.387104  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.389294  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.389986  1686 raft_consensus.cc:2376] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4. Re-sending same reply.
I20260709 13:01:28.345551  2891 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:01:28.390847  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.391654  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:28.392792  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.393376  1689 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:28.394023  3058 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.394208  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.395244  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.395720  1689 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.396874  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.397614  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.390059  1533 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.399394  2956 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:28.363713  2915 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:28.386894  2955 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.389634  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.354707  2844 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:28.374032  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.402849  1682 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.391821  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.427673  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.389482  3052 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:28.434578  1535 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:28.440623  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.453745  1686 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:28.433924  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 66552.6us
I20260709 13:01:28.459784  1687 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.459966  2891 consensus_queue.cc:1059] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.383183  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.363535  2972 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
W20260709 13:01:28.412175  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 101703us
I20260709 13:01:28.693332  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.504436  1685 raft_consensus.cc:1240] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.698398  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.612385  1689 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
W20260709 13:01:28.695894  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 331073us
I20260709 13:01:28.703019  1688 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:28.401787  2905 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.434859  1684 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:28.704186  1681 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.617051  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.710927  1534 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.708807  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.712018  1613 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:28.717388  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.723683  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.724809  1616 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.728216  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:28.467582  1579 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:28.732928  1689 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:28.734742  1689 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:01:28.464896  3067 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:01:28.461146  2891 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.461194  1687 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:28.433763  2973 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.747047  2973 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.690194  2963 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:28.749734  2963 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:28.750313  3038 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:01:28.751443  3038 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.752379  1690 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.743142  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.697082  2955 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:28.744539  2891 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:28.756907  2948 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:28.758540  2948 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.759044  2948 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:28.756968  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 289477us
I20260709 13:01:28.744431  1685 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:28.755920  2891 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.736763  1688 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:28.475723  2977 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:28.508625  3041 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:28.760350  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.770027  1536 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.763046  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 89) took 4492 ms. Trace:
W20260709 13:01:28.764021  1653 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d86302e0fce4e1585ef0f1cbc65dc7a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:28.764114  1686 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:28.772876  1653 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:28.777375  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.472116  2844 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.751819  3038 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:28.467206  2774 consensus_queue.cc:1059] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.307s
I20260709 13:01:28.765595  2891 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.767781  2973 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:28.767139  3041 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.797614  2370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 160) took 1032 ms. Trace:
W20260709 13:01:28.814410  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 119216us
I20260709 13:01:28.816576  1539 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:28.789103  2905 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:28.818464  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 45712.4us
I20260709 13:01:28.823683  2905 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:28.824126  1653 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:28.825503  1653 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:28.788347  2963 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.814278  2370 rpcz_store.cc:276] 0709 13:01:27.758181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.758359 (+   178us) service_pool.cc:224] Handling call
0709 13:01:27.779807 (+ 21448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:27.853258 (+ 73451us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:27.853295 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.065289 (+211994us) log.cc:844] Serialized 564 byte log entry
0709 13:01:28.254517 (+189228us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:28.254557 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:28.254635 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:28.790684 (+536049us) raft_consensus.cc:1685] finished
0709 13:01:28.790706 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:28.790846 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546624,"thread_start_us":161505,"threads_started":1,"wal-append.queue_time_us":242650}
W20260709 13:01:28.819861  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 58234.5us
I20260709 13:01:28.826547  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:28.788705  2977 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:28.835427  1539 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:28.835795  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 129668us
I20260709 13:01:28.813819  3052 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:28.797209  3074 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:28.843420  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.835072  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.824208  2905 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.771330  1436 rpcz_store.cc:276] 0709 13:01:24.270988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:24.271862 (+   874us) service_pool.cc:224] Handling call
0709 13:01:28.762968 (+4491106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:27.646865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:27.647725 (+   860us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:27.647791 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:01:27.647819 (+    28us) tablet.cc:662] Decoding operations
0709 13:01:27.648462 (+   643us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:27.648597 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:27.648649 (+    52us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:27.649350 (+   701us) tablet.cc:701] Row locks acquired
0709 13:01:27.649397 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:01:27.649636 (+   239us) write_op.cc:270] Start()
0709 13:01:27.653832 (+  4196us) write_op.cc:276] Timestamp: P: 1783602087649552 usec, L: 0
0709 13:01:27.678103 (+ 24271us) op_driver.cc:348] REPLICATION: starting
0709 13:01:27.733359 (+ 55256us) log.cc:844] Serialized 918 byte log entry
0709 13:01:28.268678 (+535319us) op_driver.cc:464] REPLICATION: finished
0709 13:01:28.338836 (+ 70158us) write_op.cc:301] APPLY: starting
0709 13:01:28.338973 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:28.339192 (+   219us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:28.339393 (+   201us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:28.341358 (+  1965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:28.341735 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:28.341814 (+    79us) write_op.cc:312] APPLY: finished
0709 13:01:28.342278 (+   464us) log.cc:844] Serialized 28 byte log entry
0709 13:01:28.343587 (+  1309us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:28.343735 (+   148us) write_op.cc:454] Released schema lock
0709 13:01:28.343823 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:28.372320 (+ 28497us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:28.373780 (+  1460us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":69734,"apply.run_cpu_time_us":3308,"apply.run_wall_time_us":15809,"num_ops":2,"prepare.queue_time_us":365171,"prepare.run_cpu_time_us":23734,"prepare.run_wall_time_us":338274,"raft.queue_time_us":109234,"raft.run_cpu_time_us":16175,"raft.run_wall_time_us":101396,"replication_time_us":582274,"thread_start_us":434465,"threads_started":4,"wal-append.queue_time_us":346164}]]}
I20260709 13:01:28.846621  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.759999  2948 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.833009  2943 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.832327  2827 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.858940  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.859579  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.861742  2899 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.872699  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.841970  2977 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:28.874400  3082 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:28.875124  3082 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.872757  2368 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:28.877399  1540 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.881387  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:28.884613  1534 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:28.886456  1616 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:28.835011  2942 consensus_queue.cc:1059] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:01:28.907133  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 48292.6us
I20260709 13:01:28.902745  3053 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.851410  3051 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:01:28.915311  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:28.913434  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 53948.4us
W20260709 13:01:28.918256  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:28.890944  2948 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:28.890259  2899 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.857613  3052 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.924623  1579 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:28.929200  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.853500  3074 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.935856  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.923840  2878 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:28.900297  2932 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:01:28.927620  2973 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:28.940569  3012 raft_consensus.cc:3055] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:28.895699  3088 consensus_queue.cc:1059] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260709 13:01:28.956487  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 66796.5us
I20260709 13:01:28.947968  2864 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:28.940382  3089 raft_consensus.cc:3055] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:01:28.949043  3076 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 13:01:28.951354  3077 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:28.967084  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:28.962916  2878 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:28.862408  3038 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.916644  2915 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:01:28.944274  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:28.955961  3012 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:28.978853  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 46188.3us
I20260709 13:01:28.991520  3090 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:28.992077  3090 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:28.992426  2878 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:28.993754  2878 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:28.986423  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:28.987567  3012 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:28.995155  3052 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:28.995476  3012 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.995640  2915 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:28.979653  2972 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:28.996078  3052 raft_consensus.cc:3055] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:28.996757  3052 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:28.971124  3077 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:28.997918  3052 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:28.999557  2864 tablet_bootstrap.cc:492] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:28.981269  2899 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:29.000531  2864 ts_tablet_manager.cc:1403] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 1.580s	user 0.044s	sys 0.068s
I20260709 13:01:28.998235  3077 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.005395  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:28.969731  3089 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:29.004437  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 75149.8us
I20260709 13:01:29.015861  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:29.019179  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:28.982940  3013 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.022614  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:29.045017  2899 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:29.046396  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.045629  1439 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 1 to 2, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:28.992478  3090 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:28.984773  3053 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:29.049259  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:28.996089  2915 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:29.008394  3051 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:29.069232  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 77788.8us
I20260709 13:01:29.052373  2827 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.068676  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:29.079977  1536 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:29.080458  1540 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
W20260709 13:01:29.086488  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 162005us
I20260709 13:01:29.059314  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:29.058374  3082 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:29.091940  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.070315  3013 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:29.016414  2973 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.062026  2899 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.109297  2891 consensus_queue.cc:1059] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:29.113268  2899 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:29.113987  2899 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:29.115208  2899 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:29.115029  2864 raft_consensus.cc:359] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:29.115720  2899 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:29.116389  3089 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.120182  3098 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:29.120756  3000 consensus_meta.cc:287] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.000s
I20260709 13:01:29.122784  1683 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:29.194608  1681 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260709 13:01:29.129804  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 43941us
W20260709 13:01:29.184823  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 59067.1us
I20260709 13:01:29.196575  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:29.182052  1580 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.507s (SENT)
I20260709 13:01:29.124926  2864 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:29.202785  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.261045  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:29.260574  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 64131.2us
W20260709 13:01:29.203696  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 137468us
I20260709 13:01:29.366221  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:29.205482  3102 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:01:29.395691  1689 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
W20260709 13:01:29.394559  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 269520us
I20260709 13:01:29.194074  3000 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:29.400132   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:29.400789  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 268510us
I20260709 13:01:29.205698  2915 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.401110  2864 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:29.401149  1683 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:29.401746  3095 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:29.402704  3100 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:29.404183  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.404141  3089 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.262856  3101 consensus_queue.cc:1059] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.200s
I20260709 13:01:29.403977  3082 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.183799  2953 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:01:29.136840  2905 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.192874  2774 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.179s
I20260709 13:01:29.280588  3097 raft_consensus.cc:3055] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:01:29.426805  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 225989us
I20260709 13:01:29.479163  3097 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:29.433950  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.481154  2905 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:29.484503  3097 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.485975  3097 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.487725  3035 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:29.488158  2864 ts_tablet_manager.cc:1434] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.487s	user 0.010s	sys 0.009s
I20260709 13:01:29.488179  3035 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:29.489693  3035 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.490906  3035 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.321183  3086 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:29.401347  2944 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:29.466259  1580 leader_election.cc:336] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.527s (SENT)
I20260709 13:01:29.494148  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:29.471344  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.478243  2953 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:29.465794  2891 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:29.473133  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 196701us
I20260709 13:01:29.505839  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:29.507508  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:29.473194  3100 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:29.513291  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:29.515403  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:29.516196  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.518255  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:29.520638  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.504022  2915 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:29.523887  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:29.517207  1687 raft_consensus.cc:2376] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2. Re-sending same reply.
I20260709 13:01:29.526604  3091 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.531411  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:29.515786  3086 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:29.532876  3091 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:29.532810  3086 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.533599  3091 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.534142  3091 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:29.534416  3041 consensus_meta.cc:287] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.707s	user 0.013s	sys 0.000s
I20260709 13:01:29.524710  2955 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.521854  3083 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.536937  2955 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:29.537587  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:29.538407  1683 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:29.539057  2955 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:29.539743  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 74776.7us
W20260709 13:01:29.540431  1580 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.534s (SENT)
I20260709 13:01:29.536957  3083 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:29.541394  1580 leader_election.cc:336] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.614s (SENT)
I20260709 13:01:29.541774  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.541864  3077 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.546072  2977 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:29.542719  2972 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.519486  3100 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.466382  3109 consensus_queue.cc:1059] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:01:29.509505  3000 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:29.504645  2953 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:29.548686  1608 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
W20260709 13:01:29.543766  1580 leader_election.cc:336] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.628s (SENT)
I20260709 13:01:29.556177  3094 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.539785  2955 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:29.550575  3012 consensus_meta.cc:287] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
W20260709 13:01:29.562970  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 366950us
I20260709 13:01:29.562609  2972 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:29.572873  3100 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:29.573670  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.579209  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.572603  3094 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:29.574705  1580 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.765s (SENT)
W20260709 13:01:29.576085  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.535535  3041 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:29.509635  2891 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:29.579070  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:29.592429  1682 raft_consensus.cc:2376] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2. Re-sending same reply.
I20260709 13:01:29.592567  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.561038  3000 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:29.565726  2953 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:29.577833  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 492889us
I20260709 13:01:29.578390  3083 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:29.597157  3108 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:29.600993  2370 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:29.601249  3108 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:29.598219  3084 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:29.595395  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 89736.3us
I20260709 13:01:29.598713  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:29.603747  1580 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.775s (SENT)
W20260709 13:01:29.607733  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.608384  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.608822  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.609850  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1284) took 1449 ms. Trace:
W20260709 13:01:29.611349  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.600163  3109 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:29.610351  1690 rpcz_store.cc:276] 0709 13:01:28.156394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.157145 (+   751us) service_pool.cc:224] Handling call
0709 13:01:28.157482 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:28.752761 (+595279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.605306 (+852545us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400411754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:29.605468 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367812864}
I20260709 13:01:29.622705  3000 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.626454  1505 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:29.647419  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.659924  1690 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:29.588328  2955 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:29.664255  1682 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:01:29.678771  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:29.665776  1580 leader_election.cc:336] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.984s (SENT)
I20260709 13:01:29.717816  1690 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:29.682163  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 56496.7us
W20260709 13:01:29.745718  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 134529us
I20260709 13:01:29.738181  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.666217  3000 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.672330  3109 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:29.664539  3113 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:29.664222  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 56769us
I20260709 13:01:29.673167  2891 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:29.767565  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:29.768687  2362 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:29.770833  3100 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:29.784377  2891 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:29.755535  3109 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:29.788378  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 122630us
W20260709 13:01:29.789705  1580 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.029s (SENT)
I20260709 13:01:29.793759  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.809828  2955 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:29.788774  3109 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:29.820694  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47398.4us
W20260709 13:01:29.822616  1580 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.038s (SENT)
I20260709 13:01:29.823348  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:29.832644  1580 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.601s (SENT)
I20260709 13:01:29.833120  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.823704  3097 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:29.772583  3113 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:29.835624  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 84657.7us
I20260709 13:01:29.838393  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:29.838728  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:29.840255  3104 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.314s	user 0.000s	sys 0.007s
I20260709 13:01:29.841538  3091 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:29.842227  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1318) took 1456 ms. Trace:
I20260709 13:01:29.842536  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:29.846024  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:29.848348  3118 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:29.848887  3118 raft_consensus.cc:697] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:29.849808  3118 consensus_queue.cc:237] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.831982  2891 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.843711  3091 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:29.857848  1580 leader_election.cc:336] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.646s (SENT)
I20260709 13:01:29.864125  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:29.860045  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:29.862528  1612 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:01:29.883098  1580 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.589s (SENT)
W20260709 13:01:29.885412  1580 leader_election.cc:336] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.072s (SENT)
I20260709 13:01:29.886272  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:29.838037  3084 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.888675  3000 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.838200  3108 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:29.901191  1541 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:29.871937  3116 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:29.909819  1537 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:29.911007  3112 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:29.911724  3112 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.871192  2915 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:29.884652  3100 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:29.889667  3053 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:01:29.905071  3083 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:29.919517  3110 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:29.889783  3097 consensus_queue.cc:1059] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:01:29.842983  1533 rpcz_store.cc:276] 0709 13:01:28.386233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.401184 (+ 14951us) service_pool.cc:224] Handling call
0709 13:01:28.813966 (+412782us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:28.842369 (+ 28403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:28.849795 (+  7426us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:28.983395 (+133600us) log.cc:844] Serialized 506 byte log entry
0709 13:01:29.274575 (+291180us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:29.361260 (+ 86685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:29.394968 (+ 33708us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:29.817493 (+422525us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:01:29.841810 (+ 24317us) raft_consensus.cc:1685] finished
0709 13:01:29.841833 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:29.842128 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7423872,"thread_start_us":142027,"threads_started":1,"wal-append.queue_time_us":443258}
I20260709 13:01:29.944584  3084 raft_consensus.cc:3055] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:29.945047  3084 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:29.937107  3110 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.945899  3084 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:29.947062  3084 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:29.947679  3110 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:29.952235  3113 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:29.956669  3082 raft_consensus.cc:3055] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:29.957202  3082 raft_consensus.cc:740] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:29.958544  3082 consensus_queue.cc:260] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.969310  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:29.970088  1688 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:29.917894  3112 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:29.980732  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:29.986617  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:29.987336  2364 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:29.988912  1686 raft_consensus.cc:1240] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:29.990108  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:29.991042  2923 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:01:29.992316  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:29.992908  2362 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
W20260709 13:01:29.994221  3090 consensus_meta.cc:287] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.929s	user 0.013s	sys 0.000s
I20260709 13:01:29.994372  2899 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.994603  3090 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:29.995368  2899 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:29.996361  2923 tablet_bootstrap.cc:492] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:29.997164  2923 ts_tablet_manager.cc:1403] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 1.849s	user 0.053s	sys 0.010s
I20260709 13:01:30.000255  1579 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:29.959837  3082 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.004443  3038 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:29.928586  2915 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.007722  3097 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:30.019788  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.016427  3094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:53952 (request call id 8) took 4199 ms. Trace:
W20260709 13:01:30.028848  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.029568  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.033617  3074 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.040270  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:30.040992  1688 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:30.020334  3097 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:29.966114  3109 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:30.024202  2909 raft_consensus.cc:3055] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:30.044708  1616 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:30.043705  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:30.045542  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:30.049948  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:30.045490  2909 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:30.051057  3109 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.044960  3097 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:30.053778  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:30.051798  2915 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.049158  1614 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:30.053550  3090 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.055142  2909 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:30.079749  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1326) took 1357 ms. Trace:
I20260709 13:01:30.081161  1608 rpcz_store.cc:276] 0709 13:01:28.716925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:28.717091 (+   166us) service_pool.cc:224] Handling call
0709 13:01:30.073715 (+1356624us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54002260d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:30.073894 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726499712}
I20260709 13:01:30.084884  2977 raft_consensus.cc:3055] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:30.034832  3094 rpcz_store.cc:276] 0709 13:01:25.811967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:26.809976 (+998009us) service_pool.cc:224] Handling call
0709 13:01:26.911160 (+101184us) log.cc:844] Serialized 506 byte log entry
0709 13:01:30.011230 (+3100070us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":265,"mutex_wait_us":13832,"raft.queue_time_us":17953,"raft.run_cpu_time_us":2107,"raft.run_wall_time_us":4965,"thread_start_us":77329,"threads_started":1,"wal-append.queue_time_us":166393,"wal-append.run_cpu_time_us":4134,"wal-append.run_wall_time_us":1248412}
I20260709 13:01:30.085384  2977 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:30.086380  2977 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.087066  2364 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:30.087585  2977 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.088742  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:01:30.095723  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.099804  3041 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:30.100292  2932 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.100932  2932 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:30.102551  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.103385  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.103950  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:30.108584  1690 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:30.110110  1682 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260709 13:01:30.109378  3131 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:01:30.111632  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:30.111943  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:30.110744  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:30.113996  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:30.111434  1684 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:01:30.116540  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 200841us
W20260709 13:01:30.117051  1580 leader_election.cc:336] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.105s (SENT)
I20260709 13:01:30.117347  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.117973  3082 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:30.118348  1580 leader_election.cc:336] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.111s (SENT)
W20260709 13:01:30.119132  1580 leader_election.cc:336] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.118s (SENT)
I20260709 13:01:30.107205  2932 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.119480  1580 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.120080  3085 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:30.119710  2932 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:30.123195  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.123620  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.123948  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.125074  1580 leader_election.cc:336] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.739s (SENT)
I20260709 13:01:30.125483  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:30.126482  1580 leader_election.cc:336] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.755s (SENT)
I20260709 13:01:30.126879  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.130391  3095 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.130941  3095 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:30.132051  3095 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.133492  3095 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:30.133787  3129 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:30.107435  3086 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:30.135365  3090 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:30.136077  3090 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:30.136758  3086 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:30.138691  3086 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:30.139837  2923 raft_consensus.cc:359] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:30.140754  2923 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:30.141489  2923 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:30.121730  2932 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:30.089689  2953 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.156582  2923 ts_tablet_manager.cc:1434] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.159s	user 0.007s	sys 0.001s
W20260709 13:01:30.159435  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:30.215359  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.216400  2328 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.219482  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:30.225502  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:30.225415  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.226977  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:30.228109  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.226845  2955 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:30.229424  1540 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:30.228339  1504 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:30.228890  3093 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.231778  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.233350  1535 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:30.233319  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.233480  1504 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:30.234820  1532 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:30.235263  1535 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:30.225332  3041 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.242200  3082 consensus_queue.cc:1059] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:30.242683  3041 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:30.243320  3083 raft_consensus.cc:3055] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.243700  3083 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:30.245062  3041 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.233906  2899 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.234733  2363 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:30.238912  3088 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.239136  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.251180  3088 raft_consensus.cc:697] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:30.239727  2878 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:30.241086  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:30.230952  3093 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:30.244596  3083 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:30.281418  1616 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:30.281610  3083 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.246177  1608 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:30.226366  3038 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.284430  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:30.284960  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:30.285224  1688 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:30.285522  1682 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:30.246244  1532 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:30.246908  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.219944  3135 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:01:30.249271  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.293568  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.249581  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.249944  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.299681  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.260625  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.260749  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.261310  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.306172  1541 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:01:30.304891  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51099.3us
I20260709 13:01:30.248190  2977 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:30.310336  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.263206  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:30.263561  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:30.265156  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-a93cfc3bb7634fb1b78c60f120616d9d received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:30.268777  3093 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.270391  2899 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:30.270318  2973 raft_consensus.cc:3055] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.274627  3052 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.278264  2942 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:30.280261  3041 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:30.284497  3038 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:30.288901  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.330869  1535 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.236435  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.331382  1540 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:30.283802  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 175) took 8609 ms. Trace:
I20260709 13:01:30.252233  3088 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:30.302145  1536 raft_consensus.cc:2393] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.310671  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.336740  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.311676  1538 raft_consensus.cc:2393] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.313956  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-a93cfc3bb7634fb1b78c60f120616d9d on tablet a93cfc3bb7634fb1b78c60f120616d9d with peer 9d926c10b90f452ba52d80dab6a50351
W20260709 13:01:30.313376  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.271864  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.320547  1537 raft_consensus.cc:2393] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.270349  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:30.309468  3077 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:30.297662  3082 consensus_queue.cc:1059] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:01:30.318356  2973 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:30.344637  1539 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.337395  1532 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:30.321312  2891 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:30.317408  2977 raft_consensus.cc:697] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:30.329556  3118 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.337457  1541 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:30.353467  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.354187  1536 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:30.348687  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.349855  3117 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.354251  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.351096  2369 raft_consensus.cc:1217] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:01:30.352348  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.355659  1538 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:30.341061  1533 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.357617  1535 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.357726  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.358381  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.372495  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.372813  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.373210  1541 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:30.373373  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.374073  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.331763  2844 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.326277  3041 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:30.361809  1540 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:30.363823  3142 ts_tablet_manager.cc:933] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.364612  1683 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:30.352365  1684 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:30.351817  3122 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:01:30.330091  2953 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.373512  1536 raft_consensus.cc:2393] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.379001  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.523506  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.332840  1439 rpcz_store.cc:276] 0709 13:01:21.674153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:21.674715 (+   562us) service_pool.cc:224] Handling call
0709 13:01:30.283725 (+8609010us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:29.519984 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:29.544725 (+ 24741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:29.544760 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:01:29.544773 (+    13us) tablet.cc:662] Decoding operations
0709 13:01:29.545088 (+   315us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:29.545139 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:29.545162 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:01:29.545341 (+   179us) tablet.cc:701] Row locks acquired
0709 13:01:29.545359 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:01:29.545493 (+   134us) write_op.cc:270] Start()
0709 13:01:29.545604 (+   111us) write_op.cc:276] Timestamp: P: 1783602089545449 usec, L: 0
0709 13:01:29.545621 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:01:29.546341 (+   720us) log.cc:844] Serialized 535 byte log entry
0709 13:01:29.926283 (+379942us) op_driver.cc:464] REPLICATION: finished
0709 13:01:30.057843 (+131560us) write_op.cc:301] APPLY: starting
0709 13:01:30.080255 (+ 22412us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:30.081482 (+  1227us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:30.081633 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:30.081983 (+   350us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:30.097918 (+ 15935us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:01:30.097980 (+    62us) write_op.cc:312] APPLY: finished
0709 13:01:30.098270 (+   290us) log.cc:844] Serialized 22 byte log entry
0709 13:01:30.098462 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:30.098546 (+    84us) write_op.cc:454] Released schema lock
0709 13:01:30.098582 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:30.098920 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:30.098958 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5040,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":129980,"apply.run_cpu_time_us":4883,"apply.run_wall_time_us":41934,"num_ops":1,"prepare.queue_time_us":401247,"prepare.run_cpu_time_us":45599,"prepare.run_wall_time_us":275151,"raft.queue_time_us":81365,"raft.run_cpu_time_us":28464,"raft.run_wall_time_us":100364,"replication_time_us":380506,"thread_start_us":751101,"threads_started":4,"wal-append.queue_time_us":288235}]]}
I20260709 13:01:30.375272  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.533843  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.539880  1538 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
W20260709 13:01:30.535434  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 158245us
I20260709 13:01:30.378598  2844 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:30.370210  3112 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:30.364825  2977 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:30.347684  2328 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:30.374619  3053 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:30.562829  3053 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.563097  2844 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.564667  2844 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.375150  3100 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:30.353654  3118 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.330881  2899 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:30.544476  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 166807us
I20260709 13:01:30.537277  1625 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-71e3bb6ac3eb408ba9c57b48de886d65 received from {username='slave'} at 127.0.0.1:57944
I20260709 13:01:30.560233  2827 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.364826  3038 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.561053  3122 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.561792  3094 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.534406  3041 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.546325  1537 raft_consensus.cc:2410] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:30.572016  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.573311  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.573774  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:30.597573  1541 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:30.597709  1532 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.598124  2943 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:30.598685  2943 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:30.367770  3117 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.599978  2943 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.601976  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.552220  3112 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.573137  3100 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.588827  3108 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:30.592190  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.568970  3053 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.598605  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.602137  3117 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:30.591653  1625 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-71e3bb6ac3eb408ba9c57b48de886d65 on tablet 71e3bb6ac3eb408ba9c57b48de886d65 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:30.583825  2827 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.588027  3118 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:30.606230  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:30.549546  3097 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:30.553123  2932 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:30.578343  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 248324us
I20260709 13:01:30.625844  1532 raft_consensus.cc:2368] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:30.592478  3094 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:30.593614  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.625006  3108 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.597083  3084 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:01:30.621960  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.628870  3083 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.643672  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.603434  3091 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:30.659596  1613 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:30.660195  1532 raft_consensus.cc:2376] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3. Re-sending same reply.
I20260709 13:01:30.630276  3116 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:01:30.632717  3077 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:30.662958  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.667359  1532 raft_consensus.cc:2410] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:30.651808  3108 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:30.670310  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.672426  1532 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:30.659080  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:30.673646  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:30.660441  3090 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.672068  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:30.679728  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:30.679949  1609 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:30.676250  1608 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:30.677106  1532 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:30.681604  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.682217  1532 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:30.679329  1616 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:30.684538  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.685331  1532 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
W20260709 13:01:30.677876  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 308843us
I20260709 13:01:30.661659  3136 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:30.687561  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:01:30.737011  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49554.9us
I20260709 13:01:30.740372  1537 raft_consensus.cc:2368] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
W20260709 13:01:30.740921  3139 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:01:30.742782  3112 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.688695  1533 raft_consensus.cc:2393] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:30.664244  3083 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.593530  3122 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.663136  2328 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:30.792526  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 199007us
I20260709 13:01:30.794093  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.804422  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.746268  3142 tablet_copy_client.cc:323] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:01:30.781738  1537 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:30.817145  2827 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:30.822995  2973 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:30.795368  2932 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:30.824448  2973 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:30.824856  2932 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.825338  2932 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:30.815614  3143 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:01:30.829733  3091 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:30.847913  3091 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:30.848388  3091 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:30.849046  3100 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:30.851514  3144 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:01:30.834280  3051 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:30.852382  3051 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:30.853796  3083 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:30.856232  1536 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:30.857080  1538 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:30.781313  3149 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.836946  3090 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:30.839838  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.872794  1538 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:30.874626  1538 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:30.875032  1538 pending_rounds.cc:85] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:30.875275  1538 pending_rounds.cc:107] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:30.875566  1538 raft_consensus.cc:2889] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:30.745620  3136 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.858929  1536 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:30.842736  3122 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:30.782331  3094 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:30.868680  3095 consensus_meta.cc:287] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.005s
W20260709 13:01:30.809231  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 152224us
I20260709 13:01:30.861266   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:30.878468  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 74325.6us
I20260709 13:01:30.854813  3154 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:30.846879  2948 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.889962  3083 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.847198  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:30.845810  3085 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:30.853206  3051 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.890832  2973 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:30.890925  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 210458us
I20260709 13:01:30.918898  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:30.968972  1687 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:30.944304  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.907686  3154 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:30.950680  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:30.952913  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.003639  1612 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:30.955794  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:30.906440  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:30.948124  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:30.988173  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.004817  1539 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
W20260709 13:01:31.013159  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 57509.5us
I20260709 13:01:31.009842  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.013943  1686 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:31.009949  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 91182.5us
I20260709 13:01:31.013948  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:31.015478  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:31.007862  3154 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:31.007606  3053 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:30.972843  3052 consensus_meta.cc:287] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260709 13:01:30.931463  2948 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.029681  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:31.032151  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:31.033516  3109 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:31.033903  2365 raft_consensus.cc:1240] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:31.034241  3109 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.973429  3135 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:30.879531  3149 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:30.934252  3083 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.035989  3084 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:31.036522  3090 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:31.037541  3093 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:31.079906  3093 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.080605  3093 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:31.081226  3158 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:30.964366  3085 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:31.082618  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 50572.6us
I20260709 13:01:31.083843  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:31.035944  2878 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.040805  3086 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:31.069567  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57944 (request call id 67) took 1033 ms. Trace:
I20260709 13:01:31.038488  3110 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:31.095054  1580 leader_election.cc:400] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:31.019223  3053 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.090184  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.089993  1613 rpcz_store.cc:276] 0709 13:01:30.035918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.036594 (+   676us) service_pool.cc:224] Handling call
0709 13:01:31.069105 (+1032511us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b5400279cd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:31.069496 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410238208}
I20260709 13:01:31.052193  3082 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.097000  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:31.055891  3112 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:31.148393  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63047.2us
I20260709 13:01:31.061924  3052 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.220716  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.331918  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.061803  3152 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:31.348670  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:31.358788  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 258556us
I20260709 13:01:31.361104  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.079972  2953 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:31.333729  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 240437us
I20260709 13:01:31.099740  3095 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:31.387933  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 230429us
I20260709 13:01:31.400966  1580 leader_election.cc:400] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:31.352119  3152 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:31.376308  3086 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.050381  3135 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:31.475164  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 378902us
I20260709 13:01:31.148440  2973 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.242s
I20260709 13:01:31.384510  2915 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.333241  3077 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.245s
I20260709 13:01:31.152180  2878 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.493505  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1337) took 1213 ms. Trace:
I20260709 13:01:31.493738  2899 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:31.494012  1537 rpcz_store.cc:276] 0709 13:01:30.279917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.741284 (+461367us) service_pool.cc:224] Handling call
0709 13:01:30.750812 (+  9528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:30.816173 (+ 65361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.493289 (+677116us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b540014c8d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:31.493439 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7511424}
I20260709 13:01:31.495625  2948 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:31.494367  2899 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:31.496397  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.496443  1534 raft_consensus.cc:2410] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:31.498106  3165 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.396s	user 0.001s	sys 0.000s
W20260709 13:01:31.498395  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1305) took 1249 ms (client timeout 1628 ms). Trace:
W20260709 13:01:31.498811  1534 rpcz_store.cc:269] 0709 13:01:30.248883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.249008 (+   125us) service_pool.cc:224] Handling call
0709 13:01:31.498162 (+1249154us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000ca3d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:31.498319 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2757575424}
I20260709 13:01:31.500332  1532 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:31.500727  1532 pending_rounds.cc:85] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:31.500990  1532 pending_rounds.cc:107] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:31.500540  2915 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.501231  1532 raft_consensus.cc:2889] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:31.502712  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1340) took 1226 ms. Trace:
I20260709 13:01:31.491263  3095 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.504302  3095 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.487201  3086 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:31.505873  3041 consensus_meta.cc:287] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.002s
I20260709 13:01:31.506448  3095 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.506335  3041 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:31.470985  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 564924us
I20260709 13:01:31.155591  3110 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.361902  3052 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.487680  1684 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:01:31.504667  3083 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.471087  3084 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:01:31.387347  2953 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.503888  1532 rpcz_store.cc:276] 0709 13:01:30.303406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.686178 (+382772us) service_pool.cc:224] Handling call
0709 13:01:31.499941 (+813763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:31.501887 (+  1946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:31.502514 (+   627us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54000ca3d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:31.502641 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870690688}
I20260709 13:01:31.506939  3086 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:31.592552  3140 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:01:31.551443  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 150619us
I20260709 13:01:31.510767  3109 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.592742  3174 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:31.475479  3152 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:31.470875  3012 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:01:31.349478  3112 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.472421  3113 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:31.552271  3095 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:31.605372  2844 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:31.607059  3168 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:01:31.593725  3162 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:01:31.612393  1580 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:31.689859  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 77579.2us
I20260709 13:01:31.677512  1437 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:31.619058  2932 consensus_meta.cc:287] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.793s	user 0.003s	sys 0.008s
I20260709 13:01:31.605412  3153 consensus_queue.cc:1059] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.257s
I20260709 13:01:31.612663  3041 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:31.692603  3095 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.702497  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.702802  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.703307  1612 raft_consensus.cc:2368] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4.
I20260709 13:01:31.703581  1611 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:31.703778  3095 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:31.704527  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.704939  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.705330  1609 raft_consensus.cc:2410] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:31.706075  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.706645  1615 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:31.707394  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.696447  3077 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:31.708438  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.708765  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.709197  1612 raft_consensus.cc:2368] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4.
I20260709 13:01:31.636595  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:31.654819  3135 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:31.661222  3154 consensus_meta.cc:287] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.004s
I20260709 13:01:31.611588  3085 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.694283  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.694519  2932 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.717839  1613 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
W20260709 13:01:31.718367  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 81925.7us
I20260709 13:01:31.695111  3097 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:31.695979  3113 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:31.691156  2844 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.699708  3112 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:31.700173  3160 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.700410  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.700604  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.621405  3174 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.624019  3109 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:31.709596  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.746181  1609 raft_consensus.cc:2410] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:01:31.720594  3041 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:31.720000  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.709532  1437 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:31.734359  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.740636  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.741812  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.720006  2932 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:31.744764  3160 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:31.720679  2369 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:31.739068  3097 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:31.721027  3113 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:31.749607  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 1.01095e+06us
I20260709 13:01:31.758548  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:31.760701  3041 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:31.710351  3108 consensus_meta.cc:287] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 1.020s	user 0.007s	sys 0.006s
I20260709 13:01:31.761710  3108 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.761999  3109 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:31.764454  3093 consensus_meta.cc:287] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.003s
I20260709 13:01:31.765012  3109 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.764858  3093 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:31.767361  3093 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:31.749611  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.769227  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:31.769459  1609 raft_consensus.cc:2410] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:01:31.770629  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.773164  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:31.773264  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.774168  1613 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.775074  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:31.775684  1534 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:31.742159  3154 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.759629  3174 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:31.778635  3174 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:31.780781  3089 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:31.781368  3089 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:31.782512  3091 consensus_meta.cc:287] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.934s	user 0.009s	sys 0.000s
I20260709 13:01:31.783424  3089 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.746124  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.760634  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:31.744563  1614 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:31.750568  1611 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.785445  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:01:31.786065  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet 7d86302e0fce4e1585ef0f1cbc65dc7a from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-7d86302e0fce4e1585ef0f1cbc65dc7a
I20260709 13:01:31.753460  1607 raft_consensus.cc:2368] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4.
I20260709 13:01:31.757512  3113 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:31.747699  3171 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:31.789311  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.752813  2844 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:31.754973  3097 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.785687  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.792243  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.790551  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.789808  3171 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:31.812517  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:31.752379  1437 catalog_manager.cc:5697] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:31.814112  1532 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:31.796175  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:31.765698  3109 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:31.811187  2368 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:31.795259  1609 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:31.795241  1534 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:31.824136  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.815181  2899 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.795789  1607 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:31.825021  1609 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:31.761710  3041 raft_consensus.cc:697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:31.836990  1612 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:31.840129  3109 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:31.839229  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44433us
I20260709 13:01:31.845033  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:31.849293  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.793771  3091 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:31.842491  3082 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.003s
I20260709 13:01:31.855268  1613 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:31.793306  3108 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.847301  3171 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.890380  1532 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:31.840124  3097 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:31.852779  3089 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.887238  3077 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:31.896016  3041 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:31.924053  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.896464  3154 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.898257  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:31.892202  3082 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:31.899056  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.928912  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.906034  3136 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.937227  1690 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:31.853386  2844 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:31.905064  1687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.070s	sys 0.125s
W20260709 13:01:31.949560  1687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.071s	sys 0.125s
I20260709 13:01:31.905371  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:31.907086  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:31.912204  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:31.913687  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.950730  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.951676  1683 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:31.913723  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:31.922911  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 531973us
I20260709 13:01:31.952268  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.952742  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.892789  3153 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.853247  3085 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:31.930060  1614 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:31.930413  1611 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:31.931807  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.983949  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:31.987723  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:31.950651  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.950086  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.950956  1541 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:31.989434  1682 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:31.893774  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:31.955557  1681 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:31.956869  1687 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:31.958379  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:31.959064  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.961707  3163 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:31.964788  3109 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:31.996430  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.996618  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:31.906152  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:31.991046  1686 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:31.966122  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:31.966452  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.000262  1505 leader_election.cc:336] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.612s (SENT)
I20260709 13:01:31.997575  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.000375  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:32.001161  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 95098us
I20260709 13:01:31.953084  3097 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:32.001225  1609 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.001448  1683 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:31.966679  3091 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:31.915053  2899 consensus_queue.cc:1059] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:01:31.926246  3077 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:32.016402  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.612s (SENT) [suppressed 44 similar messages]
I20260709 13:01:31.967156  3012 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:01:31.968204  3053 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.002024  3109 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:31.972342  3095 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:31.973870  2953 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:31.974709  1700 tablet_copy_source_session.cc:215] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:01:31.957157  3082 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:32.044085  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 85751us
I20260709 13:01:31.953099  3154 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:31.924821  3089 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.008131  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.008975  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:32.010912  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.053936  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.054592  1688 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:32.055233  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:32.055373  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.055788  1609 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.055852  1688 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:32.015674  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.056802  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:32.056828  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.031137  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:31.973874  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.020740  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:32.022990  1504 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.015377  3085 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.019587  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.025271  1541 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
W20260709 13:01:31.982702  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 84580.1us
I20260709 13:01:31.968989  2878 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.006260  3173 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:01:31.959702  3161 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:01:32.035384  1613 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.101959  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1367) took 1160 ms. Trace:
I20260709 13:01:32.102404  1616 rpcz_store.cc:276] 0709 13:01:30.941371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.941559 (+   188us) service_pool.cc:224] Handling call
0709 13:01:30.964698 (+ 23139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:31.015677 (+ 50979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:31.015712 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:31.039634 (+ 23922us) log.cc:844] Serialized 26 byte log entry
0709 13:01:31.182124 (+142490us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:31.182194 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:32.101496 (+919302us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b54003a39d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:32.101560 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:32.101606 (+    46us) raft_consensus.cc:1685] finished
0709 13:01:32.101619 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:32.101862 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9239,"raft.queue_time_us":12062,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":10019,"spinlock_wait_cycles":99790720,"thread_start_us":116722,"threads_started":1,"wal-append.queue_time_us":338598}
I20260709 13:01:31.986225  2844 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.105638  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:32.105930  2844 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:32.106370  1608 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.106752  1687 raft_consensus.cc:2410] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:31.992849  1612 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.025251  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:32.032829  2365 raft_consensus.cc:2368] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:32.020642  3163 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:32.017627  2329 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:32.018181  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.119411  1683 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
W20260709 13:01:32.119578  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 102240us
W20260709 13:01:32.060336  1505 leader_election.cc:336] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.657s (SENT)
I20260709 13:01:32.066407  1504 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:32.121277  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 54928.9us
I20260709 13:01:32.121867  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.122534  1616 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:31.998564  3153 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.063966  3058 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.124293  3058 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.124428  2329 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:32.124752  3058 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.127038  3153 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:32.070094  3012 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.069865  3096 consensus_queue.cc:1059] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:32.070537  3136 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:32.070641  2953 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:32.051826  3082 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.045739  3116 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.068504  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.051079  3177 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:32.076186  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 51065.1us
I20260709 13:01:32.079157  1682 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:32.142416  1579 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.143234  1579 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.086356  2955 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:32.077569  3077 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.017026  3097 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.095391  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:32.108932  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.130407  3100 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:32.117373  1613 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.118338  1609 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.147969  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.149062  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.149574  1609 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:32.150344  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:32.150790  1609 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.109002  2362 raft_consensus.cc:2393] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:32.078871  3089 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:32.068444  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.030s	sys 0.047s
W20260709 13:01:32.154872  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.030s	sys 0.047s
I20260709 13:01:32.127523  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.127641  1689 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.111681  1607 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.078778  3085 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.126721  3163 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.161856  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.162541  1607 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:32.052946  3109 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.165073  3172 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.165576  3172 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.165927  3172 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.131508  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.166707  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.166867  1616 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:32.167507  1683 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:32.136890  1504 leader_election.cc:400] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:32.144726  1612 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.168009  1611 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.110991  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:32.156910  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 61630.3us
I20260709 13:01:32.158125  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.158350  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.159699  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:32.159770  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.168092  1504 leader_election.cc:403] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:32.170996  1686 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:32.134910  3136 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.135215  3108 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:32.172381  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.172883  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:32.173143  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 112865us
W20260709 13:01:32.173647  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.174335  1505 leader_election.cc:400] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4.
I20260709 13:01:32.160352  3169 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:32.132803  3012 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:32.193576  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.160806  2891 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.177083  1609 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.200299  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.134915  3110 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.198575  3053 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:32.209913  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.156244  3100 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.075991  3152 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:32.212378  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 59571.5us
I20260709 13:01:32.159653  3180 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:01:32.134116  2328 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:32.187731  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 50991.9us
I20260709 13:01:32.204154  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.204660  3082 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.172674  3161 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:32.205310  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:32.224700  1609 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:32.225056  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 60322us
I20260709 13:01:32.145788  3116 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.179322  3136 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.178040  1608 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:32.199659  2891 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.242940  2891 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.220490  3041 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.210986  1616 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:32.252942  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.209226  3108 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:01:32.217799  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 96474.2us
I20260709 13:01:32.254842  3135 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.254644  3108 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.256305  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:32.220988  2365 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Advancing to term 2
I20260709 13:01:32.192607  2878 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.156068  3177 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.266208  3142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:32.266551  3177 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.212062  3012 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.222172  2915 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.210952  3097 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.211856  3169 raft_consensus.cc:697] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:32.268780  1541 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:32.268674  3169 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.223062  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.270936  1612 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:32.268709  3171 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:32.272581  1612 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:01:32.272763  3171 raft_consensus.cc:697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:32.231206  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.232769  3000 raft_consensus.cc:3055] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.233512  3152 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:32.273648  3000 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:32.273837  3171 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.274222  2955 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:32.274762  3000 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.275153  2955 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.220305  3109 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.241688  3116 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:32.242199  1687 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:32.255331  3135 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:32.220855  1579 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:32.286849  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 66082.9us
I20260709 13:01:32.229522  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.253563  1616 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.264163  1609 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:32.214489  3100 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.270166  2909 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.298213  1615 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:32.163929  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.279109  1613 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:32.236677  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.276456  3094 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.276008  3000 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.268311  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.287971  1579 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.289336  1609 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.302729  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.311887  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.298305  1616 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:32.272951  1612 pending_rounds.cc:85] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 4
W20260709 13:01:32.299597  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 70204.7us
I20260709 13:01:32.300803  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:32.312803  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:32.305817  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:32.316675  3077 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.317014  1533 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:32.306174  1532 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:01:32.317883  1532 pending_rounds.cc:85] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:32.317833  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.318277  1532 pending_rounds.cc:107] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:01:32.318531  1532 raft_consensus.cc:2889] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.319140  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.314462  1534 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.314764  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.317137  3077 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.266571  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:32.361341  1537 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:32.320312  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.364282  3085 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:32.321792  3090 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.364882  3085 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.365483  3090 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.366079  3090 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.367054  3085 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.304070  3116 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.371102  3116 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.379711  1685 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:32.301069  3109 raft_consensus.cc:2764] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:01:32.309302  1607 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:01:32.305845  3159 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.263s	user 0.006s	sys 0.000s
I20260709 13:01:32.386965  1610 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:32.387166  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.312644  3103 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:32.388558  3103 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.389434  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:32.390547  1610 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.391265  3103 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:32.392426  1688 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.394411  3051 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.397742  1611 raft_consensus.cc:2410] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:01:32.313747  1612 pending_rounds.cc:107] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:01:32.398700  1612 raft_consensus.cc:2889] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:32.398944  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 84262.5us
I20260709 13:01:32.401453  1505 leader_election.cc:400] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4.
I20260709 13:01:32.314779  1613 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:32.202291  1689 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:32.332870  3135 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.340358  3160 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:32.336102  2899 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:32.341507  2369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46602 (request call id 174) took 1496 ms (client timeout 1809 ms). Trace:
I20260709 13:01:32.350459  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.355645  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.360479  2362 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:32.424844  2369 rpcz_store.cc:269] 0709 13:01:30.845166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.846835 (+  1669us) service_pool.cc:224] Handling call
0709 13:01:32.341312 (+1494477us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54004f3b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:32.341447 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820798720}
I20260709 13:01:32.372251  1534 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:32.307615  3097 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.387022  3172 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:32.430331  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 174130us
I20260709 13:01:32.415287  3109 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:32.432092  3109 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.383884  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:32.415518  3112 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.436123  1607 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
W20260709 13:01:32.437207  3164 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.104s	user 0.003s	sys 0.000s
I20260709 13:01:32.438313  1611 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:01:32.375206  1609 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.375638  1616 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:32.378029  3096 raft_consensus.cc:3055] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:32.414737  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:32.444075  1614 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:32.426258  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:32.426633  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 71112.1us
I20260709 13:01:32.427582  2973 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:32.360781  3077 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.443157  1615 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:32.444805  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.463930  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.449761  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.313000  3058 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.460904  1688 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:32.465600  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.369155  3100 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.462026  3103 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:32.468757  3194 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:01:32.470505  2365 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:32.470827  2891 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.471560  3112 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.471928  2827 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.472234  2948 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:32.473853  3058 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:32.479367  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.438872  2955 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.497449  1608 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:32.483460  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:32.485220  2899 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.443889  3096 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:32.419180  2909 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:01:32.474005  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.491892  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.488021  1610 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:32.493113  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:32.502664  1532 raft_consensus.cc:2393] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:32.480198  3103 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:32.488580  2827 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.481228  2943 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:01:32.508737  3112 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.503607  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.515287  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.516510  1505 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.517256  3058 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:32.517729  3058 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.518141  3058 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.518829  3077 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.520283  2905 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.508181  1540 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:32.505426  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:32.523077  1535 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.508373  3095 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:32.497022  2878 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.512720  2948 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:32.512853  3196 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:01:32.467757  3091 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:01:32.517818  3105 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:32.499608  1534 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:32.539765  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:32.524067  2905 raft_consensus.cc:2764] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:01:32.524761  3093 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:32.525705  3077 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.521793  2827 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.521804  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.541273  1687 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.527773  2891 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.486614  3122 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:32.509955  3041 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:32.477774  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 221663us
I20260709 13:01:32.526298  2899 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.509115  3103 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:32.542798  3189 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.404s	user 0.003s	sys 0.000s
I20260709 13:01:32.548287  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:32.562677  1534 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:32.552335  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.500628  3173 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:01:32.546768  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:32.559304  2948 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.561004  2955 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:32.532155  3136 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.564752  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.564010  1579 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.538391  3095 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:32.536640  3096 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:01:32.638780  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 74918us
I20260709 13:01:32.555565  2878 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.642371  1686 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:32.644564  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 79912.3us
I20260709 13:01:32.667523  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.618422  3149 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.645601  2915 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:32.673517  3203 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:32.600416  3052 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.676059  3097 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:32.676513  3097 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.600224  2369 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:01:32.678861  2369 pending_rounds.cc:85] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Aborting all ops after (but not including) 2
I20260709 13:01:32.679178  2369 pending_rounds.cc:107] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:01:32.679490  2369 raft_consensus.cc:2917] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:01:32.679893  2369 raft_consensus.cc:2889] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:32.680025  1615 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:32.642261  3091 raft_consensus.cc:2764] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:01:32.642064  3192 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:01:32.681298  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.573544  3090 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.694468  1539 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:32.652842  3174 raft_consensus.cc:3055] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:32.654333  1687 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:32.655341  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.657222  3120 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.628821  3100 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.658346  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:32.658874  3041 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:32.663100  1685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35722 (request call id 86) took 2400 ms (client timeout 1884 ms). Trace:
I20260709 13:01:32.664286  1540 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:32.728407  1579 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:32.664503  1535 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:32.664918  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:32.670076  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:32.729727  1613 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:32.670038  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.664860  3095 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.672878  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:32.674783  2878 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:32.674890  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:32.671512  3177 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.555864  1533 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:32.647485  3136 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.704638  3161 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:32.651464  3172 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.576355  3112 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.695987  1689 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:32.591267  3182 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.618083  3109 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.555570  3180 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.141s
I20260709 13:01:32.556737  2942 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:01:32.733338  1541 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:01:32.728018  1685 rpcz_store.cc:269] 0709 13:01:30.262776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.262911 (+   135us) service_pool.cc:224] Handling call
0709 13:01:32.662905 (+2399994us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54000d61d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:32.663011 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4757374848}
W20260709 13:01:32.737805  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 67885us
I20260709 13:01:32.699039  3174 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:32.773258  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:32.751119  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:32.751866  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:32.779444  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.795421  1613 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:32.788004  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.745827  2973 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:32.749075  1610 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.798792  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.731148  3096 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.804122  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.734341  3163 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:01:32.780967  3077 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:32.832643  3077 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.834218  3116 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:32.834882  3077 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:32.835493  1607 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:32.836771  3205 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:01:32.841321  3135 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.850448  2973 raft_consensus.cc:697] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:32.851470  2973 consensus_queue.cc:237] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.855038  2878 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.860051  3012 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.865330  3090 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:32.814870  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.777979  3112 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:32.828281  3177 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:32.829387  2905 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:32.802677  3136 raft_consensus.cc:2764] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:01:32.870913  1687 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:01:32.871781  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57002.2us
I20260709 13:01:32.881137  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.882519  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.745946  2932 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:01:32.799692  2899 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.886881  3173 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.887780  3173 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:32.888406  3173 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:32.889155  2827 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.891511  2827 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:32.886973  2899 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:32.893289  1533 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:32.893101  2899 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.894538  1532 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:32.896670  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:32.897437  1533 raft_consensus.cc:2368] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4.
I20260709 13:01:32.884855  3174 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.785925  3182 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.814568  3100 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:32.913774  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:32.902647  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.914817  3113 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:01:32.901569  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:32.916721  1681 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:32.735525  3041 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:32.918303  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:32.919494  3211 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.204s	user 0.000s	sys 0.005s
I20260709 13:01:32.720706  3120 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.913944  3100 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:32.922735  1690 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:32.923540  3100 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.924309  3112 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:32.922179  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:32.908761  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:32.880466  3191 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:01:32.930483  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:32.942587  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:32.945554  1686 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:32.879087  2905 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:32.937714  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:32.951707  1683 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:32.876715  3109 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:32.944939  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.932760  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:32.949848  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:33.017462  1611 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:33.041787  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:32.971971  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:32.904438  3108 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:01:32.942559  3136 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:32.907023  2963 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:33.016142  1615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:01:32.929157  3177 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:33.276715  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 331889us
I20260709 13:01:33.300625  1615 raft_consensus.cc:606] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:33.301000  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:33.301023  1615 raft_consensus.cc:614] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:33.282572  3142 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.009s
I20260709 13:01:33.282729  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:33.282931  3082 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.009753  3174 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:33.283793  3058 consensus_meta.cc:287] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.008s
I20260709 13:01:33.283916  1683 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:33.284162  3052 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:32.960296  3109 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:33.287159  3095 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:33.287681  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 246003us
I20260709 13:01:33.355568  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:33.237201  3161 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:33.356912  3161 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.302651  3193 raft_consensus.cc:2764] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:01:33.289335  3103 consensus_meta.cc:287] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.714s	user 0.013s	sys 0.005s
I20260709 13:01:33.294070  1682 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
W20260709 13:01:32.949079  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 68773us
W20260709 13:01:33.126876  3210 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:01:33.290086  3097 consensus_meta.cc:287] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.007s
I20260709 13:01:33.277100  2878 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.298990  1610 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:33.314635  1616 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:33.335513  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 402907us
W20260709 13:01:33.313194  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.306793  3177 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:33.307336  3222 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.382557  1615 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:01:33.416383  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.406294  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:33.381938  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:33.376149  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.421433  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:33.355525  3109 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:33.308818  2963 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:33.398617  3215 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:01:33.435861  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:33.380216  3193 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:33.458384  3235 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:33.465224  1532 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:33.399353  3142 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53388 (request call id 270) took 3143 ms. Trace:
I20260709 13:01:33.426298  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:33.468600  1683 raft_consensus.cc:606] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:33.516662  1683 raft_consensus.cc:614] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:33.516754  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 90554.4us
W20260709 13:01:33.456543  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.416402  3177 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:33.347772  3058 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.383266  1607 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:33.497399  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1340) took 1339 ms. Trace:
I20260709 13:01:33.529721  1690 rpcz_store.cc:276] 0709 13:01:32.157715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.157842 (+   127us) service_pool.cc:224] Handling call
0709 13:01:33.497142 (+1339300us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b5400433854. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:33.497322 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730211200}
I20260709 13:01:33.471618  1541 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:33.425428  3094 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:33.473819  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:33.515235  3226 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:33.352165  3082 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.471843  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:33.537319  3082 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:33.365275  3095 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.540481  2963 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:33.540758  3173 consensus_meta.cc:287] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.652s	user 0.017s	sys 0.000s
I20260709 13:01:33.541201  3173 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.541802  3095 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:33.368459  3103 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:33.426262  3169 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:33.400576  3097 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:33.532676  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 88241.8us
I20260709 13:01:33.382145  3181 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:01:33.355209  2905 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.554805  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:33.555790  1689 raft_consensus.cc:2410] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:33.463444  3163 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
W20260709 13:01:33.564191  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 90501.7us
I20260709 13:01:33.543660  2827 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.539654  3094 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:33.642580  3094 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:33.463423  2328 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:01:33.650734  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 229119us
W20260709 13:01:33.607908  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 50647us
I20260709 13:01:33.621012  1684 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:33.621402  3232 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.678516  3232 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.681453  3232 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:33.616829  3122 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:33.622298  2827 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.683756  2827 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:33.632016  3173 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:33.638038  3097 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:33.640375  3103 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:33.652220  2955 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:33.660686  3108 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:33.551433  3213 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:01:33.670908  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:33.674209  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba63305badaf4879aab6ec160417462c"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:33.712072  1682 raft_consensus.cc:606] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:33.712282  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:33.677685  3205 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:01:33.559231  3226 raft_consensus.cc:697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:33.726605  1533 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:33.693327  3182 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:33.620308  3169 raft_consensus.cc:697] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:33.503355  3142 rpcz_store.cc:276] 0709 13:01:30.255606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:30.266220 (+ 10614us) service_pool.cc:224] Handling call
0709 13:01:30.541569 (+275349us) ts_tablet_manager.cc:934] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
0709 13:01:32.257569 (+1716000us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:01:32.599661 (+342092us) tablet_metadata.cc:665] Metadata flushed
0709 13:01:32.599819 (+   158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:01:33.338971 (+739152us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:01:33.367467 (+ 28496us) tablet_replica.cc:206] Creating consensus instance
0709 13:01:33.399170 (+ 31703us) ts_tablet_manager.cc:989] Replica registered.
0709 13:01:33.399252 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":85329,"tablet-copy.queue_time_us":86930,"thread_start_us":134284,"threads_started":2}
I20260709 13:01:33.713183  1690 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:33.747747  3142 tablet_copy_client.cc:806] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:01:33.708927  2955 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:33.748376  2955 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:33.748503  3142 tablet_copy_client.cc:670] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:01:33.744953  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:33.709295  2878 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:01:33.882707  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 167764us
I20260709 13:01:33.789646  3226 consensus_queue.cc:237] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:33.888687  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:33.887401  1654 leader_election.cc:400] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4.
I20260709 13:01:33.877763  3169 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:33.890652  1654 leader_election.cc:403] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:33.891160  1688 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:33.901006  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 479632us
I20260709 13:01:33.909965  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:33.866405  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 101) took 1203 ms. Trace:
I20260709 13:01:33.891140  3182 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.915675  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:33.874028  3177 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.929251  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:33.901085  2948 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 13:01:33.941815  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.009s	sys 0.015s
W20260709 13:01:33.907372  3161 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.009s	sys 0.005s
I20260709 13:01:33.958693  1688 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:33.920193  3219 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4.
I20260709 13:01:33.946451  2973 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:33.955376  3177 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:33.942298  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.009s	sys 0.015s
I20260709 13:01:33.933966  3241 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:33.933065  3077 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:33.934841  3097 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:33.934705  3103 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:33.919961  2955 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:33.969650  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:33.939177  3224 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:33.933472  3041 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:33.926189  3012 consensus_queue.cc:1059] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:01:33.982717  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:34.015005  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:33.965627  3052 consensus_meta.cc:287] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
I20260709 13:01:33.914456  1684 rpcz_store.cc:276] 0709 13:01:32.662788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.662921 (+   133us) service_pool.cc:224] Handling call
0709 13:01:32.663289 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.659082 (+995793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.857981 (+198899us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54002d6c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:33.866285 (+  8304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202261248}
I20260709 13:01:33.939249  3253 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:33.979913  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:33.971330  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:33.929275  3182 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.026574  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:34.027676  1504 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:33.970463  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 318206us
I20260709 13:01:33.981431  3241 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:34.031694  3241 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.040386  3249 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:34.040985  3249 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.041416  3249 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.043622  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1385) took 1150 ms. Trace:
I20260709 13:01:34.044265  3103 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:34.045352  3103 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.046150  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.016465  3248 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:34.051105  1541 rpcz_store.cc:276] 0709 13:01:32.893373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.908252 (+ 14879us) service_pool.cc:224] Handling call
0709 13:01:33.397237 (+488985us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b5800001298. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:01:33.397499 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.531570 (+134071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.041991 (+510421us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b540012c120. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7fdc0 00007fd02eb0ba02 00007fd02eb07dd6 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:01:34.043438 (+  1447us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b540006b654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:34.043569 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188467840}
I20260709 13:01:34.064232  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.012975  3082 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:34.068027  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.020673  3052 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:34.079147  1690 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.019977  3253 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:34.062039  3109 consensus_meta.cc:287] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 13:01:33.971997  2878 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.073204  3174 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:01:33.978942  3097 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.064230  3173 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:01:33.976439  3077 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:33.976174  2973 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.064333  3248 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:34.020364  3224 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:34.067181  1689 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:34.126812  3182 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.127351  3097 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.083777  3253 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:34.128376  3077 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.129280  2955 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.133493  3255 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:34.129742  1682 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:34.134616  3255 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:34.135444  3255 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:34.078917  3082 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.110119  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:34.113229  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:34.138033  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 222501us
I20260709 13:01:34.120752  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1407) took 1167 ms. Trace:
I20260709 13:01:34.140831  1613 rpcz_store.cc:276] 0709 13:01:32.953725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.953884 (+   159us) service_pool.cc:224] Handling call
0709 13:01:32.954261 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:33.018163 (+ 63902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.018192 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:33.685744 (+667552us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b2c0000e5c8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:01:33.686268 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:01:33.976672 (+290404us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:33.976711 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:33.976794 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.120277 (+143483us) raft_consensus.cc:1685] finished
0709 13:01:34.120301 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.120667 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63475,"raft.queue_time_us":70045,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":62401,"spinlock_wait_cycles":10798848,"thread_start_us":289962,"threads_started":1,"wal-append.queue_time_us":392524}
I20260709 13:01:34.091579  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.144426  1534 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:34.068356  3233 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.050338  3252 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.062847  3177 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:34.134452  2905 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.092635  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.158951  1541 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:34.093909  3142 tablet_copy_client.cc:538] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:01:34.085355  3112 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.123595  3232 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.166415  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:34.148681  3248 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.149580  3233 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.167642  3082 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.173544  3255 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.176055  3232 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.180814  3077 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.181046  3082 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.164542  3177 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:34.184401  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:34.175989  3093 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.156831  3100 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:34.177887  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.087527  3109 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.088328  3094 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.198937  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:34.218552  1615 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:34.186879  3233 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.204516  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:34.215556  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.222875  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:34.223960  1615 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:34.170792  3171 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:01:34.229672  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:34.230676  1615 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:34.198401  3093 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.218168  1684 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:34.201407  2973 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:34.269397  1688 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:34.201493  3100 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:34.274271  1536 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.175439  3112 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.187342  3248 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.273578  1686 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:34.279210  3093 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.227022  3136 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.196602  3077 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.272130  3174 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:34.325584  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 100362us
I20260709 13:01:34.199334  3082 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.276625  2368 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:34.326346  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 139040us
I20260709 13:01:34.328226  1536 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:34.341789  2364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46612 (request call id 114) took 2455 ms. Trace:
I20260709 13:01:34.347170  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.338558  1615 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:34.276787  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:34.355674  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.358070  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:34.358713  1608 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:34.359970  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.360605  1615 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:34.401806  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.402719  1532 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.352883  3255 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:34.337481  3213 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:34.354647  3097 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.342391  2364 rpcz_store.cc:276] 0709 13:01:31.886342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:31.910049 (+ 23707us) service_pool.cc:224] Handling call
0709 13:01:31.954349 (+ 44300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:32.679300 (+724951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:32.679341 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:32.679985 (+   644us) log.cc:844] Serialized 52 byte log entry
0709 13:01:32.819494 (+139509us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:32.875537 (+ 56043us) log.cc:844] Serialized 14 byte log entry
0709 13:01:32.947347 (+ 71810us) log.cc:844] Serialized 14 byte log entry
0709 13:01:33.056020 (+108673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.341101 (+1285081us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54001a5c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:34.341177 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.341413 (+   236us) raft_consensus.cc:1685] finished
0709 13:01:34.341434 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:34.341663 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62381,"prepare.queue_time_us":24727,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":103,"raft.queue_time_us":90763,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":45914,"spinlock_wait_cycles":1662181120,"thread_start_us":112593,"threads_started":1,"wal-append.queue_time_us":181532}
I20260709 13:01:34.418875  3248 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.398567  3100 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.322906  3177 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.422199  3100 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.422556  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.423591  1539 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:34.424482  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.424636  3232 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.425241  3241 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.425628  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.425930  3241 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.426080  3213 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.347783  3174 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.429934  3174 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:34.432771  3262 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:01:34.441066  1532 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:34.442458  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.443971  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.336745  3136 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.452651  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.464701  3120 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.465289  3077 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.467341  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:34.468371  3241 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.469152  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.412700  2973 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.475731  1539 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:34.454448  3232 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.436595  3097 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.570611  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.572840  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.566370  1684 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:34.579402  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.556339  3082 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.581478  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:34.482308  2973 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:34.552291  3272 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.227s	user 0.001s	sys 0.001s
W20260709 13:01:34.510573  3264 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:01:34.584702  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.587239  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.582108  3094 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.604826  1611 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:34.521737  3077 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.509879  3109 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.611771  1683 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:34.593091  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:34.614859  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:34.624814  1684 raft_consensus.cc:2368] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
W20260709 13:01:34.617319  3249 consensus_meta.cc:287] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.575s	user 0.012s	sys 0.000s
I20260709 13:01:34.591221  3161 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.625797  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:01:34.609515  3266 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:01:34.535022  3177 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.518009  3232 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:34.611869  3279 log.cc:927] Time spent T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:01:34.639586  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.627872  3161 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.627473  3077 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.623111  3112 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.591398  3253 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.632829  2942 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.611536  3276 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.646916  3161 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.639297  3177 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.647760  3088 consensus_queue.cc:1059] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:01:34.654253  2942 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.663472  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.647993  3193 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.630724  3249 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.673380  3193 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.673862  3193 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.674993  3249 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.675800  3058 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.676976  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:34.677075  1537 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:34.637995  3122 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:01:34.657889  3082 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.663870  3136 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.672391  2942 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.691640  3249 raft_consensus.cc:1064] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:34.691936  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.699508  3093 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.694813  3082 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.701838  3093 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.686755  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 92) took 1782 ms. Trace:
W20260709 13:01:34.703238  3277 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:01:34.703074  1533 rpcz_store.cc:276] 0709 13:01:32.900794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.905027 (+  4233us) service_pool.cc:224] Handling call
0709 13:01:32.958988 (+ 53961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:33.737452 (+778464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.664567 (+927115us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b5400400954. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:34.682874 (+ 18307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1620979072}
W20260709 13:01:34.707052  3263 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 13:01:34.709582  2328 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:34.711874  3232 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:34.660147  3276 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.722832  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.736586  3253 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:34.738842  3252 consensus_meta.cc:287] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.004s
I20260709 13:01:34.739272  3252 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:34.741154  3177 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.741730  3276 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.734442  3097 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.743217  3219 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:34.743772  3219 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:34.744668  3219 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.746212  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:34.746898  1687 raft_consensus.cc:2368] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:34.730901  3041 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:34.747725  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.749440  2973 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.749670  3224 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:34.750321  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.750233  3249 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.751580  1538 raft_consensus.cc:2410] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:34.747927  3094 raft_consensus.cc:993] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:01:34.752287  3094 raft_consensus.cc:1081] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Signalling peer e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:01:34.754747  1532 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:34.760192  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.743314  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.762856  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.764149  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.764231  3193 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.770238  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.771215  1541 raft_consensus.cc:2410] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:34.771457  3193 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.747668  3041 raft_consensus.cc:697] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:34.772176  3142 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:01:34.727994  3169 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:01:34.773025  3041 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.761637  1538 raft_consensus.cc:2393] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:34.739651  3233 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:34.799068  3258 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.601s	user 0.000s	sys 0.003s
I20260709 13:01:34.800769  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.782439  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1358) took 1342 ms. Trace:
I20260709 13:01:34.807121  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:34.808123  1609 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:34.813006  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.806622  1686 rpcz_store.cc:276] 0709 13:01:33.439951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.442056 (+  2105us) service_pool.cc:224] Handling call
0709 13:01:33.442465 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.289499 (+847034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.782078 (+492579us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54002eb3d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:34.782355 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910915840}
I20260709 13:01:34.818300  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:34.820538  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.821599  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:34.822518  1609 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.823645  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:34.824481  1613 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.830163  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.831171  1541 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:34.832648  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.833438  1534 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:34.834542  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.835170  1534 raft_consensus.cc:2376] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3. Re-sending same reply.
I20260709 13:01:34.779929  3082 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.838443  3255 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.838903  3213 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.839078  3255 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.841890  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.842584  1538 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:34.843242  1613 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:34.843506  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.844939  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.846812  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.807389  3233 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:34.851929  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:34.812981  3224 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:34.853350  1686 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:34.781008  3161 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.855225  1690 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:34.805907  1533 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:34.894094  1609 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:34.859475  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:34.909952  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:34.864226  1613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba63305badaf4879aab6ec160417462c"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:01:34.914775  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.915241  1613 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:34.915787  1613 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.916770  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.917831  1538 raft_consensus.cc:2410] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:01:34.912272  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 183507us
I20260709 13:01:34.919188  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:34.922079  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:34.917208  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 79937us
I20260709 13:01:34.916157  3224 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.926249  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:34.930302  3160 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.930759  3160 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.931099  3224 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.899310  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:34.928201  1579 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:34.935024  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:34.936776  3161 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.926939  3291 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:34.891559  2942 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.937114  3135 raft_consensus.cc:1064] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:34.954095  2942 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.954552  3135 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.958129  3249 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.958689  3249 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.928179  3252 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:34.960505  3252 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:34.961069  2878 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:34.961621  2878 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:34.962437  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:34.963011  3252 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:34.963222  3109 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:34.939493  3233 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:34.933272  3103 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:34.940155  3177 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:34.940932  3058 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:34.871174  3171 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:34.938916  2369 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:34.935909  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:34.936800  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:34.965119  1688 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:34.963080  1539 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:35.013139  2915 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:35.013872  2915 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.014314  2915 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:35.012017  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 76195.1us
I20260709 13:01:34.931098  3160 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.951262  1610 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:34.952095  3291 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:34.978364  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:35.018676  1504 leader_election.cc:400] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:35.035611  1504 leader_election.cc:403] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:35.037350  1504 leader_election.cc:400] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:35.037746  1504 leader_election.cc:403] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:01:35.039158  3260 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:35.035130  2948 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:35.041043  3094 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:35.040916  2948 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:35.041779  3094 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:34.963675  3252 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:35.012012  3103 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:34.989426  3161 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:35.023556  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:35.026755  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:34.968415  3232 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:35.026779  3108 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:34.942212  2364 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
W20260709 13:01:35.028909  3288 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.064s	user 0.001s	sys 0.011s
I20260709 13:01:35.039983  3260 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.045197  3136 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:35.064760  3136 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:35.050745  2905 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.065394  3260 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:34.964522  3112 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.066860  3112 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:35.044791  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 66545us
I20260709 13:01:35.068166  1532 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:35.043026  3094 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.069720  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:35.045454  3291 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.019919  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:34.952131  1533 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:01:34.998256  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:34.999681  3249 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:35.034399  3177 consensus_queue.cc:1243] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:35.043779  2948 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:34.969705  3090 consensus_queue.cc:1059] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:01:35.034193  3058 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.059496  3241 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:01:34.872555  3255 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:35.020114  3171 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:35.090855  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.071861  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:34.963564  2878 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:34.959887  3174 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:35.072916  3161 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:34.963822  3109 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:35.077381  3232 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:35.080771  1539 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:35.081913  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.055045  3103 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.055670  3298 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:34.947883  1613 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.085292  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.092594  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:35.061358  3295 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:35.093528  2329 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:35.089671  3082 raft_consensus.cc:3055] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:35.055313  3252 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.079766  3169 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:01:35.109858  1653 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:35.116572  3249 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:35.125396  1614 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.125339  1683 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
I20260709 13:01:35.096671  3112 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:35.107161  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:35.157032  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 47279.9us
W20260709 13:01:35.136669  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 82686us
I20260709 13:01:35.092568  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:35.108124  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1359) took 1029 ms. Trace:
I20260709 13:01:35.120888  2948 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:35.197419  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.083889  2915 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:35.108552  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:35.171096  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:35.172587  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.173806  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.174597  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.175356  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.177141  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.177486  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.132742  3082 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:35.126595  3174 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:35.132257  3298 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:35.661842  1611 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:35.154953  3113 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:35.660524  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:35.207271  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.617229  1610 consensus_meta.cc:287] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.002s
I20260709 13:01:35.249068  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.679261  1686 raft_consensus.cc:2410] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:01:35.579010  1580 connection.cc:256] RPC call timeout handler was delayed by -1.822333317000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2135s for a response
W20260709 13:01:35.516831  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.503051  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 409672us
I20260709 13:01:35.199574  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:35.320027  1504 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:35.402498  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:35.242386  1687 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:35.136868  3161 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:35.716544  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.509713  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.716104  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:35.442391  3259 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:01:35.157773  3120 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:35.683867  1614 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.545s	user 0.003s	sys 0.007s
I20260709 13:01:35.742080  1614 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
W20260709 13:01:35.720086  1580 connection.cc:256] RPC call timeout handler was delayed by -1.8043333169999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 13:01:35.721717  1615 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.741770  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.731652  1610 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:35.737323  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:35.720937  1539 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.024s	sys 0.051s
I20260709 13:01:35.740362  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.746235  1683 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:35.740648  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:35.409183  3305 log.cc:927] Time spent T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:01:35.752199  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:35.260437  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:35.748710  1539 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.024s	sys 0.055s
I20260709 13:01:35.749030  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbc0065dafc14741989730fd503966f0"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:35.755721  1686 raft_consensus.cc:606] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
W20260709 13:01:35.449776  3307 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:01:35.754968  1541 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:35.449142  3306 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:35.479959  3058 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:35.260666  3093 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:35.403565  3035 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:35.501534  2905 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:35.595885  3241 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:35.196792  3112 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.556s
I20260709 13:01:35.652498  3309 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:35.765110  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:35.309811  2878 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.455s
I20260709 13:01:35.779654  1615 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:35.476006  3160 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.170113  3249 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:35.796669  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:35.760447  3163 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.007s	sys 0.010s
I20260709 13:01:35.735263  2948 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:35.831097  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 66162.3us
I20260709 13:01:35.840480  1541 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:35.841610  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:35.764976  3233 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:35.321678  3232 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.851576  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1404) took 1651 ms. Trace:
W20260709 13:01:35.836687  3259 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:01:35.855149  1541 rpcz_store.cc:276] 0709 13:01:34.200193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.846121 (+1645928us) service_pool.cc:224] Handling call
0709 13:01:35.846701 (+   580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.846898 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.846924 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.850220 (+  3296us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:35.850278 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.850361 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.851471 (+  1110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:35.840339  3163 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.007s	sys 0.011s
I20260709 13:01:35.860862  1684 raft_consensus.cc:2368] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3.
I20260709 13:01:35.197073  1533 rpcz_store.cc:276] 0709 13:01:34.072703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.942690 (+869987us) service_pool.cc:224] Handling call
0709 13:01:34.951829 (+  9139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.083342 (+131513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.102153 (+ 18811us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.870837  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1352) took 1800 ms. Trace:
I20260709 13:01:35.871340  1534 rpcz_store.cc:276] 0709 13:01:34.070785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.929513 (+858728us) service_pool.cc:224] Handling call
0709 13:01:34.933267 (+  3754us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.945045 (+ 11778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.945093 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.028542 (+ 83449us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.075835 (+ 47293us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:35.075888 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.075979 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:35.870607 (+794628us) raft_consensus.cc:1685] finished
0709 13:01:35.870630 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.870768 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17067,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":46861,"threads_started":1,"wal-append.queue_time_us":99079}
I20260709 13:01:35.873665  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1406) took 1672 ms. Trace:
I20260709 13:01:35.875970  1534 rpcz_store.cc:276] 0709 13:01:34.201742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.872846 (+1671104us) service_pool.cc:224] Handling call
0709 13:01:35.873160 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.873348 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.873374 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.873415 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:35.873454 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.873507 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.873610 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.877794  1534 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:35.878587  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1407) took 1675 ms. Trace:
I20260709 13:01:35.878948  1534 rpcz_store.cc:276] 0709 13:01:34.202875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.876971 (+1674096us) service_pool.cc:224] Handling call
0709 13:01:35.877369 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.878298 (+   929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.878533 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:35.877012  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 557145us
I20260709 13:01:35.829766  3035 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.829902  3093 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.891454  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1405) took 1690 ms. Trace:
I20260709 13:01:35.849539  3233 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:35.895655  1541 rpcz_store.cc:276] 0709 13:01:34.200838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.856916 (+1656078us) service_pool.cc:224] Handling call
0709 13:01:35.890660 (+ 33744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.891073 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.891102 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.891162 (+    60us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:35.891198 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.891262 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.891377 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.832010  3309 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:35.901829  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1409) took 1697 ms. Trace:
I20260709 13:01:35.829953  3241 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:35.829286  3082 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.910120  1686 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:35.911012  1534 rpcz_store.cc:276] 0709 13:01:34.203948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.879755 (+1675807us) service_pool.cc:224] Handling call
0709 13:01:35.901111 (+ 21356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.901378 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.901416 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.901479 (+    63us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:35.901523 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.901597 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.901745 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.907084  3113 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:35.922989  2948 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:35.898665  3233 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:35.929947  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1411) took 1495 ms. Trace:
I20260709 13:01:35.930445  1541 rpcz_store.cc:276] 0709 13:01:34.435066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.925334 (+1490268us) service_pool.cc:224] Handling call
0709 13:01:35.929392 (+  4058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.929589 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.929617 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.929661 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:35.929688 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.929744 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.929880 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.935861  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 98) took 2509 ms. Trace:
W20260709 13:01:35.913605  3291 consensus_meta.cc:287] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.828s	user 0.009s	sys 0.002s
I20260709 13:01:35.939651  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1412) took 1135 ms. Trace:
I20260709 13:01:35.940218  1541 rpcz_store.cc:276] 0709 13:01:34.804469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.938746 (+1134277us) service_pool.cc:224] Handling call
0709 13:01:35.939136 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.939319 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.939346 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.939389 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:35.939420 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.939473 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.939589 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:35.849012  3161 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.936302  1535 rpcz_store.cc:276] 0709 13:01:33.422861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.423446 (+   585us) service_pool.cc:224] Handling call
0709 13:01:33.423892 (+   446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:33.721143 (+297251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:33.721187 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:33.881886 (+160699us) log.cc:844] Serialized 52 byte log entry
0709 13:01:34.054058 (+172172us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:34.074946 (+ 20888us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.082688 (+  7742us) log.cc:844] Serialized 14 byte log entry
0709 13:01:34.082945 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:34.083036 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:34.115839 (+ 32803us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b18001d9ce0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b522 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:01:34.766788 (+650949us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18001d9ce0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1
0709 13:01:34.999025 (+232237us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18001d9ce0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:01:35.098337 (+ 99312us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18001d9ce0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:01:35.926196 (+827859us) raft_consensus.cc:1685] finished
0709 13:01:35.926227 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.932619 (+  6392us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3801,"prepare.queue_time_us":65201,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":90,"raft.queue_time_us":38010,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":6344,"spinlock_wait_cycles":55544576,"thread_start_us":428650,"threads_started":2,"wal-append.queue_time_us":183524}
I20260709 13:01:35.953430  1535 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:35.966035  1535 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:35.967417  1686 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:35.968385  1683 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:35.969003  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:35.932322  3103 consensus_meta.cc:287] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.794s	user 0.006s	sys 0.005s
I20260709 13:01:35.972349  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.978685  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:35.983403  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:35.943076  2915 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:35.985936  1685 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:35.990670  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1416) took 1795 ms. Trace:
I20260709 13:01:35.991097  1607 rpcz_store.cc:276] 0709 13:01:34.195445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.198121 (+  2676us) service_pool.cc:224] Handling call
0709 13:01:35.893940 (+1695819us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:01:35.912104 (+ 18164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.933237 (+ 21133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.935652 (+  2415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.962377 (+ 26725us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:35.970099 (+  7722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.979138 (+  9039us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:35.990607 (+ 11469us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16602368}
I20260709 13:01:35.991886  3241 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:35.993575  3093 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:35.985504  3174 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:35.981758  3120 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:35.998318  3285 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.275s	user 0.005s	sys 0.005s
I20260709 13:01:35.998993  3249 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:35.970263  3082 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:35.999169  3120 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:36.000649  1613 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.001157  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57548 (request call id 1441) took 1152 ms. Trace:
I20260709 13:01:36.001443  1613 rpcz_store.cc:276] 0709 13:01:34.849116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.849327 (+   211us) service_pool.cc:224] Handling call
0709 13:01:36.000544 (+1151217us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4c00021b00. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02cdd4a20 00007fd02cde5a29 00007fd02cde613f 00007fd02cdaa2ab 00007fd02cdd7f3c 00007fd02cdd83fe 00007fd02d06588b 00007fd02ea64495 00007fd02eab530f 00007fd02eaffa55 00007fd033acfcd0
0709 13:01:36.001074 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5685632}
I20260709 13:01:35.983887  1535 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.015777  1690 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:36.013351  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:36.019683  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8464531709643ab8a8fd947089037ef"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:36.020388  1682 raft_consensus.cc:606] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
W20260709 13:01:36.022001  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 278642us
W20260709 13:01:36.023770  1580 leader_election.cc:336] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.911s (SENT)
I20260709 13:01:36.024446  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:35.987689  3226 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:35.963004  3291 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:35.980059  3103 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.034327  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1414) took 1229 ms. Trace:
I20260709 13:01:36.027707  3090 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:36.014495  3174 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:36.040354   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:36.019042  3241 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:36.039045  1541 rpcz_store.cc:276] 0709 13:01:34.805063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.941588 (+1136525us) service_pool.cc:224] Handling call
0709 13:01:35.942101 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.942369 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:35.986560 (+ 44191us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.033436 (+ 46876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.033519 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:36.033574 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.033650 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.033798 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44031,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":183,"spinlock_wait_cycles":11022080,"thread_start_us":45173,"threads_started":1}
W20260709 13:01:36.066609  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.072556  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48927.7us
W20260709 13:01:36.073921  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.074278  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:36.074926  1580 connection.cc:256] RPC call timeout handler was delayed by -1.6753406949999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
W20260709 13:01:36.075388  1580 connection.cc:256] RPC call timeout handler was delayed by -1.6563066440000398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:01:36.078433  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:36.079571  1534 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:36.090407  3109 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:36.091171  3109 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:36.100385   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:36.100812  3321 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.101615  3321 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:36.087749  2368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46612 (request call id 118) took 2117 ms. Trace:
I20260709 13:01:36.104761  2368 rpcz_store.cc:276] 0709 13:01:33.970581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.974274 (+  3693us) service_pool.cc:224] Handling call
0709 13:01:34.050373 (+ 76099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:34.352594 (+302221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.087367 (+1734773us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540061e754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:36.087656 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436072832}
I20260709 13:01:36.108518  3252 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.110256  1436 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 3, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.114579  3077 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.115285  3077 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:36.121066  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.121794  1534 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
W20260709 13:01:36.122243  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.122714  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.123319  1534 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
W20260709 13:01:36.124464  3301 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.553s	user 0.002s	sys 0.000s
I20260709 13:01:36.091795  3109 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.125792  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1440) took 1295 ms. Trace:
I20260709 13:01:36.127374  3109 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.126324  1608 rpcz_store.cc:276] 0709 13:01:34.830906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.831013 (+   107us) service_pool.cc:224] Handling call
0709 13:01:34.831329 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.850635 (+ 19306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.850666 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.911975 (+ 61309us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.170605 (+258630us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:35.170669 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.170778 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.123860 (+953082us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:01:36.125343 (+  1483us) raft_consensus.cc:1685] finished
0709 13:01:36.125376 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.125703 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18909,"raft.queue_time_us":22483,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":23969,"spinlock_wait_cycles":22058368,"thread_start_us":233338,"threads_started":1,"wal-append.queue_time_us":647118}
I20260709 13:01:36.124593  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:36.128683  3303 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.597s	user 0.003s	sys 0.000s
I20260709 13:01:36.129757  3321 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:36.119776  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 183) took 8152 ms. Trace:
I20260709 13:01:36.131592  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1443) took 1261 ms. Trace:
I20260709 13:01:36.132119  1612 rpcz_store.cc:276] 0709 13:01:34.869969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.870100 (+   131us) service_pool.cc:224] Handling call
0709 13:01:34.870468 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.870674 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.870711 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.917647 (+ 46936us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.118560 (+200913us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:35.118596 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.118662 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.128080 (+1009418us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:01:36.131317 (+  3237us) raft_consensus.cc:1685] finished
0709 13:01:36.131337 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.131538 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128225536,"thread_start_us":158364,"threads_started":1,"wal-append.queue_time_us":598036}
I20260709 13:01:36.134083  3077 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:36.134640  3077 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:36.136683  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1193) took 1474 ms. Trace:
I20260709 13:01:36.137473  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.136735  3077 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:36.139158  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.113721  1436 catalog_manager.cc:5697] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 3, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:36.139606  1534 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:36.137207  1688 rpcz_store.cc:276] 0709 13:01:34.662768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.663132 (+   364us) service_pool.cc:224] Handling call
0709 13:01:36.136498 (+1473366us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b54002ebdd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:36.136625 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676337024}
I20260709 13:01:36.145959  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1403) took 1942 ms. Trace:
I20260709 13:01:36.131219  1437 rpcz_store.cc:276] 0709 13:01:27.967268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:27.967521 (+   253us) service_pool.cc:224] Handling call
0709 13:01:36.119690 (+8152169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:32.037438 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:32.038809 (+  1371us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:32.038860 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:01:32.038888 (+    28us) tablet.cc:662] Decoding operations
0709 13:01:32.039565 (+   677us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:32.039668 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:32.039709 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:32.040177 (+   468us) tablet.cc:701] Row locks acquired
0709 13:01:32.040203 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:01:32.040393 (+   190us) write_op.cc:270] Start()
0709 13:01:32.040550 (+   157us) write_op.cc:276] Timestamp: P: 1783602092040335 usec, L: 0
0709 13:01:32.040583 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:01:32.041475 (+   892us) log.cc:844] Serialized 1364 byte log entry
0709 13:01:33.292803 (+1251328us) op_driver.cc:464] REPLICATION: finished
0709 13:01:33.434929 (+142126us) write_op.cc:301] APPLY: starting
0709 13:01:33.435053 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:33.435273 (+   220us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:33.435478 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:33.436293 (+   815us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:33.436543 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:33.436611 (+    68us) write_op.cc:312] APPLY: finished
0709 13:01:33.436933 (+   322us) log.cc:844] Serialized 34 byte log entry
0709 13:01:33.437158 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:33.437314 (+   156us) write_op.cc:454] Released schema lock
0709 13:01:33.437378 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:34.033190 (+595812us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b180001c960. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd03253eef0 00007fd03253f489 00007fd03254171a
0709 13:01:34.033335 (+   145us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:34.033369 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18638,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":141793,"apply.run_cpu_time_us":3006,"apply.run_wall_time_us":7640,"num_ops":3,"prepare.queue_time_us":206716,"prepare.run_cpu_time_us":5634,"prepare.run_wall_time_us":5632,"raft.queue_time_us":517217,"raft.run_cpu_time_us":15369,"raft.run_wall_time_us":741183,"replication_time_us":1252076,"spinlock_wait_cycles":86890880,"thread_start_us":765505,"threads_started":4,"wal-append.queue_time_us":20756,"wal-append.run_cpu_time_us":31768,"wal-append.run_wall_time_us":2385874}]]}
I20260709 13:01:36.027050  3315 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:01:36.147400  1539 rpcz_store.cc:276] 0709 13:01:34.198922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.103765 (+904843us) service_pool.cc:224] Handling call
0709 13:01:35.104087 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.104298 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:35.756682 (+652384us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.141189 (+384507us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.141236 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:36.141275 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.141340 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.141440 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":739828,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":62701,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":1009501,"threads_started":3,"wal-append.queue_time_us":280233}
I20260709 13:01:36.041720  3160 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:36.041625  3090 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:36.167949  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.165783  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.140455  3035 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:36.215224  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.189523  3318 log.cc:927] Time spent T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:01:36.191498  3317 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:01:36.192514  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:36.192925  3313 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:01:36.142469  3241 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:36.187490  3090 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.195108  3103 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:36.195788  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.230214  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:36.139676  3174 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.211786  3291 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.212838  3309 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:36.234498  1539 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:36.236238  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.238597  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.239779  1539 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:36.241273  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:36.243664  1580 connection.cc:256] RPC call timeout handler was delayed by -1.5438066440000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 13:01:36.244236  1580 connection.cc:256] RPC call timeout handler was delayed by -1.492343806000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:01:36.244509  1580 connection.cc:256] RPC call timeout handler was delayed by -1.464740694999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 13:01:36.244997  1580 connection.cc:256] RPC call timeout handler was delayed by -1.3963406949999921s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:01:36.245546  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.247524  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.272171  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:36.273023  1539 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:36.275897  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 173781us
W20260709 13:01:36.279692  1505 leader_election.cc:336] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.612s (SENT)
I20260709 13:01:36.280375  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:36.278569  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 260632us
W20260709 13:01:36.282372  1580 connection.cc:256] RPC call timeout handler was delayed by -1.295037002000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
W20260709 13:01:36.282905  1580 connection.cc:256] RPC call timeout handler was delayed by -1.2424406949999707s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:01:36.283268  1580 connection.cc:256] RPC call timeout handler was delayed by -1.0872316830000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:01:36.283629  1580 connection.cc:256] RPC call timeout handler was delayed by -1.0467316830000186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:01:36.285252  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.285730  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.286141  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.286922  1609 raft_consensus.cc:2410] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:36.286791  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.288246  1610 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:01:36.288678  1610 pending_rounds.cc:85] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 2
I20260709 13:01:36.288918  1610 pending_rounds.cc:107] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:01:36.288870  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.290653  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.291177  1615 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:36.291826  1616 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:36.292007  1608 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:36.296684  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.297603  1608 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:36.430709  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:36.450443  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:36.461494  1615 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:36.440275  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.454079  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:36.462237  1689 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:36.235878  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1392) took 2267 ms. Trace:
I20260709 13:01:36.463053  1690 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.292310  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.346951  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1394) took 2331 ms. Trace:
I20260709 13:01:36.424849  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:36.300060  1610 raft_consensus.cc:2917] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:01:36.328377  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.451325  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.467429  1616 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:36.439509  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:36.361068  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 81429.4us
I20260709 13:01:36.467929  1611 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:36.468987  1610 raft_consensus.cc:2889] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:36.468153  1505 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.614s (SENT)
I20260709 13:01:36.470098  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:36.403230  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1400) took 2208 ms. Trace:
I20260709 13:01:36.465734  1536 rpcz_store.cc:276] 0709 13:01:33.968930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.970972 (+  2042us) service_pool.cc:224] Handling call
0709 13:01:36.299652 (+2328680us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400099a54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:36.299792 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590984064}
I20260709 13:01:36.443102  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:36.471721  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.348001  1535 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.473315  1539 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:36.471043  1532 rpcz_store.cc:276] 0709 13:01:34.194470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.101047 (+906577us) service_pool.cc:224] Handling call
0709 13:01:35.101455 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:35.105783 (+  4328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:35.105817 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:35.132303 (+ 26486us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.874325 (+742022us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:35.874382 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:35.874480 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.402949 (+528469us) raft_consensus.cc:1685] finished
0709 13:01:36.402977 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.403148 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3875,"raft.queue_time_us":4386,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":18134,"thread_start_us":226383,"threads_started":1,"wal-append.queue_time_us":375122}
I20260709 13:01:36.475486  1539 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:36.461717  1688 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:36.474305  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1419) took 1553 ms. Trace:
I20260709 13:01:36.476223  1688 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:36.476364  1536 rpcz_store.cc:276] 0709 13:01:34.921222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.473009 (+1551787us) service_pool.cc:224] Handling call
0709 13:01:36.473860 (+   851us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.474011 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.474032 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.474073 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:36.474102 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.474164 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.474260 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.477869  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1420) took 1556 ms. Trace:
I20260709 13:01:36.465163  1609 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:36.480401  1539 rpcz_store.cc:276] 0709 13:01:34.921571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.475033 (+1553462us) service_pool.cc:224] Handling call
0709 13:01:36.475345 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.477608 (+  2263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.477813 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16640}
I20260709 13:01:36.459324  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.478820  1686 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:36.479264  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.475898  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 99) took 1516 ms. Trace:
I20260709 13:01:36.482255  1616 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:36.482455  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.481269  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.487021  1610 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:36.291385  3082 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.496904  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:36.447556  3219 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.445554  3174 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.462862  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.291035  3335 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:36.509601  3335 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:36.510564  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1344) took 2444 ms. Trace:
I20260709 13:01:36.511113  1538 rpcz_store.cc:276] 0709 13:01:34.065985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.928451 (+862466us) service_pool.cc:224] Handling call
0709 13:01:34.928778 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.929090 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:34.929118 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:34.935738 (+  6620us) log.cc:844] Serialized 26 byte log entry
0709 13:01:35.978572 (+1042834us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b180041a2e0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:01:36.074395 (+ 95823us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:36.074744 (+   349us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.074933 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.075012 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:36.510160 (+435148us) raft_consensus.cc:1685] finished
0709 13:01:36.510287 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.510453 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5540,"prepare.queue_time_us":71907,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":38548,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":218,"spinlock_wait_cycles":16245632,"thread_start_us":88407,"threads_started":1,"wal-append.queue_time_us":1389949}
I20260709 13:01:36.486088  3077 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:36.514463  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1422) took 1351 ms. Trace:
I20260709 13:01:36.497113  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:36.516896  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.482129  1532 rpcz_store.cc:276] 0709 13:01:34.959411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.475067 (+1515656us) service_pool.cc:224] Handling call
0709 13:01:36.475403 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.475579 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.475604 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.475649 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:36.475678 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.475730 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.475840 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13696}
I20260709 13:01:36.514942  1538 rpcz_store.cc:276] 0709 13:01:35.163312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.513518 (+1350206us) service_pool.cc:224] Handling call
0709 13:01:36.513877 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.514082 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.514119 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.514171 (+    52us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:36.514209 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.514277 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.514399 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.520321  1532 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:36.484020  3326 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:36.501026  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.483752  1608 raft_consensus.cc:2368] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:36.496637  3321 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.542922  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.543215  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1426) took 1295 ms. Trace:
I20260709 13:01:36.543767  1612 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.543697  1538 rpcz_store.cc:276] 0709 13:01:35.247966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.542425 (+1294459us) service_pool.cc:224] Handling call
0709 13:01:36.542747 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.542907 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.542930 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.542971 (+    41us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:36.543001 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.543051 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.543165 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.445756  3112 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:36.346627  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.505023  1539 raft_consensus.cc:3055] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:36.349514  3241 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:36.430802  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:36.465950  3142 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:01:36.504197  1535 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:36.495223  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:36.508822  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1410) took 2304 ms. Trace:
I20260709 13:01:36.517855  1688 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.500097  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 100) took 1522 ms. Trace:
I20260709 13:01:36.521193  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.521416  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1423) took 1357 ms. Trace:
I20260709 13:01:36.571696  1532 rpcz_store.cc:276] 0709 13:01:35.163554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.519791 (+1356237us) service_pool.cc:224] Handling call
0709 13:01:36.520134 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.520841 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.521340 (+   499us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.571547  1688 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:36.572424  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.521042  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.571525  1536 rpcz_store.cc:276] 0709 13:01:34.959709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.479904 (+1520195us) service_pool.cc:224] Handling call
0709 13:01:36.481265 (+  1361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.481473 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:36.481501 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.481541 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:36.481570 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.481619 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.481723 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:36.495366  3135 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:36.495411  3035 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.465770  1537 rpcz_store.cc:276] 0709 13:01:33.968299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:33.974405 (+  6106us) service_pool.cc:224] Handling call
0709 13:01:34.050638 (+ 76233us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:34.678512 (+627874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.226954 (+1548442us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b540008e3d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:36.235816 (+  8862us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432389888}
I20260709 13:01:36.579486  3035 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.545583  3326 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.541129  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.502271  1534 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:36.479924  3327 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:36.430217  3337 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
W20260709 13:01:36.504004  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.515461  3090 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:36.507093  3082 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.549052  1611 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:36.559113  1535 pending_rounds.cc:85] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:36.610306  1535 pending_rounds.cc:107] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:36.610615  1535 raft_consensus.cc:2889] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:36.611349  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1416) took 1798 ms. Trace:
I20260709 13:01:36.611660  1535 rpcz_store.cc:276] 0709 13:01:34.812874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.952843 (+1139969us) service_pool.cc:224] Handling call
0709 13:01:35.953270 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.347684 (+394414us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b580065edd0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea640aa 00007fd02eae6447 00007fd02eafefe7 00007fd02eb007de 00007fd02eb0ab49 00007fd02eb0b416 00007fd02eb07d8f 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4
0709 13:01:36.611038 (+263354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.611285 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269752704}
I20260709 13:01:36.532253  2878 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:36.575352  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.551105  3112 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.580689  1615 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:36.484203  3322 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:36.539971  2943 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:36.549052  1539 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:36.588940  3135 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:36.601022  1534 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:36.601440  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1390) took 1298 ms. Trace:
W20260709 13:01:36.605381  3334 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:36.622705  1687 rpcz_store.cc:276] 0709 13:01:35.303429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.742374 (+438945us) service_pool.cc:224] Handling call
0709 13:01:35.748586 (+  6212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.916761 (+168175us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:36.069524 (+152763us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.274328 (+204804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.274390 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:36.274446 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.599902 (+325456us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b1800344620. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419
0709 13:01:36.601176 (+  1274us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54002ec7d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:36.601228 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.601375 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":840,"prepare.queue_time_us":210055,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":954,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":20891,"spinlock_wait_cycles":392974848,"thread_start_us":334501,"threads_started":2,"wal-append.queue_time_us":474603}
I20260709 13:01:36.625299  1688 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:36.625775  1612 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:36.606035  1690 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:36.581899  3335 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:36.577661  3291 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:36.580446  1537 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:36.660868  1609 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:36.654585  3142 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:01:36.647737  2899 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:01:36.657389  1539 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:36.680631  1539 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:36.682382  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 137842us
I20260709 13:01:36.686429  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:01:36.693221  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:36.694602  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 213338us
I20260709 13:01:36.696398  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:36.697757  1616 raft_consensus.cc:1217] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:01:36.698329  1616 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:01:36.699457  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:36.636477  2878 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.702538  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:36.635474  3322 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:36.677922  3291 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:36.703655  3120 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.723681  3035 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:36.720930  3142 tablet_bootstrap.cc:492] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:01:36.724502  3326 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:36.724828  3343 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:36.725234  3142 ts_tablet_manager.cc:1403] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 1.992s	user 0.073s	sys 0.079s
I20260709 13:01:36.702432  3348 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.707687  3333 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:36.737876  3336 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:01:36.727093  3347 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:36.741638  3322 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:36.747458  3324 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.748299  3324 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.730727  3333 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:36.756536  3348 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:36.757290  3333 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:36.758656  3348 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.571029  1533 rpcz_store.cc:276] 0709 13:01:34.204448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.893516 (+1689068us) service_pool.cc:224] Handling call
0709 13:01:35.936252 (+ 42736us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.979398 (+ 43146us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:36.165250 (+185852us) log.cc:844] Serialized 14 byte log entry
0709 13:01:36.484375 (+319125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:36.487530 (+  3155us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:36.501798 (+ 14268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.508621 (+  6823us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.508755 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1210,"prepare.queue_time_us":50444,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":23530,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9452,"thread_start_us":432246,"threads_started":2,"wal-append.queue_time_us":352289}
W20260709 13:01:36.794279  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.796054  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:36.798732  2363 raft_consensus.cc:2393] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:36.803966  2878 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.806957  3082 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.817819  3090 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.819257  3112 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.820906  3142 raft_consensus.cc:359] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:36.822562  3142 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:01:36.730664  3120 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:36.824536  1684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1377) took 1651 ms (client timeout 2108 ms). Trace:
I20260709 13:01:36.823830  3142 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:01:36.825094  1684 rpcz_store.cc:269] 0709 13:01:35.173102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:35.175104 (+  2002us) service_pool.cc:224] Handling call
0709 13:01:36.823870 (+1648766us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400433854. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:36.824194 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418175872}
I20260709 13:01:36.827194  1681 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:36.826488  3120 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.824916  3135 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:36.828342  3142 ts_tablet_manager.cc:1434] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.103s	user 0.003s	sys 0.009s
I20260709 13:01:36.833549  3347 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:36.839264  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 133678us
I20260709 13:01:36.840137  3171 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:36.842852  3355 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:01:36.843328  1539 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:36.846683  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 102) took 1833 ms. Trace:
I20260709 13:01:36.840134  3347 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:36.853473  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.847244  1539 rpcz_store.cc:276] 0709 13:01:35.012840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.484741 (+1471901us) service_pool.cc:224] Handling call
0709 13:01:36.504904 (+ 20163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.845780 (+340876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.846110 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:36.855815  3233 consensus_meta.cc:287] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.929s	user 0.015s	sys 0.002s
W20260709 13:01:36.866295  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 64926.2us
I20260709 13:01:36.855731  3298 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.866609  3233 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.868616  1541 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:36.849565  3291 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:36.870097  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:36.884866  2367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 182) took 2032 ms. Trace:
W20260709 13:01:36.886483  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:36.885558  2367 rpcz_store.cc:276] 0709 13:01:34.852248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:34.852388 (+   140us) service_pool.cc:224] Handling call
0709 13:01:34.883116 (+ 30728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:35.123067 (+239951us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:35.129653 (+  6586us) log.cc:844] Serialized 14 byte log entry
0709 13:01:35.412138 (+282485us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18003a6e40. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a823a 00007fd02eb12a2a
0709 13:01:35.830304 (+418166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:35.830377 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:35.830435 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:36.884133 (+1053698us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54004c6154. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:36.884271 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:36.884579 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7474,"prepare.queue_time_us":4249,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":86743,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8879,"spinlock_wait_cycles":556980224,"thread_start_us":377794,"threads_started":1,"wal-append.queue_time_us":767817}
I20260709 13:01:36.900914  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.896432  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.905831  1613 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:36.913949  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.914615  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.916108  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.915329  1608 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:36.920579  1614 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:36.928874  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.930811  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.915198  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.937271  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.938705  1607 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:36.943398  3174 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.947134  3112 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.947634  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.948186  3112 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.949273  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.950537  1613 raft_consensus.cc:2410] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:01:36.951048  3112 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.947278  1540 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 3. Ops: []
I20260709 13:01:36.967232  3324 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:36.947146  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.968822  3174 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.979017  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:36.980723  3232 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:36.981657  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.981988  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.982585  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.983445  1608 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:36.984365  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:36.985340  1616 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:36.987056  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:36.981545  3232 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:36.988107  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:37.020504  1607 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:37.021510  3174 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:36.989071  1613 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:36.926927  3333 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:37.043843  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-7d86302e0fce4e1585ef0f1cbc65dc7a received from {username='slave'} at 127.0.0.1:35722
I20260709 13:01:37.044759  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-7d86302e0fce4e1585ef0f1cbc65dc7a on tablet 7d86302e0fce4e1585ef0f1cbc65dc7a with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:37.045257  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.048893  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:37.051424  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:37.051679  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:37.052223  3333 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:37.052294  1607 raft_consensus.cc:2376] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2. Re-sending same reply.
I20260709 13:01:37.053702  1616 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:37.056335  3120 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.056630  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:37.056991  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.057184  3120 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.058386  3255 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:37.052663  1613 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:37.047668  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:37.059806  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:37.116415  1615 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:37.119580  1538 raft_consensus.cc:1240] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:01:37.130678  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.116590  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1362) took 3043 ms. Trace:
I20260709 13:01:37.104163  1608 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:37.154515  1540 rpcz_store.cc:276] 0709 13:01:34.073492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:36.041586 (+1968094us) service_pool.cc:224] Handling call
0709 13:01:36.946907 (+905321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:36.970286 (+ 23379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:37.116262 (+145976us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b54001fc550. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:37.116495 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847228672}
I20260709 13:01:37.021804  3232 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.124579  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:37.169417  1612 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:37.060138  3233 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.130528  2365 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:37.170104  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:37.059800  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:37.104843  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:37.174670  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:37.113111  3120 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:37.119524  3321 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:01:37.179843  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.181622  1614 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:37.181692  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.182327  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 134939us
I20260709 13:01:37.117472  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.112210  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:37.187484  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:37.190055  3213 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.190675  3213 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:37.191653  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:37.192323  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:37.189888  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 130246us
I20260709 13:01:37.198140  3314 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:37.198251  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:37.199635  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.510s (SENT) [suppressed 21 similar messages]
I20260709 13:01:37.186437  3347 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:37.202193  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.196888  3232 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:37.209028  1681 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:37.209900  3347 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:37.210147  1607 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:37.211189  1608 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:37.211272  3347 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.204918  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:37.239029  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.239498  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:37.244860  2365 raft_consensus.cc:1217] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:01:37.246052  3213 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.246399  2367 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:37.251673  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:37.213244  3232 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:37.262291  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 65744.7us
I20260709 13:01:37.204134  3321 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:37.271890  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.273727  3321 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:37.274210  3333 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:37.275533  3333 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:37.275969  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 158664us
I20260709 13:01:37.276903  3333 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.260150  3348 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.280323  1579 leader_election.cc:400] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3.
I20260709 13:01:37.280715  1579 leader_election.cc:403] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:37.261135   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:37.287122  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.287539  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:37.288410  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:37.292927  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.289522  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.295825  3082 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:37.297917  3082 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.280578  3348 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.300699  3348 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:37.293120  3289 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3.
I20260709 13:01:37.306430  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:01:37.307242  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 69974.3us
I20260709 13:01:37.261684  3232 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.311693  3297 consensus_queue.cc:1059] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:01:37.302933  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 90) took 7361 ms. Trace:
I20260709 13:01:37.315721  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.317423  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.318342  1685 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:37.315655  3298 raft_consensus.cc:3055] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:37.319023  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.318074  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.318958  3154 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:37.319031  3298 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:37.326519  3297 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:37.327253  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:37.328099  1536 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:37.326179  3298 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:37.333961  3298 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.334012  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.334499  1688 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:37.334352  3113 consensus_queue.cc:1059] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:37.335568  3255 raft_consensus.cc:3055] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:37.335930  3255 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:37.336829  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.337157  3255 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:37.338480  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.339322  1686 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:37.339737  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:37.349241  1536 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:37.349898  1536 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:01:37.353236  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.339167  3255 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:37.359790  1681 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:37.350929  3120 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 13:01:37.366130  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.363914  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:37.363385  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:37.373347  1538 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:37.376015  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:37.374392  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:37.376191  3348 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:01:37.387241  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 215597us
I20260709 13:01:37.408605  1539 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:37.404901  1536 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.316478  1436 rpcz_store.cc:276] 0709 13:01:29.941131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:29.941349 (+   218us) service_pool.cc:224] Handling call
0709 13:01:30.142240 (+200891us) spinlock_profiling.cc:243] Waited 81.1 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea72090 00007fd02eb10f3a 00007fd0348c71cc 00007fd0349c537e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc 00007fd032e85392 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:37.302649 (+7160409us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:36.606662 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:36.726576 (+119914us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:36.728011 (+  1435us) write_op.cc:435] Acquired schema lock
0709 13:01:36.729159 (+  1148us) tablet.cc:662] Decoding operations
0709 13:01:36.739648 (+ 10489us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:36.739722 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:36.739764 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:01:36.740711 (+   947us) tablet.cc:701] Row locks acquired
0709 13:01:36.740731 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:36.740902 (+   171us) write_op.cc:270] Start()
0709 13:01:36.741016 (+   114us) write_op.cc:276] Timestamp: P: 1783602096740855 usec, L: 0
0709 13:01:36.741043 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:01:36.741754 (+   711us) log.cc:844] Serialized 918 byte log entry
0709 13:01:36.956660 (+214906us) op_driver.cc:464] REPLICATION: finished
0709 13:01:37.155916 (+199256us) write_op.cc:301] APPLY: starting
0709 13:01:37.156158 (+   242us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:37.156472 (+   314us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:37.156679 (+   207us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:37.157376 (+   697us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:37.157854 (+   478us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:01:37.157969 (+   115us) write_op.cc:312] APPLY: finished
0709 13:01:37.158602 (+   633us) log.cc:844] Serialized 28 byte log entry
0709 13:01:37.158945 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:37.159141 (+   196us) write_op.cc:454] Released schema lock
0709 13:01:37.159219 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:37.193616 (+ 34397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:37.193653 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":161705,"reported_tablets":12,"spinlock_wait_cycles":186583296,"child_traces":[["op",{"apply.queue_time_us":198749,"apply.run_cpu_time_us":4241,"apply.run_wall_time_us":29018,"num_ops":2,"prepare.queue_time_us":385933,"prepare.run_cpu_time_us":20406,"prepare.run_wall_time_us":255031,"raft.queue_time_us":110989,"raft.run_cpu_time_us":35511,"raft.run_wall_time_us":199041,"replication_time_us":215340,"thread_start_us":597402,"threads_started":4,"wal-append.queue_time_us":18631}]]}
I20260709 13:01:37.413080  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:37.386376  3012 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.179s
W20260709 13:01:37.425321  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 85787.4us
I20260709 13:01:37.428419  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:37.429356  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.412133  3233 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:01:37.435539  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:37.436941  3108 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:37.437703  3108 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:37.424607  3120 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:37.456123  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.418996  3321 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:01:37.459898  3103 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:01:37.461606  3232 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:37.461962  3291 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:37.463986  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:37.477835  3291 raft_consensus.cc:697] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:37.478432  1533 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:37.479480  3136 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:37.470379  3100 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:01:37.481276  3100 consensus_queue.cc:1243] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:37.480594  3136 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:37.480782  1439 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.481787  3100 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:37.482193  3100 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:37.483072  3100 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.482982  1439 catalog_manager.cc:5697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 4, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.479146  3291 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:37.475963  3174 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:01:37.488404  1537 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:37.490312  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 56560.4us
I20260709 13:01:37.494949  3108 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.496308  3120 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:37.498843  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:37.499686  3082 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:37.500586  3100 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.501322  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.503603  3233 consensus_queue.cc:1243] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:37.505730  3319 consensus_queue.cc:1059] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:37.506450  3321 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:01:37.506631  1580 connection.cc:256] RPC call timeout handler was delayed by -1.6186177940000448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
W20260709 13:01:37.532542  1580 connection.cc:256] RPC call timeout handler was delayed by -1.6042177940000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:01:37.533210  1580 connection.cc:256] RPC call timeout handler was delayed by -1.5646177940000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 13:01:37.533672  1580 connection.cc:256] RPC call timeout handler was delayed by -1.5403177940000319s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 13:01:37.509763  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.511214  3174 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:37.535609  1608 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:37.536949  1687 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:37.548945  3136 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.554347  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:37.536145  3174 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:37.555790  3174 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.556495  3319 consensus_queue.cc:1243] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:01:37.557184  3319 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:37.557549  3319 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:37.558519  3319 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.560365  3174 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.565048  2915 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:37.565770  2915 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.534116  3321 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:37.569628  3321 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.559753  3319 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.571291  3321 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.579177  1541 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:37.576996  3241 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:37.585783  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:01:37.586470  1580 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.537s (SENT)
I20260709 13:01:37.567961  2915 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.591104  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.589602  3298 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:37.596926  3298 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:37.597370  3298 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:37.601701  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.588235  3233 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:37.619892  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.634366  1536 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.611533  3233 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.639626  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:37.613323  1439 catalog_manager.cc:5697] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 3, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.641351  1439 catalog_manager.cc:5697] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 3, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:37.588732  3241 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.642231  3226 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:37.643069  3226 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.644075  3241 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.646209  3226 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:37.648849  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 71461.2us
I20260709 13:01:37.649037  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.649629  1681 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
W20260709 13:01:37.649987  1580 leader_election.cc:336] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.543s (SENT)
I20260709 13:01:37.650406  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:01:37.651547  1580 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.555s (SENT)
I20260709 13:01:37.638312  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.649644  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:37.652817  1687 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:37.652704  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.653056  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:37.653702  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.654265  3241 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:37.655102  3241 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:37.654858  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.654325  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.656978  3120 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:37.657055  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.657338  3241 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:37.654918  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:37.657867  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.655918  3226 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:37.659520  1580 connection.cc:256] RPC call timeout handler was delayed by -1.5259177940000086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260709 13:01:37.659621  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:37.660140  1580 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.557s (SENT)
I20260709 13:01:37.660643  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.661577  3241 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:37.661991  1504 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:37.663012  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.664286  3226 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:37.666188  3241 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:37.668236  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 149139us
I20260709 13:01:37.669077  1439 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index -1 to 3, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:37.671206  1439 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 3, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 3 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:37.672341  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:37.673398  1690 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:37.676353  3327 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:37.676987  3327 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.677443  3327 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.681097  1504 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:37.623188  3289 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:37.700248  3136 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:37.700743  3136 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:37.701103  3136 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:37.681638  3233 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:37.725433  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.689777  3108 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:37.709342  3012 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:01:37.769622  3298 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:37.783870  2364 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:37.787159  3298 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.790400  3327 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:37.798950  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:37.819245  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 80289.1us
W20260709 13:01:37.833631  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 159024us
I20260709 13:01:37.833247  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:37.841274  1686 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:37.809579  3100 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:37.876729  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:37.888796  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.862360  3136 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.881873  3100 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:37.924743  1580 connection.cc:256] RPC call timeout handler was delayed by -1.5223177940000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 13:01:37.929394  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:37.821503  2366 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:37.914683  3327 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:37.935392  3380 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:01:37.941838  3136 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:37.924130  3369 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:37.950380  1686 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:37.962857  3012 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:37.963397  3012 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:37.964340  3012 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.965822  3012 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:37.966622  3384 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:01:37.967630  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 186076us
I20260709 13:01:37.968573  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:37.969620  3120 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:37.976950  3120 raft_consensus.cc:697] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:37.978008  3120 consensus_queue.cc:237] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:37.984431  1690 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:37.986099  3386 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.001s
I20260709 13:01:37.984499  3108 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:37.988487  3108 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:37.991231  3100 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:37.996644  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.998504  3136 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:37.999205  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:37.999330  3136 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:38.002605  3392 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:01:38.005925  3108 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.009258  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:38.009830  1608 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.013259  3233 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.018220  1608 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:38.019043  3136 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.019768  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:38.020082  3136 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:38.020704  3136 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:38.021521  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:38.021733  3394 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:38.021672  3136 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.023141  3154 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:38.023706  3154 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:38.025246  1505 leader_election.cc:400] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:38.024820  3154 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.041307  3354 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:38.043042  3354 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:38.025897  3394 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:38.027619  3108 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:38.029538  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:38.044374  3389 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:38.044549  1684 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.044832  3389 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:38.044927  3394 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.045964  3389 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.047451  3389 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:38.029817  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:38.048429  3219 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:38.033702  1685 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:38.049877  3103 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:38.050926  3233 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:38.051792  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:38.052742  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.036511  1686 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:38.055652  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.055625  3100 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.039693  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:38.023335  3136 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.048854  3219 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:38.060640  3219 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.062232  3219 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.054476  3348 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.064340  3348 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:38.064754  3348 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.059301  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:38.071233  3233 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:38.072247  3233 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.075616  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.086114  3100 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.086733  3100 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:38.087224  3100 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.104189  3233 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:38.105134  3321 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:38.107393  1684 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:38.108546  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.110447  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:38.112129  3354 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.112679  3354 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:38.113099  3354 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.106402  3348 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.114099  3321 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.114746  1690 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.114827  3384 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:38.115374  3384 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.116923  3100 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.117883  3384 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:38.118700  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.119580  3384 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:38.121035  1505 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.124169  3384 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.124752  3384 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.125315  3384 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.125574  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.127055  3348 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:38.127916  3100 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:38.123775  1690 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:01:38.138815  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 57511.1us
I20260709 13:01:38.140345  3233 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:38.144320  1504 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:38.145681  1504 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:38.142170  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:38.124706  1580 leader_election.cc:336] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.809s (SENT)
I20260709 13:01:38.156783  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:01:38.159857  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.166774  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 184753us
I20260709 13:01:38.177600  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:38.178318  1686 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.184377  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:38.192886  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:38.206823  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 64770.1us
I20260709 13:01:38.209432  2366 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:38.209826  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:38.211229  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 86634us
I20260709 13:01:38.212213  3291 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:38.213399  1580 connection.cc:256] RPC call timeout handler was delayed by -1.4827177940000524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22930000000000003s for a response
W20260709 13:01:38.216384  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 106053us
W20260709 13:01:38.215752  1580 connection.cc:256] RPC call timeout handler was delayed by -1.4179177940000613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23650000000000004s for a response
I20260709 13:01:38.171878  3100 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:38.220997  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:38.175794  3233 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:38.178514  3136 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.228703  1505 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.178421  3082 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:38.238883  3291 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:01:38.264493  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.265554  3241 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.266148  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.246462  3327 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.247334  3233 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:38.244660  3100 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:38.269862  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:38.273633  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.277765  1686 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:38.285055  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.267949  3241 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.268215  3082 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.296399  3120 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:01:38.304111  3120 consensus_queue.cc:1243] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer 9d926c10b90f452ba52d80dab6a50351 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:01:38.304323  3082 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:38.305750  3082 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.312928  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.313894  3321 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.314405  3321 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:38.314769  3389 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.314311  3233 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.315080  3321 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.315253  3389 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:38.315724  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 59725.7us
I20260709 13:01:38.314635  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:38.315838  3136 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.330123  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.280109  3384 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:38.323772  3241 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:38.345618  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.322511  3389 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:38.358278  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 91474.9us
I20260709 13:01:38.359216  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:38.362397  3100 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.356365  3241 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:01:38.367003  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 147467us
I20260709 13:01:38.367147  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:38.369514  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 108607us
W20260709 13:01:38.375079  3398 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:01:38.365048  3136 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:38.366689  3012 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.379220  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:38.376807  3319 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:38.369966  3241 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:38.402806  1684 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.403648  3354 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.404991  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:38.407536  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:38.408600  3391 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.409304  3391 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:38.409724  3391 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:38.418885  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44989.5us
W20260709 13:01:38.422415  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57799us
I20260709 13:01:38.392467  3136 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:38.426839  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.410616  2366 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 1 LEARNER]: Advancing to term 2
I20260709 13:01:38.395210  3012 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.435683  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.411763  3405 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.443638  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.411077  3289 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:01:38.425637  3321 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.451509  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:38.452596  1684 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:38.452872  3396 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:01:38.453131  3399 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:01:38.453846  3354 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:38.454777  3404 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:38.456225  3410 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:38.456516  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.456876  3410 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:38.458442  3012 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:38.461967  3389 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:38.463296  3407 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:01:38.464359  3136 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.451579  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:38.466372  3321 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:38.467097  3406 raft_consensus.cc:2764] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:01:38.467192  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:38.468530  1684 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:38.497750  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:38.441988  3405 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:38.506812  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50409.8us
W20260709 13:01:38.508800  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 60984.5us
I20260709 13:01:38.451890  3384 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:38.514252  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 87504.1us
I20260709 13:01:38.509379  3174 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:38.506098  3333 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:38.508514  3327 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.505246  3405 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.522573  1684 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 13:01:38.510296  3408 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:38.516223  3389 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:38.516085  3411 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:38.528168  3174 raft_consensus.cc:697] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:38.543534  3409 raft_consensus.cc:3055] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:38.541033  3408 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:38.564832  3174 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:38.558423  3409 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:38.568910  3409 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.572952  3408 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.557331  3333 consensus_queue.cc:1059] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:01:38.561717  3410 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:38.576946  3333 raft_consensus.cc:3055] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:38.556161  3384 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:38.577380  3333 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:38.578368  3333 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:38.558885  3389 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:38.580829  3389 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.584251  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.585930  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.610378  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.579905  3333 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.611847  1541 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:38.610862  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.589324  3233 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:38.589484  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:38.623747  2368 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:38.591331   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:38.624895  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:38.625638  1616 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:38.626303  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:38.627621  1613 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:01:38.617826  3391 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.629398  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:38.603152  1684 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:38.630020  1609 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:38.630311  3391 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:38.631371  1612 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:38.633025  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 46479.1us
I20260709 13:01:38.634466  3093 raft_consensus.cc:1064] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:38.614042  1686 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:38.635309  1686 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:38.636271  1686 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.637274  3093 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.640657  1609 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:38.608412  1608 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:38.609424  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.643376  1536 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:38.583797  3389 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:38.644363  1614 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:38.612447  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.645911  3395 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:38.648126  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.648762  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.649400  1535 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:38.651160  1535 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:38.651485  1535 pending_rounds.cc:85] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:38.651727  1535 pending_rounds.cc:107] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:38.652004  1535 raft_consensus.cc:2889] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.652980  1533 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:01:38.653292  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 67461.4us
I20260709 13:01:38.654197  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.655400  1536 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:38.655792  1536 pending_rounds.cc:85] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:38.656479  1536 pending_rounds.cc:107] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:38.656796  1536 raft_consensus.cc:2889] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.660488  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:38.661211  3409 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:38.666929  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.672802  1653 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:38.680110  3174 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:38.680939  3174 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:38.643879  2366 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:01:38.690606  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:38.695541  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.698056  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:38.698555  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:38.699307  1607 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:38.691119  3120 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:38.703394  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 48646.7us
I20260709 13:01:38.698873  1685 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:38.710054  1536 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:38.730619  1607 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:38.730310  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.731650  1538 raft_consensus.cc:2368] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3.
I20260709 13:01:38.732913  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:38.733791  2364 raft_consensus.cc:1217] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Deduplicated request from leader. Original: 3.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:01:38.734386  2364 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:01:38.735102  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.735773  1539 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:38.736241  1539 pending_rounds.cc:85] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:38.736487  1539 pending_rounds.cc:107] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:38.736758  1539 raft_consensus.cc:2889] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.737534  1686 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.737978  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:38.738570  1539 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.740427  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:38.741065  1538 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
W20260709 13:01:38.741140  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 48009.1us
I20260709 13:01:38.742254  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:38.743047  3347 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:38.743139  1439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 168) took 6499 ms. Trace:
I20260709 13:01:38.743507  3347 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:38.759866  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:38.743244  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:38.764671  1538 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:38.765420  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.766454  1536 raft_consensus.cc:2393] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:38.631417  3241 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:38.772734  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:38.773727  3241 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:38.774592  1612 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:38.775692  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:38.768260  1539 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
W20260709 13:01:38.778345  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:38.781383  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:38.774598  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:38.776285  1616 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:38.779747  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:38.792485  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 115040us
I20260709 13:01:38.799163  1538 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:38.730288  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.801041  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.801362  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.802292  3406 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:38.802650  1609 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:38.803381  3348 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:38.744223  3389 raft_consensus.cc:2764] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:38.804795  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:38.806285  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 374751us
I20260709 13:01:38.743930  3347 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:38.808833  1686 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:38.757678  1436 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.818122  1436 catalog_manager.cc:5697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 4, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.820245  1612 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:38.717523  3120 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:38.811023  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:38.821810  1615 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:38.845418  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.842569  3120 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:38.779278  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:38.705142  3219 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.106s
W20260709 13:01:38.853736  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49019.6us
I20260709 13:01:38.855443  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:38.856348  1538 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:38.860285  3395 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:38.861548  1537 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:01:38.861946  1537 pending_rounds.cc:85] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:38.862201  1537 pending_rounds.cc:107] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:38.862449  1537 raft_consensus.cc:2889] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.763634  3012 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:01:38.821027  1436 catalog_manager.cc:5697] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 2 to 4, term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to c98c328741aa493d87abafbf08f04944 (127.0.107.193), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:38.864185  1532 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:38.860610  1533 pending_rounds.cc:85] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:01:38.743695  1439 rpcz_store.cc:276] 0709 13:01:32.243292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:32.244231 (+   939us) service_pool.cc:224] Handling call
0709 13:01:32.629375 (+385144us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b5400002210. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e40b2 00007fd03495da89 00007fd0348f5da6 00007fd0348c7088 00007fd0349c537e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc
0709 13:01:38.743053 (+6113678us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:37.918795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:37.967977 (+ 49182us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:37.968060 (+    83us) write_op.cc:435] Acquired schema lock
0709 13:01:37.968077 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:37.968970 (+   893us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:37.969063 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:37.969105 (+    42us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:01:37.969744 (+   639us) tablet.cc:701] Row locks acquired
0709 13:01:37.969794 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:37.969963 (+   169us) write_op.cc:270] Start()
0709 13:01:37.970140 (+   177us) write_op.cc:276] Timestamp: P: 1783602097969901 usec, L: 0
0709 13:01:37.970163 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:37.970794 (+   631us) log.cc:844] Serialized 2534 byte log entry
0709 13:01:38.373325 (+402531us) op_driver.cc:464] REPLICATION: finished
0709 13:01:38.523918 (+150593us) write_op.cc:301] APPLY: starting
0709 13:01:38.526041 (+  2123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:38.549150 (+ 23109us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:38.608345 (+ 59195us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:38.609329 (+   984us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:38.609513 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:01:38.609554 (+    41us) write_op.cc:312] APPLY: finished
0709 13:01:38.609811 (+   257us) log.cc:844] Serialized 52 byte log entry
0709 13:01:38.610005 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:38.610118 (+   113us) write_op.cc:454] Released schema lock
0709 13:01:38.610159 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:38.612866 (+  2707us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:38.612903 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":22,"spinlock_wait_cycles":207243520,"child_traces":[["op",{"apply.queue_time_us":137473,"apply.run_cpu_time_us":2884,"apply.run_wall_time_us":94708,"num_ops":6,"prepare.queue_time_us":209503,"prepare.run_cpu_time_us":4229,"prepare.run_wall_time_us":69750,"replication_time_us":395223,"thread_start_us":181949,"threads_started":2}]]}
I20260709 13:01:38.868970  1436 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 5, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.855805  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:38.871381  1533 pending_rounds.cc:107] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:01:38.871803  1533 raft_consensus.cc:2889] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:38.873086  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:38.874809  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:38.788705  3405 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:38.857412  3354 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:38.887686  1532 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:38.876135  1436 catalog_manager.cc:5697] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195), now has a pending config: VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193), VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194), VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195), VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:38.888453  3406 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:38.954856  1436 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:38.975672  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 110804us
I20260709 13:01:38.908694  3354 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:38.910483  3426 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 13:01:38.920964  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 113147us
I20260709 13:01:38.981019  1687 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:38.976984  1436 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 2 to 3, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.914299  3154 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:38.986981  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:38.989019  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 112336us
I20260709 13:01:38.984570  1436 catalog_manager.cc:5697] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 5, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:38.967283  3406 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:38.968689  3289 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.975235  3391 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.012900  3314 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:38.967128  3103 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:38.986063  3354 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:39.016405  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 170313us
I20260709 13:01:39.005803  1436 catalog_manager.cc:5697] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 3 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:39.010633  3232 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.011678  3406 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:38.999178  3384 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:39.005231  3154 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:39.053228  3108 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.059100  3108 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:39.062011  3108 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:39.046304  2366 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:01:39.064836  3422 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.215s	user 0.003s	sys 0.001s
I20260709 13:01:39.066888  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:39.067421  3430 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:01:39.068622  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45638.4us
I20260709 13:01:39.069408  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:39.024856  3314 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:39.034945  3391 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.070744  1537 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:39.044894  3348 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:39.118310  3391 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:39.045364  3403 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:01:39.085251  3314 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:39.085948  3154 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:39.100884  3405 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:39.103783  3406 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.052512  3093 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:01:39.106279  3082 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.109527  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:39.131418  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:39.075451  3414 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:39.142026  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.144598  3404 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.132864  3406 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:39.152056  3384 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.143810  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:39.158864  1685 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:39.165298  1687 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:39.164397  3384 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.169153  3384 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:39.169461  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 60073.7us
I20260709 13:01:39.170424  1686 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:39.171361  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:39.171841  3389 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:39.137635  3414 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:39.174893  3414 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.175102  3437 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:39.124223  3436 consensus_queue.cc:1059] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:01:39.174271  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:39.175436  1685 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:39.143296  3403 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:39.175711  3012 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:39.181736  3389 raft_consensus.cc:697] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:39.181990  3401 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.177280  3348 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:39.183480  3348 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:39.182933  3389 consensus_queue.cc:237] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.184621  3348 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.186004  3348 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:39.198556  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.183086  3403 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:39.236084  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 61224.2us
I20260709 13:01:39.240669  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:39.213052  3404 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:01:39.244859  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.245144  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.246119  1535 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:39.246099  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.210580  3120 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:39.204341  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "9d926c10b90f452ba52d80dab6a50351"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:01:39.256459  1612 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:39.242601  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:39.268920  3394 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:39.270471  3108 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:39.270938  3108 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:39.274731  3120 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:39.276391  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:39.258248  1609 raft_consensus.cc:606] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Received request to transfer leadership to TS 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:39.279241  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:39.280478  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.281131  1613 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.225534  3384 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:39.282374  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.281155  1616 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:39.289187  3108 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:39.227054  3327 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 13:01:39.290941  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 55057.8us
I20260709 13:01:39.292275  3082 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:39.227258  3408 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 13:01:39.299755  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.306071  1580 leader_election.cc:400] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3.
I20260709 13:01:39.230031  3436 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:01:39.370828  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 64348.8us
I20260709 13:01:39.296667  3289 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:39.228427  3233 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 13:01:39.320729  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:39.377135  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 344227us
I20260709 13:01:39.376067  2329 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:39.361912  1685 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:39.372383  3333 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:39.384553  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 78628.8us
I20260709 13:01:39.374671  3241 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.388002  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:39.388675  1690 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:39.294857  3403 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.381644  3154 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:39.393631  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:39.391075  3333 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.394999  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:39.307173  3347 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:39.385149  3108 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:39.405572  1613 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:39.407761  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:39.381424  3405 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:01:39.389983  3241 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.416050  3414 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.378456  3446 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:39.420739  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:39.423358  1686 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:39.405218  3154 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:39.423409  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:39.431735  3448 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:39.436928  3448 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.434489  3414 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:39.468438  3314 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:01:39.440163  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54599.4us
I20260709 13:01:39.441743  3389 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.418226  3241 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:39.444303  3347 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:39.447535  2363 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:39.436305  3154 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.454463  3333 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:39.459529  3453 log.cc:927] Time spent T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:39.470562  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:01:39.482481  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 91580.5us
I20260709 13:01:39.489435  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:39.494053  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 105477us
I20260709 13:01:39.501561  1653 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:39.502740  3403 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:39.503572  3403 raft_consensus.cc:697] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:39.504567  3403 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:39.491261  3289 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.516201  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:39.520653  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:39.481555  3389 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:39.566039  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 69824.8us
I20260709 13:01:39.495297  3333 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.604583  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:01:39.622623  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 125040us
I20260709 13:01:39.612550  3419 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:39.656494  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:39.565802  3456 consensus_queue.cc:1059] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:01:39.642863  3406 raft_consensus.cc:3055] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:01:39.687098  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 68205.5us
I20260709 13:01:39.651957  3347 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:39.671983  3232 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:39.769620  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 53416.5us
I20260709 13:01:39.770421  1654 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:39.684459  3406 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:39.698655  3347 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:39.715852  3354 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.007s
I20260709 13:01:39.658522  3440 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:01:39.715390  3012 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.826529  3347 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:39.846947  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 175705us
I20260709 13:01:39.860984  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.861328  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.862150  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.863133  1613 raft_consensus.cc:2410] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:39.831250  3403 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:39.868810  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.869127  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.869500  1607 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:39.825454  3232 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:39.872591  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.873915  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:39.868188  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 206671us
I20260709 13:01:39.874482  1536 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.875170  3462 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:39.877751  3460 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:39.866750  3408 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.873567  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.875161  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.880803  1533 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:39.883494  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:39.883721  3457 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:01:39.866856  3327 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:39.835891  3012 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.828775  3354 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.917675  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.919375  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.934989  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.942830  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:39.934681  3442 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:01:39.943017  1607 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.919298  3456 consensus_queue.cc:1243] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:39.941810  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:39.951030  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 179226us
I20260709 13:01:39.952481  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.953785  1534 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:39.953891  1614 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:39.952153  1536 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:39.950524  1609 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:39.966429  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.938485  3233 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:39.913093  3462 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.978374  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:39.936406  3470 raft_consensus.cc:476] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Not starting pre-election -- already a leader
I20260709 13:01:39.982869  1685 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:39.995808  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:39.936559  3408 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.003435  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:40.006165  1613 raft_consensus.cc:2410] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:01:40.004220  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:40.007402  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.940811  3327 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:39.934686  3406 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.012635  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.969383  3241 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:01:40.019568  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:39.970106  3440 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:01:40.020576  1610 raft_consensus.cc:2368] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
W20260709 13:01:40.028782  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.028949  1612 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:40.035270  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:40.048599  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 70344.5us
I20260709 13:01:39.985800  3233 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:40.031154  3406 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.071281  3479 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.091251  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "469f8c03f4924f809435141a09c976fa"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:40.092296  1681 raft_consensus.cc:606] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:40.072170  3479 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.099936  3480 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.100855  3480 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.110455  3233 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.111505  3233 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:40.112165  3154 consensus_meta.cc:287] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.003s
W20260709 13:01:40.112741  3464 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
I20260709 13:01:40.112844  3154 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.116279  3479 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:40.118391  1614 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:40.116017  3154 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.119745  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.121578  1614 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:40.123692  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.124320  1614 raft_consensus.cc:2376] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5. Re-sending same reply.
I20260709 13:01:40.125279  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.126494  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.129292  3462 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:40.145620  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.103717  3480 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:40.146090  3470 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:01:40.150300  3467 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:01:40.150612  3470 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:40.152186  3465 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:01:40.149330  3469 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.164s
I20260709 13:01:40.160696  3456 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.161285  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:40.161382  3456 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.162416  2364 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:01:40.163290  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.163906  1612 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:40.164970  1608 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.181979  3456 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.174851  1579 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:40.185055  3456 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:40.185400  3389 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:40.185693  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.186260  3408 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:40.187379  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.187682  3473 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.188423  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:40.188387  3473 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.185438  3456 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:40.189793  3456 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:40.191191  1614 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:40.192891  1614 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:01:40.193261  1614 pending_rounds.cc:85] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 2
I20260709 13:01:40.193554  1614 pending_rounds.cc:107] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 2.3
I20260709 13:01:40.193959  1614 raft_consensus.cc:2889] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:40.197067  1614 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:40.197568  3012 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:01:40.200933  1607 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:40.214378  1538 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:40.215174  1612 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.222601  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:40.223423  1607 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.223593  1608 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.153136  3470 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:40.144918  3233 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.200596  3473 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.264259  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.270130  1533 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:40.277422  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.278342  1538 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:40.291345  1607 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:40.294014  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.259747  3333 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.286576  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.316494  1538 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:40.295425  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.318506  1533 raft_consensus.cc:2368] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:40.260890  3354 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:40.298556  3233 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:40.298734  2368 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEARNER]: Advancing to term 3
I20260709 13:01:40.301904  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.283773  3482 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:40.337446  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 264123us
W20260709 13:01:40.306030  3483 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:01:40.320722  1534 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:40.325640  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.327093  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.334507  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.335242  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.343434  1538 raft_consensus.cc:2410] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:40.328167  3289 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.354991  3289 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.356698  3456 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.357436  3289 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.333971  3333 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.358932  3456 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:40.372200  1616 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:40.385064  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.388597  1608 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:40.388562  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:40.389709  1681 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.415300  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.362371  3475 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.359871  3333 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:40.386788  3482 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.431953  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:40.434303  1536 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:40.434073  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.371344  3241 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.432696  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.441049  1539 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:40.437314  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:40.442189  2367 raft_consensus.cc:2410] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:01:40.437305  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.443280  1538 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:40.444399  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.445016  1538 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:40.452085  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.452740  1534 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:40.388626  3384 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.477591  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.477662  1681 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:40.478497  1533 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:40.478842  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.479337  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.479519  2328 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:40.480062  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.480865  1541 raft_consensus.cc:2368] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:40.480654  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.481554  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.482123  1538 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:40.482401  1536 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 1.
I20260709 13:01:40.479951  1533 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3. Re-sending same reply.
I20260709 13:01:40.483271  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.491073  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.492051  1534 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:40.494380  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.436162  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:40.505088  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 453510us
I20260709 13:01:40.484972  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:40.484125  3409 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.507966  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:40.490262  3435 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:40.456357  3241 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.463012  3384 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.516426  1533 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:01:40.436214  3475 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.529393  1533 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:40.552531  3489 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.553149  3489 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.555341  3489 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.508890  3093 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:01:40.519378  3435 raft_consensus.cc:697] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:40.515089  3409 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.579557  3482 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.580267  3405 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:40.581087  3384 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.581758  1541 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:40.601521  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.587680  3233 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.604498  3233 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:40.582286  3347 consensus_meta.cc:287] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.006s
I20260709 13:01:40.607437  3347 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.608429  3233 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.610365  2368 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:40.585126  3241 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.566792  3499 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:40.558606  3435 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.599244  3405 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.658285  3405 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:40.608624  1686 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:40.610435  3479 raft_consensus.cc:3055] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:40.610937  3347 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:40.584887  3409 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.614821  3414 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:40.622593  2370 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:01:40.676664  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48350
I20260709 13:01:40.586927  1539 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:40.643146  1609 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:40.677322  1688 raft_consensus.cc:606] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:01:40.664942  3499 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:40.659948  3468 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:40.666247  3403 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:40.669911  3479 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:40.686187  1532 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:40.702461  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 138) took 1047 ms. Trace:
I20260709 13:01:40.672778  3475 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.702976  1611 rpcz_store.cc:276] 0709 13:01:39.655516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.655740 (+   224us) service_pool.cc:224] Handling call
0709 13:01:39.680408 (+ 24668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.680675 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:39.710953 (+ 30278us) log.cc:844] Serialized 14 byte log entry
0709 13:01:39.716253 (+  5300us) log.cc:844] Serialized 14 byte log entry
0709 13:01:40.561890 (+845637us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b18003d5f40. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b522 00007fd02ba1d7c1
0709 13:01:40.701850 (+139960us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18003d5f40. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287
0709 13:01:40.701979 (+   129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:40.702044 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:40.702139 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.702244 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:40.702390 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2867,"prepare.queue_time_us":147110,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":1099,"raft.queue_time_us":271811,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":10838,"spinlock_wait_cycles":103571840,"thread_start_us":130912,"threads_started":1}
I20260709 13:01:40.708477  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.713776  1532 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:01:40.721909  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.723088  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.723757  1535 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:40.684341  3414 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.721900  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.725880  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.728654  1539 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:40.684427  3241 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:01:40.735807  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.737031  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.737169  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.704226  3403 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.738770  1535 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:40.738083  1532 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:40.747828  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:40.758716  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48350
I20260709 13:01:40.759274  1684 raft_consensus.cc:606] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:01:40.761845  3403 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:40.756433  3437 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:40.763929  3437 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.765883  3437 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:40.756680  3233 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:40.772184  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.773105  1532 raft_consensus.cc:2393] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:40.774467  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:40.777438  1610 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:40.779412  1611 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:40.733623  3479 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.780364  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:40.780743  3479 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.789381  3333 raft_consensus.cc:993] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: : Instructing follower 9d926c10b90f452ba52d80dab6a50351 to start an election
I20260709 13:01:40.790179  3333 raft_consensus.cc:1081] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Signalling peer 9d926c10b90f452ba52d80dab6a50351 to start an election
I20260709 13:01:40.791405  1611 raft_consensus.cc:3055] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:40.792282  1611 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:40.799294  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.799474  1579 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:40.801395  1505 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:40.800271  1610 raft_consensus.cc:3055] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:40.804834  1610 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:40.805816  3437 raft_consensus.cc:993] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:01:40.805681  1610 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.806315  3437 raft_consensus.cc:1081] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:01:40.806733  1610 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.807554  3403 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:40.805821  3233 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:40.808733  3233 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.807914  3333 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:40.809448  3333 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:40.810412  3333 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:40.823817  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.809142  3233 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.825093  3241 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.805681  1611 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.826299  1611 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.826843  3241 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.828336  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.828341  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.828992  1607 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:40.829850  3241 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.831964  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.832753  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.833357  1607 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:40.833477  3241 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:40.832273  2368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
 from {username='slave'} at 127.0.0.1:46602
I20260709 13:01:40.834939  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:40.835822  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.851228  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.851473  1611 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.854255  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.865321  2368 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:40.870759  2368 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:40.865173  3479 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:40.871956  3414 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:40.872833  3479 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:40.875551  3479 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.853665  3459 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:40.880842  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:40.882166  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.882911  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:40.886433  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54752.2us
I20260709 13:01:40.886644  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.890883  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.891790  1505 leader_election.cc:400] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:40.892122  1505 leader_election.cc:403] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:40.895701  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:40.898824  3486 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:40.899089  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:40.899438  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1446) took 1381 ms. Trace:
I20260709 13:01:40.899775  1537 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:40.899645  3491 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:40.905319  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.900007  1685 rpcz_store.cc:276] 0709 13:01:39.518307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:39.518462 (+   155us) service_pool.cc:224] Handling call
0709 13:01:39.518861 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:39.991418 (+472557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.899147 (+907729us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b54001194d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:40.899360 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066457856}
I20260709 13:01:40.752364  3499 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.921311  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.924340  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:40.925732  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:40.885890  3448 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:40.886322  3327 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:40.893901  3384 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:40.890362  3475 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.893533  3482 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:40.931937  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.949548  1609 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:40.950405  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:40.950623  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.951308  1609 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:40.927244  1610 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.909960  3489 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:40.895012  3459 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:40.925089  3491 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.905834  3479 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:40.938923  3486 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:40.945466  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:40.948500  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:40.955754  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:40.966187  1536 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:40.925175  3241 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:40.987627  1541 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:40.998202  1541 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:40.976727  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.961167  2370 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:41.003834  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:41.007905  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.008610  1539 raft_consensus.cc:1240] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:41.005041  1533 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:41.008584  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:40.943707  3327 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:40.960492  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:41.002770  3404 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:01:41.011669  1612 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:41.013909  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:40.955790  3219 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:41.014681  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 56039.6us
I20260709 13:01:40.959954  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:40.995219  3241 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.021601  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:41.038197  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.015187  1537 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:41.001492  3503 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.017032  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.027837  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.032289  3473 consensus_queue.cc:1059] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:41.034685  3459 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.047005  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.036176  3219 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.044627  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:41.045720  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:40.942071  3448 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.049000  1685 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:41.053433  3219 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:41.031391  2368 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.054806  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:41.055151  3510 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.323s	user 0.004s	sys 0.000s
I20260709 13:01:41.044001  3241 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.055675  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.068944  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.054227  3233 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.059113  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:41.046434  3468 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:41.047293  3289 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.094411  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.096699  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:41.098968  3289 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.061185  3333 raft_consensus.cc:3055] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:41.109992  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.066197  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:41.093787  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.111420  1537 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
W20260709 13:01:41.114331  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.130163  3498 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:41.130749  3498 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:41.131146  3498 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:40.961376  2364 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:41.060842  3406 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:01:41.136651  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.139572  3347 raft_consensus.cc:993] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:01:41.140141  3347 raft_consensus.cc:1081] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:01:41.141503  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.141073  3347 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:41.142762  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.143899  1533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "469f8c03f4924f809435141a09c976fa"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:01:41.144013  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.144477  1533 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:41.144928  1533 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:41.145576  3289 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.178093  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.136145  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.049845  3503 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.148609  1532 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:41.152007  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.155241  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1259) took 1111 ms. Trace:
I20260709 13:01:41.155882  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:41.158138  1686 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:41.151629  1609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:01:41.160560  3448 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.058020  3414 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:01:41.144013  1540 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:41.170650  3233 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:41.173290  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.100701  3219 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:41.176362  1685 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:41.209515  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.151649  1687 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:41.146643  3479 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.185870  1690 rpcz_store.cc:276] 0709 13:01:40.044454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:40.044662 (+   208us) service_pool.cc:224] Handling call
0709 13:01:40.045067 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:40.500610 (+455543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:40.500660 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:40.504399 (+  3739us) log.cc:844] Serialized 26 byte log entry
0709 13:01:40.732812 (+228413us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:40.732874 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:40.733222 (+   348us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:40.923580 (+190358us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:01:41.154937 (+231357us) raft_consensus.cc:1685] finished
0709 13:01:41.154959 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:41.155172 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25179,"raft.queue_time_us":39205,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":9156,"spinlock_wait_cycles":2443648,"thread_start_us":640580,"threads_started":2,"wal-append.queue_time_us":221865}
I20260709 13:01:41.185456  1684 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:41.111703  3333 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:41.189522  3496 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.244565  1609 raft_consensus.cc:606] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:41.245185  1609 raft_consensus.cc:614] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:41.190012  3474 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.239991  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:41.200405  3404 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.201006  3289 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:41.209312  3219 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.255923  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.260401  1684 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:41.233572  3473 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:41.262892  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:41.267253  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 341585us
I20260709 13:01:41.271050  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:41.273103  1612 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:01:41.274070  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 177524us
W20260709 13:01:41.276906  1423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 320430us
I20260709 13:01:41.209872  3491 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:01:41.273609  1612 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:41.285802  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.292026  1690 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:41.297524  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.288798  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:41.300010  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.263641  3219 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:41.308482  1682 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:41.284904  3473 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.315006  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:41.253136  3496 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.316999  1690 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:41.333304  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.263471  3289 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.302989  1612 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.336499  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:41.350895  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.386864  1612 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.387907  1688 raft_consensus.cc:2410] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:41.333797  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.410320  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:41.308905  2368 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.312120  3154 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:41.287817  3482 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.065s
W20260709 13:01:41.415735  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 79361us
I20260709 13:01:41.420588  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:41.354127  1533 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:41.423297  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 128829us
I20260709 13:01:41.421543  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:41.257690  3474 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.436678  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:41.342859  3491 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:01:41.312194  3499 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.109s
I20260709 13:01:41.266052  3404 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:01:41.447011  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.446484  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 135307us
I20260709 13:01:41.318783  3492 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:01:41.421615  3481 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.443150  3120 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.415285  3479 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.409216  3525 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.115s
I20260709 13:01:41.448511  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:41.348342  3333 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.443430  3403 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:01:41.454080  1610 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:41.565238  3499 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:41.443605  3468 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.572389  3468 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.526762  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 91) took 3295 ms. Trace:
I20260709 13:01:41.478364  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48350
I20260709 13:01:41.479132  3473 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:41.536466  1437 catalog_manager.cc:5697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.479627  3503 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:41.438434  3532 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:41.577384  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:41.464412  3517 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:01:41.576984  1437 catalog_manager.cc:5697] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 3 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:41.465195  3524 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:41.524587  1533 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.579711  3532 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.580216  3532 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.455487  3354 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:41.530864  3241 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.585239  1538 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:41.586899  3494 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.007s	sys 0.017s
W20260709 13:01:41.587339  3494 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.007s	sys 0.017s
I20260709 13:01:41.459581  3409 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.588694  3409 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.591075  3409 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.572137  3499 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:41.592331  3241 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:41.593433  3518 log.cc:927] Time spent T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.322s	user 0.003s	sys 0.000s
I20260709 13:01:41.593493  3499 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:41.446075  3498 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:41.494638  3516 log.cc:927] Time spent T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:01:41.478013  3404 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.461113  3120 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:41.563159  1690 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:41.597899  3120 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:41.495198  3523 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:01:41.573770  1436 rpcz_store.cc:276] 0709 13:01:38.231625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.231893 (+   268us) service_pool.cc:224] Handling call
0709 13:01:41.526637 (+3294744us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:39.272138 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:39.272719 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:39.272753 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:01:39.272770 (+    17us) tablet.cc:662] Decoding operations
0709 13:01:39.273691 (+   921us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:39.273745 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:39.273773 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:39.274487 (+   714us) tablet.cc:701] Row locks acquired
0709 13:01:39.274506 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:39.274646 (+   140us) write_op.cc:270] Start()
0709 13:01:39.274768 (+   122us) write_op.cc:276] Timestamp: P: 1783602099274596 usec, L: 0
0709 13:01:39.274787 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:01:39.292351 (+ 17564us) log.cc:844] Serialized 3977 byte log entry
0709 13:01:39.469222 (+176871us) op_driver.cc:464] REPLICATION: finished
0709 13:01:39.564091 (+ 94869us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb03e28 00007fd03253e581 00007fd03253dd58 00007fd0325429f1 00007fd0325429a9 00007fd032542939 00007fd032542901 00007fd032541b2d 000000000038f354 000000000038f199
0709 13:01:39.919371 (+355280us) write_op.cc:301] APPLY: starting
0709 13:01:39.935130 (+ 15759us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:39.973400 (+ 38270us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:39.976903 (+  3503us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:40.284495 (+307592us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:40.355210 (+ 70715us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:01:40.355256 (+    46us) write_op.cc:312] APPLY: finished
0709 13:01:40.355620 (+   364us) log.cc:844] Serialized 70 byte log entry
0709 13:01:40.355808 (+   188us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:40.355948 (+   140us) write_op.cc:454] Released schema lock
0709 13:01:40.355997 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:40.356499 (+   502us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:40.356527 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20198,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":403670,"apply.run_cpu_time_us":6392,"apply.run_wall_time_us":449292,"num_ops":9,"prepare.queue_time_us":152134,"prepare.run_cpu_time_us":29750,"prepare.run_wall_time_us":311691,"replication_time_us":194256,"spinlock_wait_cycles":38498176,"thread_start_us":354846,"threads_started":2}]]}
I20260709 13:01:41.526954  3219 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.574805  3468 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:41.511389  3327 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 13:01:41.453626  3486 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:41.449889  1505 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:41.603812  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 155446us
I20260709 13:01:41.612746  3108 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.612982  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:41.604699  3496 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.612653  1437 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.613432  3108 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:41.614770  3496 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:41.605355  3103 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.466289  3289 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:41.491278  1612 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:41.617758  2329 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:41.603541  3333 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.621011  3496 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:41.621657  3496 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:41.622742  3496 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:41.621030  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.624239  3498 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:41.624529  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.611894  3219 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
W20260709 13:01:41.633236  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 183408us
I20260709 13:01:41.634161  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.634714  3475 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:41.635169  3486 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.635663  3486 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.636067  3486 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.641250  1683 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:41.643939  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 202535us
I20260709 13:01:41.646507  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.615936  1437 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.647274  3539 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:41.650784  1437 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:41.651757  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 318066us
I20260709 13:01:41.652513  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:41.635195  3475 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:41.659721  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.661720  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:41.657575  1437 catalog_manager.cc:5697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.615571  3108 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.707235  3547 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.707837  3547 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.708240  3547 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.708910  3540 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:41.709640  3540 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:41.709867  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 96981.1us
I20260709 13:01:41.710165  3540 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:41.711373  3348 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:41.711849  3348 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:41.712312  3348 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:41.712406  3544 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:41.713555  3544 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:41.713925  3544 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:41.714198  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:41.714775  3544 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.715952  3544 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.716437  3481 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:01:41.718331  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58698.3us
I20260709 13:01:41.718423  3289 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:41.722364  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:01:41.732599  1616 raft_consensus.cc:606] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:41.732969  1616 raft_consensus.cc:614] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:41.724169  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.727667  1437 catalog_manager.cc:5697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:01:41.739655  1437 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.746827  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.733980  3327 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:41.756692  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.756894  3120 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.757514  1540 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:01:41.759223  3120 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:41.759091  3348 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.759944  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.722015  3539 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:41.760845  3539 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:41.761193  3539 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:41.763339  3404 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:41.760222  3154 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:41.763844  3404 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.807284  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.794868  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.808007  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.808310  1541 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:41.794484  3474 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.808714  1532 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:41.790942  3494 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:41.797259  1684 raft_consensus.cc:606] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:01:41.810289  1532 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:41.790107  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 138821us
I20260709 13:01:41.770560  3348 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:41.813228  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.799861  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.806633  3491 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.812454  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.790004  3327 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:41.816267  3491 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.817334  3327 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.763772  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:41.790393  3384 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.793840  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.753856  3289 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.776804  3479 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:41.771618  1580 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.822433  3537 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:41.822770  3289 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:41.823639  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 52125.4us
I20260709 13:01:41.822835  3537 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.824333  3537 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.825512  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.819490  3491 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.829732  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:41.831194  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.780583  2329 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:01:41.840728  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.842013  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
W20260709 13:01:41.846448  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 66023.4us
I20260709 13:01:41.846768  1611 raft_consensus.cc:606] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:41.831756  3289 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:41.745956  1437 catalog_manager.cc:5697] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
W20260709 13:01:41.848351  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 116807us
I20260709 13:01:41.836171  3404 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.855370  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.861341  1540 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:41.862850  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:41.863436  1685 raft_consensus.cc:3055] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:41.854264  1437 catalog_manager.cc:5697] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 4, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.849387  3108 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:41.863719  1685 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:41.867892  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:41.870357  1686 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:41.865736  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:41.865849  1437 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.873142  1437 catalog_manager.cc:5697] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:01:41.875595  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.877107  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:41.881632  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 50500.1us
I20260709 13:01:41.819504  3327 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.894272  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.895078  1682 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:41.895836  1580 leader_election.cc:400] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:41.907904  1437 catalog_manager.cc:5697] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.910092  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:41.910382  1437 catalog_manager.cc:5697] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.907904  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.908427  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.920373  1687 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:41.924250  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:41.775704  3547 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.869973  3543 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:41.938158  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.930310  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:41.931413  1535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:01:41.844696  3544 consensus_queue.cc:1059] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:01:41.840260  3384 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.942070  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.926972  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.927983  1541 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:41.933400  1532 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:01:41.919775  1437 catalog_manager.cc:5697] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 4, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.936208  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.939879  1535 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:41.939775  1607 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:41.943956  1535 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:41.871199  3108 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:41.944307  1689 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:41.945688  1682 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:01:41.945972  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 50288.6us
I20260709 13:01:41.946285  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.946748  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.946929  1534 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:41.948076  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:41.949355  1540 raft_consensus.cc:2393] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:41.949168  1437 catalog_manager.cc:5697] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:01:41.800026  3475 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.959149  3544 consensus_queue.cc:1243] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:41.954649  2369 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:41.959157  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:41.966033  3532 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:41.952509  1437 catalog_manager.cc:5697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:41.956930  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:41.967388  1613 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:41.957600  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:41.968699  1615 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:41.958997  3525 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:41.956092  3547 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.970477  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.971995  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:41.974892  1613 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:41.934197  2364 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:01:41.975381  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 132198us
I20260709 13:01:41.979228  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:41.986078  2328 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:41.985443  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 122686us
I20260709 13:01:41.981822  1437 catalog_manager.cc:5697] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:01:41.994513  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:41.993423  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:41.949023  3108 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:41.972688  3473 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.002544  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:42.015625  1540 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.018066  1541 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:41.996421  3493 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.020592  3541 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:42.021214  3541 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.023386  3541 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.948710  3327 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:01:42.024817  3327 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:42.025308  3327 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:42.026530  3327 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.002362  3543 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.029018  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:42.030387  3556 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:01:42.031591  3384 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:41.967651  3539 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.034034  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:42.045323  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:41.950441  3491 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:01:42.041548  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:42.037727  1541 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:42.052386  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:42.056530  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:42.047079  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:42.047981  1615 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:42.059296  1612 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.068356  1540 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:42.075572  1613 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:42.036218  3327 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.085760  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:42.088153  1615 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.086436  1611 raft_consensus.cc:2368] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6.
I20260709 13:01:42.023649  3540 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.046197  3384 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:42.151950  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.161576  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.162195  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 69555.5us
I20260709 13:01:42.049502  3532 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:42.085415  3219 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:42.048585  3499 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 13:01:42.183128  1609 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:42.188541  1612 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:42.048822  3468 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:01:42.161657  3093 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:42.195364  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 224964us
W20260709 13:01:42.208011  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 261334us
I20260709 13:01:42.194597  1615 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:42.209151  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.057883  3537 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:42.221271  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.179874  3545 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.233639  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:01:42.235929  1613 raft_consensus.cc:606] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:42.236415  1613 raft_consensus.cc:614] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:42.169579  3384 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:42.206609  3486 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.570s	user 0.004s	sys 0.008s
I20260709 13:01:42.196784  3219 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:42.249266  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:42.252750  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.260618  3548 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:42.261662  3459 consensus_queue.cc:1059] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:42.266512  3384 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.256707  3471 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.246270  3289 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:01:42.272671  3546 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:42.273437  3546 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.274466  3540 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.277310  3539 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.277475  3103 consensus_queue.cc:1059] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:01:42.268509  3219 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.301045  1616 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:42.301836  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.252554  3473 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.302489  3354 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:42.306795  3537 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:42.302702  3544 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.319036  3405 consensus_queue.cc:1059] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:42.320255  3446 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.320367  3405 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:42.320717  3446 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:42.321578  3446 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:42.322588  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 69963.5us
W20260709 13:01:42.323064  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.323392  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.319888  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:42.324797  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.325848  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:42.326499  3473 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.322733  3446 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.325861  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.326609  3557 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:42.348618  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.350625  1685 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.253327  3486 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:42.325886  3354 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.335668  3544 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:42.366750  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:42.368129  1532 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.364513  1685 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.365433  3354 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.370738  3354 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.371872  3473 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.362074  1535 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.375428  1540 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:42.352802  3546 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.361255  3532 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:42.401080  3532 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:42.401340  3404 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.003s
I20260709 13:01:42.401904  3404 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.402082  3532 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.405795  3459 raft_consensus.cc:3055] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.406251  3459 raft_consensus.cc:740] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:42.407006  3459 consensus_queue.cc:260] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.410435  1615 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:42.411963  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63453.4us
I20260709 13:01:42.438009  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:42.439193  1533 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:42.439908  1535 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:42.354796  3537 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.335295  3499 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:01:42.449260  1654 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:42.408977  3103 raft_consensus.cc:3055] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:42.451604  3404 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:42.452757  3576 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:01:42.367424  3544 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.468771  1616 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:42.469581  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:01:42.476903  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63812.5us
I20260709 13:01:42.471781  1616 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:42.477769  1580 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.457302  3537 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.466269  3541 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.465626  3548 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.483896  1616 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.491484  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:42.467927  3103 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:42.476210  3498 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:42.478946  3494 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:42.501610  1608 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.474534  3547 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.473739  3544 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.464910  3354 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.485191  3404 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.514802  1616 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.502707  1614 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:42.500682  3327 raft_consensus.cc:1064] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:01:42.492388  3537 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:42.521167  1534 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:42.501175  3548 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:42.513391  3498 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:42.538573  3498 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:42.538753  3571 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:01:42.543104  3486 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.537777  3471 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.529584  3494 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:42.509493  3541 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.554483  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:42.555308  1539 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:42.558820  1532 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:42.563169  1608 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:42.517102  3566 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.567492  1685 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:42.525713  3547 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:42.572638  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48601.1us
I20260709 13:01:42.536348  3548 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:42.632150  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 162656us
W20260709 13:01:42.639370  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.526469  3384 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:42.641028  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:42.587934  3405 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:01:42.656534  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:42.659936  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:42.548694  3103 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.652690  3384 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.649272  3486 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.662277  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:42.691869  3108 consensus_meta.cc:287] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.647s	user 0.012s	sys 0.000s
I20260709 13:01:42.663460  3477 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:01:42.710220  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48028.4us
I20260709 13:01:42.711012  1580 leader_election.cc:400] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:42.666218  3587 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.689095  3354 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:42.715363  3384 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:42.692896  3404 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.662247  3544 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.698088  3546 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.709438  3540 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:42.707487  3545 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.660471  3566 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.739018  3532 consensus_queue.cc:1059] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:42.739665  3566 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.740481  3477 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:42.741743  3477 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.653025  3494 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.672861  3547 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.699009  3486 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.778151  1610 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:42.771739  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.780198  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 60587.1us
I20260709 13:01:42.782423  1580 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.726962  3590 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:42.713529  3108 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.734297  3384 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.753034  3540 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.800462  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.788822  3404 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:42.752259  3546 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.802209  3541 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.796396  3540 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:42.727144  3587 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.795781  3590 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:42.827692  3594 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:01:42.829085  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.804527  3489 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:42.842108  1616 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:42.798671  3471 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:01:42.807654  3233 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:42.854646  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 106755us
I20260709 13:01:42.826359  3404 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.798863  3384 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.753717  3545 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.839978  3541 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:42.828240  3597 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:42.878396  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:42.881713  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:42.874046  3555 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.931s	user 0.005s	sys 0.000s
I20260709 13:01:42.850869  3327 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.855141  3489 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:42.871658  3541 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:42.883314  3600 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:42.898765  3498 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:42.899318  3600 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.874359  3596 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:42.903868  3587 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.882750  3597 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.860083  3233 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.897836  3546 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:42.917084  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 116850us
I20260709 13:01:42.876070  3108 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.917042  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1545) took 1008 ms. Trace:
I20260709 13:01:42.932610  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:42.939461  1611 rpcz_store.cc:276] 0709 13:01:41.908885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.909854 (+   969us) service_pool.cc:224] Handling call
0709 13:01:42.916853 (+1006999us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540014aad4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:42.916982 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":377982336}
I20260709 13:01:42.940874  1614 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:42.904582  3589 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:01:42.939775  1532 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:42.889070  3592 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:01:42.933351  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.918749  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:42.906358  3409 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 13:01:42.905026  3588 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:01:42.924106  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:42.891433  2366 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 331) took 1244 ms. Trace:
I20260709 13:01:42.885890  3557 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:42.916674  3233 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.954968  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.914083  3545 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.906809  3597 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.956646  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.896262  3489 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:42.948151  3473 consensus_meta.cc:287] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.005s
I20260709 13:01:42.892741  3590 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.960729  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1549) took 1036 ms. Trace:
I20260709 13:01:42.949290  3600 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.965083  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.967841  1532 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:42.898334  3604 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:01:42.970127  1609 rpcz_store.cc:276] 0709 13:01:41.924076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.924686 (+   610us) service_pool.cc:224] Handling call
0709 13:01:42.960453 (+1035767us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54001b5dd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:42.960633 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538995584}
I20260709 13:01:42.975641  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.978380  3498 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:42.962486  3409 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:42.981812  1580 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:42.964829  3544 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.897063  3541 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.967574  3557 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:42.903941  3596 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:42.973801  3543 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:42.997920  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:42.990418  3605 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.985349  3471 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 13:01:43.002199  3446 consensus_meta.cc:287] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.003s
I20260709 13:01:42.985953  3333 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:43.002918  3333 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:43.003016  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.003398  3333 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:42.985285  3409 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:42.994031  3586 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.339s	user 0.002s	sys 0.001s
I20260709 13:01:42.994302  3404 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:42.954370  2366 rpcz_store.cc:276] 0709 13:01:41.646638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.646844 (+   206us) service_pool.cc:224] Handling call
0709 13:01:41.647351 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:41.647922 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:41.647976 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:41.648782 (+   806us) log.cc:844] Serialized 26 byte log entry
0709 13:01:41.746473 (+ 97691us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:41.756090 (+  9617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:41.756187 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.812368 (+1056181us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:01:42.890911 (+ 78543us) raft_consensus.cc:1685] finished
0709 13:01:42.890932 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:42.891345 (+   413us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4644,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":117,"spinlock_wait_cycles":69802368,"thread_start_us":54881,"threads_started":1,"wal-append.queue_time_us":217441}
I20260709 13:01:42.983529  3486 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:43.006006  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.007226  1614 raft_consensus.cc:2393] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:43.010198  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:43.010910  1614 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.981415  3537 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:43.004149  3409 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.000085  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:42.971978  3473 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:43.005090  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.002053  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.018662  1609 raft_consensus.cc:2410] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:43.018785  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:43.019105  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:43.019490  1611 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:42.999603  3543 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:43.020370  3543 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.020596  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.021353  1608 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:43.022383  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.022925  3537 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:43.023710  1607 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:43.024170  3603 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:43.025262  3603 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:43.025712  3603 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:43.026609  3603 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:43.028144  3603 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.029915  3596 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:42.999831  3541 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.041715  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1563) took 1091 ms. Trace:
I20260709 13:01:43.042197  1615 rpcz_store.cc:276] 0709 13:01:41.950793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.227299 (+276506us) service_pool.cc:224] Handling call
0709 13:01:42.231767 (+  4468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:42.411149 (+179382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.041397 (+630248us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b5400421154. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:43.041638 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409974656}
I20260709 13:01:43.047640  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.049078  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.050186  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.050828  1609 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
W20260709 13:01:43.051973  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.023694  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.054981  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.055029  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.056453  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.043751  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.019932  1616 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:43.057719  1611 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:43.066457  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.068537  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.071870  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.071628  1614 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:43.065056  3543 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:43.075361  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.076759  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.079691  3327 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:43.087460  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.061862  3596 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:43.090701  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:43.091706  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.072918  3241 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:43.070724  3600 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:43.094410  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:43.095801  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.073539  3597 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:43.075356  3582 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.674s	user 0.000s	sys 0.011s
I20260709 13:01:43.095790  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:43.099423  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:43.100873  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.101306  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.102381  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.103627  1612 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:43.075042  3486 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:43.103741  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.106552  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.111254  1608 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:43.088218  3545 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:43.112169  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.116369  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:43.118803  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:43.119606  1532 raft_consensus.cc:2368] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:43.120326  3241 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:43.120473  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:43.120939  1580 leader_election.cc:400] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
I20260709 13:01:43.121318  1580 leader_election.cc:403] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:01:43.121248  1532 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:43.092758  3233 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:43.093916  3327 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:43.126336  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:43.127465  3327 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:43.127784  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:43.128647  1532 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:43.133744  3475 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:43.104343  3596 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:43.100204  3525 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:43.088852  3557 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:43.122380  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.120944  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:43.120451  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:43.105031  3598 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:43.109143  3489 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:43.142974  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 168255us
I20260709 13:01:43.145045  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.152676  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:43.153319  1608 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.157214  3595 raft_consensus.cc:3055] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:43.157799  3595 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:43.121985  3600 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:43.164173  1532 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:43.166455  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:43.158784  3595 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:43.168329  3473 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:43.170564  1532 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:43.170609  3473 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:43.173228  3473 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:43.173059  3595 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:43.177944  3593 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.370s	user 0.003s	sys 0.000s
W20260709 13:01:43.147504  3609 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.168s	user 0.000s	sys 0.002s
I20260709 13:01:43.137265  3545 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:43.140645  3525 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:43.181435  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.293218  1614 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:43.294251  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.295914  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.297170  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:43.298606  1614 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:01:43.299791  1614 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:01:43.275411  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 110917us
I20260709 13:01:43.300554  3547 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:01:43.301033  1487 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:01:43.301553  1487 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 71e3bb6ac3eb408ba9c57b48de886d65 already in progress
I20260709 13:01:43.301127  3547 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:43.301815  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 71e3bb6ac3eb408ba9c57b48de886d65 already in progress
I20260709 13:01:43.303311  3547 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:43.295914  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.305874  1614 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:43.276235  1612 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:43.142289  3537 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:43.273934  3384 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:43.278792  3600 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:43.284236  3473 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:43.184857  1608 raft_consensus.cc:2410] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:43.361979   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:01:43.429847  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.451738  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:43.450938  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1533) took 1068 ms. Trace:
I20260709 13:01:43.420451  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1565) took 1056 ms. Trace:
I20260709 13:01:43.443050  3605 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.465794  1607 rpcz_store.cc:276] 0709 13:01:42.363599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.363760 (+   161us) service_pool.cc:224] Handling call
0709 13:01:42.364071 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.024264 (+660193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.420077 (+395813us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b540040a6d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:43.420355 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1516689792}
W20260709 13:01:43.443416  3612 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:01:43.453367   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:43.426122  3598 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:43.464457  1540 rpcz_store.cc:276] 0709 13:01:42.382385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.383652 (+  1267us) service_pool.cc:224] Handling call
0709 13:01:42.384131 (+   479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:42.455556 (+ 71425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:42.455604 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:43.064105 (+608501us) spinlock_profiling.cc:243] Waited 9.41 ms on lock 0x7b2c00000f48. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:01:43.064843 (+   738us) log.cc:844] Serialized 52 byte log entry
0709 13:01:43.123028 (+ 58185us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:43.345262 (+222234us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.414943 (+ 69681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.415072 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:43.415149 (+    77us) raft_consensus.cc:1685] finished
0709 13:01:43.450543 (+ 35394us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.450842 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":122455,"raft.queue_time_us":129884,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":23127,"spinlock_wait_cycles":21641088,"thread_start_us":259229,"threads_started":2,"wal-append.queue_time_us":87210}
I20260709 13:01:43.309128  3543 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:43.475283  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 174908us
I20260709 13:01:43.479735  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:43.443162  3596 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:43.401084  3593 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:43.441974  3544 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:43.331727  3404 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:43.519021  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.477203  3614 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:01:43.644294  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.575973  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.493319  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:43.651309  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:43.707958  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.766489  2367 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:01:43.767699  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.641817  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:43.378392  3489 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.332306  3540 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:43.318087  3548 consensus_meta.cc:287] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.663s	user 0.009s	sys 0.011s
I20260709 13:01:43.452680  3473 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:43.649894  3532 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:43.337457  3384 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:43.798841  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:43.330876  3525 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:43.485682  3605 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:43.643893  3600 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:43.495630  3598 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:43.784545  3475 consensus_meta.cc:287] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.007s
I20260709 13:01:43.867365  1615 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:43.836007  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.132220  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:43.772681  3595 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.598s	user 0.005s	sys 0.005s
I20260709 13:01:44.129724  1540 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:44.139906  1654 leader_election.cc:400] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6.
W20260709 13:01:43.878887  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:43.628554  3604 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:43.945437  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.036s (SENT) [suppressed 31 similar messages]
I20260709 13:01:44.132879  1537 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:01:43.904332  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1535) took 1521 ms. Trace:
W20260709 13:01:44.043129  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 274984us
I20260709 13:01:43.766129  3547 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:43.765801  3486 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:43.766145  3596 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:44.141687  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:44.152254  1536 rpcz_store.cc:276] 0709 13:01:42.383054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.443175 (+ 60121us) service_pool.cc:224] Handling call
0709 13:01:42.443515 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.513850 (+ 70335us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:42.526070 (+ 12220us) log.cc:844] Serialized 14 byte log entry
0709 13:01:42.724705 (+198635us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:42.731767 (+  7062us) log.cc:844] Serialized 26 byte log entry
0709 13:01:42.731999 (+   232us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:42.732079 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:42.732186 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:42.912765 (+180579us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4800030e58. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd033a31aa1 00007fd033a28b37 00007fd033a289ca 00007fd033b2026f 00007fd033b1ff37 00007fd033b3455c 00007fd033b34508 00007fd033b34488 00007fd033b34443 00007fd033b336ec 00007fd032a5da96
0709 13:01:43.085464 (+172699us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:01:43.904096 (+818632us) raft_consensus.cc:1685] finished
0709 13:01:43.904117 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:43.904260 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47273,"prepare.queue_time_us":12051,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":65,"raft.queue_time_us":113288,"raft.run_cpu_time_us":2301,"raft.run_wall_time_us":457427,"spinlock_wait_cycles":16100352,"thread_start_us":199060,"threads_started":3,"wal-append.queue_time_us":226964}
I20260709 13:01:44.173508  1532 raft_consensus.cc:2368] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 3. Current term is 4.
I20260709 13:01:43.843219  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:44.143724  1654 leader_election.cc:403] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:43.865877  3618 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.616s	user 0.003s	sys 0.000s
W20260709 13:01:43.804634  3612 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:01:43.896699  3409 consensus_meta.cc:287] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.861s	user 0.011s	sys 0.005s
I20260709 13:01:44.184412  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:44.185158  1532 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:43.770800  3587 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:43.907981  3333 consensus_meta.cc:287] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.904s	user 0.014s	sys 0.000s
I20260709 13:01:44.174729  2369 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:43.842078  3476 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:43.797900  3468 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:43.770167  3404 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.176133  1608 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:01:44.176637  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47614.9us
I20260709 13:01:44.182827  1540 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:44.101810  3540 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:44.043929  3403 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:44.067934  3590 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:43.725051  3544 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.187245  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:43.788944  3489 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.177002  3475 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:44.175669  3604 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:44.214560  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1456) took 1095 ms. Trace:
I20260709 13:01:44.151650  3541 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:43.809104  3548 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:44.176206  3537 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.868s	user 0.012s	sys 0.001s
I20260709 13:01:44.218159  1536 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:01:44.196687  3409 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.150206  3414 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:01:44.133378  3384 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:44.225597  1540 rpcz_store.cc:276] 0709 13:01:43.118965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.798518 (+679553us) service_pool.cc:224] Handling call
0709 13:01:44.214494 (+415976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.183455  3486 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.233803  1532 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:01:44.196605  3448 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:44.196700  3623 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:44.243672  1538 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:01:44.141544  3532 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:44.233222  3597 consensus_meta.cc:287] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.115s	user 0.009s	sys 0.004s
I20260709 13:01:44.221954  3446 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:01:44.176167  3547 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:44.222234  3545 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:44.249351  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34908 (request call id 160) took 2512 ms (client timeout 1798 ms). Trace:
W20260709 13:01:44.253096  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.248787  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 167) took 1087 ms. Trace:
I20260709 13:01:44.253734  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1538) took 1331 ms. Trace:
I20260709 13:01:44.258581  1540 rpcz_store.cc:276] 0709 13:01:43.161022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.247663 (+1086641us) service_pool.cc:224] Handling call
0709 13:01:44.248126 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.248351 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.248387 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.248444 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.248498 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.248570 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.248714 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.185600  3596 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:44.261865  3489 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:44.262135  3409 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:44.234597  3403 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.246352  3448 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:44.264672  3403 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:44.218578  3468 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:44.234423  3475 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.265396  3596 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:44.267657  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 168) took 1106 ms. Trace:
I20260709 13:01:44.235095  3537 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4.
W20260709 13:01:44.257944  1533 rpcz_store.cc:269] 0709 13:01:41.730421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.730963 (+   542us) service_pool.cc:224] Handling call
0709 13:01:44.243079 (+2512116us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b5400071554. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:44.243245 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1534753664}
I20260709 13:01:44.275064  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 169) took 1113 ms. Trace:
I20260709 13:01:44.275529  1533 rpcz_store.cc:276] 0709 13:01:43.161723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.272294 (+1110571us) service_pool.cc:224] Handling call
0709 13:01:44.274547 (+  2253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.274737 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.274761 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.274815 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.274848 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.274904 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.275010 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:44.267742  2367 consensus_meta.cc:287] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.001s
I20260709 13:01:44.277187  2367 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:01:44.257495  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 83289.2us
I20260709 13:01:44.268169  1540 rpcz_store.cc:276] 0709 13:01:43.161411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.259861 (+1098450us) service_pool.cc:224] Handling call
0709 13:01:44.260179 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.260423 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.260453 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.260497 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.260545 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.260600 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.267595 (+  6995us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.205103  3587 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.281289  3587 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:44.204869  3333 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.283564  3333 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:44.267125  3475 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:44.213517  3476 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:44.252511  3597 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:44.222584  3590 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.258857  1535 rpcz_store.cc:276] 0709 13:01:42.922401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.922547 (+   146us) service_pool.cc:224] Handling call
0709 13:01:42.923012 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:42.923555 (+   543us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:42.946443 (+ 22888us) log.cc:844] Serialized 14 byte log entry
0709 13:01:43.086893 (+140450us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.097368 (+ 10475us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.097521 (+   153us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:43.097555 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:43.097617 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.253475 (+1155858us) raft_consensus.cc:1685] finished
0709 13:01:44.253498 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.253666 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20932,"raft.queue_time_us":7514,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":13680,"spinlock_wait_cycles":8978304,"thread_start_us":124571,"threads_started":1,"wal-append.queue_time_us":182501}
I20260709 13:01:44.311659  2329 leader_election.cc:400] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 3. Current term is 4.
I20260709 13:01:44.239620  3541 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.245460  3619 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:01:44.264710  3448 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:44.267104  3468 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:44.324136  2329 leader_election.cc:403] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:44.330226  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:44.330786  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 172) took 1055 ms. Trace:
I20260709 13:01:44.331199  1535 rpcz_store.cc:276] 0709 13:01:43.275150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.329947 (+1054797us) service_pool.cc:224] Handling call
0709 13:01:44.330277 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.330468 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.330493 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.330535 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:44.330575 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.330630 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.330733 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.270874  3545 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:44.358271  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 171) took 1192 ms. Trace:
I20260709 13:01:44.358870  1533 rpcz_store.cc:276] 0709 13:01:43.166175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.311738 (+1145563us) service_pool.cc:224] Handling call
0709 13:01:44.357696 (+ 45958us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.357910 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.357937 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:44.357984 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.358015 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.358068 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.358200 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:44.375196  1534 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:01:44.378324  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 432954us
I20260709 13:01:44.254814  3623 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:44.358368  3620 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 3. Current term is 4.
I20260709 13:01:44.362172  3404 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:44.381146  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51008.8us
I20260709 13:01:44.361922  3448 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:44.390396  2329 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:01:44.420222  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.421875  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.382023  3597 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:44.365959  3545 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:44.435802  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 223284us
I20260709 13:01:44.391645  3448 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:44.441020  3448 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:44.397624  3475 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.315371  3604 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.413558  3473 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:44.421963  3434 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:01:44.437237  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.460808  3619 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:01:44.461870  3626 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:01:44.462842  3628 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 13:01:44.484807  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 329481us
I20260709 13:01:44.447655  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:01:44.481642  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.487968  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:44.502508  3384 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:44.453918  3605 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:44.484982  3544 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:44.481084  3477 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:01:44.454540  3597 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.480454  3475 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:44.550602  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1454) took 1432 ms. Trace:
I20260709 13:01:44.586508  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:44.736368  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:44.655157  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:44.631891  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1307) took 1619 ms (client timeout 1813 ms). Trace:
W20260709 13:01:45.176671  1615 rpcz_store.cc:269] 0709 13:01:43.012422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.043453 (+ 31031us) service_pool.cc:224] Handling call
0709 13:01:44.631596 (+1588143us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b540024d1d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:44.631804 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862203776}
W20260709 13:01:44.649797  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.178092  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.178493  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.178762  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.557366  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:44.573639  1690 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:44.733489  1534 rpcz_store.cc:276] 0709 13:01:43.118457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.120740 (+  2283us) service_pool.cc:224] Handling call
0709 13:01:44.550374 (+1429634us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54000ca3d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:44.550502 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2724098304}
I20260709 13:01:44.519611  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:45.180351  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.180604  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:44.665448  3631 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:45.184324  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1581) took 1701 ms (client timeout 1728 ms). Trace:
W20260709 13:01:44.670962  3635 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:01:44.490619  3548 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:44.584483  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:44.772727  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.189476  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:44.507696  2366 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:44.997368   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:45.158962  3406 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:45.159188  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:45.161047  3446 consensus_meta.cc:287] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.905s	user 0.013s	sys 0.000s
I20260709 13:01:45.160869  3607 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:44.865195  3636 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:45.161643  3632 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.050086  3448 consensus_meta.cc:287] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 13:01:45.174350  3477 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.164659  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:45.165966  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1294) took 2155 ms. Trace:
I20260709 13:01:45.167053  1612 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:45.168876  3633 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.671672  3639 log.cc:927] Time spent T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:01:45.169452  3348 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.753334  3093 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:44.749400  3241 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.628949  3459 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:45.173511  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.959335  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:44.988397  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 477631us
I20260709 13:01:44.538177  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:45.181380  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:44.585119  2364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 204) took 1273 ms. Trace:
I20260709 13:01:44.845283  3596 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:44.585107  3610 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.509s	user 0.013s	sys 0.013s
W20260709 13:01:45.184890  1609 rpcz_store.cc:269] 0709 13:01:43.482543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.654805 (+1172262us) service_pool.cc:224] Handling call
0709 13:01:45.184253 (+529448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.285594  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:45.205569  3333 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:45.286264  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:45.185997  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.257690  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:45.288323  1534 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:45.288275  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.254518  1682 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:45.290403  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:44.713696  3638 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 13:01:45.258086  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:44.918766  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:45.190445  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:44.780570  3634 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:44.716146  3590 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:44.748992  3468 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:44.585119  3545 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:44.826020  3525 consensus_meta.cc:287] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.005s
I20260709 13:01:45.198881  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:44.514667  3598 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:45.202222  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1582) took 1719 ms. Trace:
I20260709 13:01:45.202217  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 160) took 2041 ms. Trace:
I20260709 13:01:44.737984  3619 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:45.203518  3406 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.171891  3103 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:45.203955  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.204006  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.193989  3540 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.212519  3632 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.174175  3606 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:44.512694  3532 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:44.787731  3547 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:44.825182  3476 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:44.845073  3623 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:45.257138  3241 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.186576  3600 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:45.194126  3631 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.242880  3652 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.216228  3636 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:45.244539  3643 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:01:45.247475  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:45.216027  3597 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:45.202436  3537 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:45.205243  3233 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.248621  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:45.248263  3633 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.218993  1614 rpcz_store.cc:276] 0709 13:01:43.010082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.306650 (+296568us) service_pool.cc:224] Handling call
0709 13:01:43.306938 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.307279 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.307307 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.307819 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:01:43.468863 (+161044us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:43.489704 (+ 20841us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.789917 (+1300213us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b180040b820. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287 00007fd02eb23208
0709 13:01:45.087983 (+298066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.088109 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.088175 (+    66us) raft_consensus.cc:1685] finished
0709 13:01:45.165301 (+ 77126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.165890 (+   589us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":597865,"prepare.queue_time_us":23712,"prepare.run_cpu_time_us":3227,"prepare.run_wall_time_us":45561,"raft.queue_time_us":1346983,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":8691,"spinlock_wait_cycles":2559232,"thread_start_us":458398,"threads_started":2,"wal-append.queue_time_us":412369,"wal-append.run_cpu_time_us":2781,"wal-append.run_wall_time_us":1137212}
I20260709 13:01:45.249250  3605 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:45.249464  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1512) took 3340 ms. Trace:
I20260709 13:01:45.198920  3624 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:45.284922  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:45.493819  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 150291us
W20260709 13:01:45.494119  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.490254  1538 rpcz_store.cc:276] 0709 13:01:41.909126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.909252 (+   126us) service_pool.cc:224] Handling call
0709 13:01:44.243232 (+2333980us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.246305 (+  3073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.249244 (+1002939us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b5400071550. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:45.249403 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5286601984}
I20260709 13:01:45.292429  1535 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:45.307444  3634 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.286854  1609 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:45.299639  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:45.299968  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.233817  3543 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.303910  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.503597  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:45.235287  3448 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.313969  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1459) took 2194 ms. Trace:
I20260709 13:01:45.366209  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.361686  1615 rpcz_store.cc:276] 0709 13:01:43.482847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.177663 (+1694816us) service_pool.cc:224] Handling call
0709 13:01:45.201652 (+ 23989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.201849 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.201882 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.201930 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.201968 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.202032 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.202163 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.382344  3540 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.382001  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:45.382673  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.311798   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:45.531997  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.535188  1689 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:45.539089  1609 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:45.544863  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:45.240401  3477 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.216761  2369 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 4. Ops: []
I20260709 13:01:45.309113  3590 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:45.402053  1504 connection.cc:256] RPC call timeout handler was delayed by -1.5405871930000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:01:45.552790  1504 connection.cc:256] RPC call timeout handler was delayed by -1.3240980390000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 13:01:45.553217  1504 connection.cc:256] RPC call timeout handler was delayed by -1.3240980390000345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 13:01:45.553545  1504 connection.cc:256] RPC call timeout handler was delayed by -1.2795243310000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
W20260709 13:01:45.553902  1504 connection.cc:256] RPC call timeout handler was delayed by -1.2121967890000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:01:45.554364  1504 connection.cc:256] RPC call timeout handler was delayed by -1.0662716819999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
I20260709 13:01:45.554541  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:45.302021  3333 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.257002  3093 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.251152  3348 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.409267  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.312629  3654 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.343235  3404 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:45.362659  3544 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:45.421105  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 233406us
I20260709 13:01:45.369354  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:45.437476  1688 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:45.312064  3468 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.297519  3596 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.483945  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:45.485759  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:45.421484  3547 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.206076  3475 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:45.214044  3446 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6.
I20260709 13:01:45.421038  3661 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:45.361598  3525 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.251335  3471 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:45.505581  1539 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:45.509323  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:45.361541  1613 rpcz_store.cc:276] 0709 13:01:43.160872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.400164 (+239292us) service_pool.cc:224] Handling call
0709 13:01:43.476005 (+ 75841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:43.490639 (+ 14634us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:44.221304 (+730665us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.201862 (+980558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.201917 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:45.201968 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.202045 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.202160 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1107418,"prepare.queue_time_us":456992,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":842016,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":6223,"thread_start_us":534102,"threads_started":2,"wal-append.queue_time_us":213850}
I20260709 13:01:45.507953  1536 rpcz_store.cc:276] 0709 13:01:43.119789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.235531 (+1115742us) service_pool.cc:224] Handling call
0709 13:01:44.235865 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.244204 (+  8339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.244236 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.244816 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.365046 (+120230us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:44.405188 (+ 40142us) log.cc:844] Serialized 14 byte log entry
0709 13:01:44.421500 (+ 16312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.421584 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.313718 (+892134us) raft_consensus.cc:1685] finished
0709 13:01:45.313741 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.313893 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":138244,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":42248,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":14494,"thread_start_us":117200,"threads_started":2,"wal-append.queue_time_us":172672}
I20260709 13:01:45.361624  3619 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.486680  3537 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.513509  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.513815  3657 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:45.513069  3653 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.493413  2368 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:45.217971  3607 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.556242  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:45.556317  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:45.561314  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1460) took 2441 ms. Trace:
W20260709 13:01:45.562844  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.382233  3606 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.486848  3233 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.519138  3543 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.498376  3605 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.432219  3652 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.422487  3600 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.500810  3624 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:45.932976  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 360986us
I20260709 13:01:45.929234  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:45.982872  1540 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:45.983536  3659 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.984169  3659 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.984869  3348 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:45.986763  3659 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:45.986975  3596 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:45.987407  3659 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:45.570027  3590 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.989219  3659 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.990700  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:45.993898  3633 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:45.993878  3525 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:45.995268  1532 rpcz_store.cc:276] 0709 13:01:43.120018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.240154 (+1120136us) service_pool.cc:224] Handling call
0709 13:01:44.240591 (+   437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:44.399260 (+158669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:44.399311 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:44.399953 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.488917 (+ 88964us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.488959 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.489049 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:45.561063 (+1072014us) raft_consensus.cc:1685] finished
0709 13:01:45.561091 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.561242 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21636,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":197402,"threads_started":2,"wal-append.queue_time_us":749910}
W20260709 13:01:45.657675  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 59433.5us
W20260709 13:01:45.998566  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.689164  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:45.999264  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:45.668519  1683 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:45.934580  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:45.925904  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1583) took 2442 ms. Trace:
W20260709 13:01:45.760179  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.001644  1611 rpcz_store.cc:276] 0709 13:01:43.483185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.571004 (+2087819us) service_pool.cc:224] Handling call
0709 13:01:45.571297 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.656513 (+ 85216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.656542 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.656581 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:45.656608 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.925617 (+269009us) spinlock_profiling.cc:243] Waited 85 ms on lock 0x7b540007bcd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:45.925673 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:45.925843 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195554560}
I20260709 13:01:45.981439  1615 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:45.575239  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 80045us
I20260709 13:01:46.006989  1684 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:01:46.004199  1611 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:45.656700  1533 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:46.008864  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1585) took 2524 ms. Trace:
I20260709 13:01:46.010835  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:46.007998  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 186) took 1048 ms. Trace:
I20260709 13:01:46.012064  1684 rpcz_store.cc:276] 0709 13:01:44.959191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.599064 (+639873us) service_pool.cc:224] Handling call
0709 13:01:46.006436 (+407372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.007759 (+  1323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.007942 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.014379  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:45.868688  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1452) took 2750 ms (client timeout 1687 ms). Trace:
W20260709 13:01:46.016446  1537 rpcz_store.cc:269] 0709 13:01:43.117905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.120204 (+  2299us) service_pool.cc:224] Handling call
0709 13:01:45.868478 (+2748274us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b540005e454. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:45.868601 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2277729664}
W20260709 13:01:46.018821  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1478) took 1502 ms (client timeout 1618 ms). Trace:
I20260709 13:01:45.586927  1504 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:45.983672  3631 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:46.021390  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 434543us
I20260709 13:01:46.024418  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:45.257206  2364 rpcz_store.cc:276] 0709 13:01:43.312002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.326619 (+ 14617us) service_pool.cc:224] Handling call
0709 13:01:43.427614 (+100995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:43.476968 (+ 49354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.480469 (+  3501us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:43.842742 (+362273us) log.cc:844] Serialized 26 byte log entry
0709 13:01:44.203606 (+360864us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:44.203665 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:44.211404 (+  7739us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:44.584743 (+373339us) raft_consensus.cc:1685] finished
0709 13:01:44.584789 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:44.585026 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70514,"raft.queue_time_us":2659,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":20469,"thread_start_us":295202,"threads_started":1,"wal-append.queue_time_us":340517}
W20260709 13:01:45.948184  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.019469  1688 rpcz_store.cc:269] 0709 13:01:44.517040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.517712 (+   672us) service_pool.cc:224] Handling call
0709 13:01:46.018567 (+1500855us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.044929  1616 raft_consensus.cc:1240] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:46.157610  1504 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:46.052677  1615 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:45.991740  3590 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:46.172940  1609 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 2.
I20260709 13:01:46.175626  1538 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:46.181965  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1587) took 2696 ms. Trace:
W20260709 13:01:46.079248  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.000s	sys 0.014s
I20260709 13:01:46.091195  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:46.184662  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.005s	sys 0.018s
I20260709 13:01:46.184921  1540 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:46.058724  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:45.997371  3659 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:45.968775  3632 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:46.051950  3471 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:45.936291  3541 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:45.996711  3634 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:46.237849  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:45.625125  3404 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:45.925733  3655 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.428s	user 0.000s	sys 0.000s
W20260709 13:01:46.165504  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.000s	sys 0.012s
I20260709 13:01:46.182542  1616 rpcz_store.cc:276] 0709 13:01:43.485604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.036241 (+2550637us) service_pool.cc:224] Handling call
0709 13:01:46.036702 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.181561 (+144859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.181876 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.573552  3598 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:45.594347  3434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.000s	sys 0.022s
I20260709 13:01:45.853509  3666 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:45.959944  3406 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:46.238125  1540 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:46.537645  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:46.503458  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 344056us
W20260709 13:01:46.467319  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.015s	sys 0.032s
W20260709 13:01:46.540877  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.019s	sys 0.032s
I20260709 13:01:46.551542  1615 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:46.552382  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1589) took 1313 ms. Trace:
I20260709 13:01:46.552745  1615 rpcz_store.cc:276] 0709 13:01:45.238606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.550718 (+1312112us) service_pool.cc:224] Handling call
0709 13:01:46.551113 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.552136 (+  1023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.552329 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.554741  1504 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:46.556219  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:46.565701  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.538650  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:46.577301  1533 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:46.577894  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1553) took 1011 ms. Trace:
I20260709 13:01:46.578300  1533 rpcz_store.cc:276] 0709 13:01:45.566356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.053654 (+487298us) service_pool.cc:224] Handling call
0709 13:01:46.577837 (+524183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.534546  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:46.581549  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:46.582278  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.583355  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:46.585549  1504 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:46.595151  1615 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:46.596359  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1591) took 1345 ms. Trace:
I20260709 13:01:46.596833  1615 rpcz_store.cc:276] 0709 13:01:45.250520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.553594 (+1303074us) service_pool.cc:224] Handling call
0709 13:01:46.594802 (+ 41208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.595958 (+  1156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.596291 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.238214  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:46.600046  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:46.436637  2363 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:46.602313  2363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 150) took 1334 ms. Trace:
I20260709 13:01:46.602730  2363 rpcz_store.cc:276] 0709 13:01:45.268102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.286809 (+ 18707us) service_pool.cc:224] Handling call
0709 13:01:46.602221 (+1315412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.604429  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:46.641309  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:46.009245  1611 rpcz_store.cc:276] 0709 13:01:43.484391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.003449 (+2519058us) service_pool.cc:224] Handling call
0709 13:01:46.003990 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.008541 (+  4551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.008811 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.642352  2363 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:46.643272  1611 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:46.606710  3434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.062s	user 0.004s	sys 0.048s
I20260709 13:01:46.504302  3448 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:46.050892  3544 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.645092  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1597) took 1288 ms. Trace:
I20260709 13:01:46.645601  1611 rpcz_store.cc:276] 0709 13:01:45.356799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.642586 (+1285787us) service_pool.cc:224] Handling call
0709 13:01:46.643018 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.643885 (+   867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.645011 (+  1126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.646884  3544 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:46.647634  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1598) took 1283 ms. Trace:
I20260709 13:01:46.658756  1611 rpcz_store.cc:276] 0709 13:01:45.364216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.646556 (+1282340us) service_pool.cc:224] Handling call
0709 13:01:46.646984 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.647226 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.647260 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.647319 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:46.647360 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.647427 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.647559 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.661190  1611 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:46.661990  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1599) took 1296 ms. Trace:
I20260709 13:01:46.662389  1611 rpcz_store.cc:276] 0709 13:01:45.366000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.660200 (+1294200us) service_pool.cc:224] Handling call
0709 13:01:46.660701 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.661648 (+   947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.661919 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:46.344290  3103 consensus_meta.cc:287] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.975s	user 0.004s	sys 0.009s
I20260709 13:01:46.668900  1686 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:46.675096  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 164) took 1304 ms. Trace:
I20260709 13:01:46.676822  1686 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:46.678292  2370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 156) took 1261 ms. Trace:
I20260709 13:01:46.678903  2370 rpcz_store.cc:276] 0709 13:01:45.416969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.051321 (+634352us) service_pool.cc:224] Handling call
0709 13:01:46.678229 (+626908us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:45.655758  3667 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:46.637045  1538 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:46.605459  3666 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:46.693077  3598 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.644407  3434 raft_consensus.cc:697] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:46.647989  3544 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.680742  1539 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:46.702787  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1559) took 1118 ms. Trace:
I20260709 13:01:46.703122  1539 rpcz_store.cc:276] 0709 13:01:45.584713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.236506 (+651793us) service_pool.cc:224] Handling call
0709 13:01:46.680544 (+444038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.702543 (+ 21999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.702736 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.157780  3596 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:45.625996  3654 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:45.961344  3658 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:01:46.160394  2366 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.946s	user 0.011s	sys 0.000s
I20260709 13:01:45.655716  2362 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:01:46.169305  3599 consensus_queue.cc:1059] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.513s
I20260709 13:01:46.160852  3657 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:46.022938  3475 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:46.684149  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.001s	sys 0.020s
I20260709 13:01:46.723590  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1293) took 3713 ms. Trace:
I20260709 13:01:46.158104  3547 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:46.675737  1611 rpcz_store.cc:276] 0709 13:01:45.370376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.673845 (+1303469us) service_pool.cc:224] Handling call
0709 13:01:46.674331 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.674607 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.674647 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.674707 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:46.674765 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.674837 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.675012 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.687212  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:46.687896  3414 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:46.688016  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:46.689203  1614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.012s
W20260709 13:01:46.737298  1614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.000s	sys 0.012s
I20260709 13:01:45.925369  3403 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:46.693269  3667 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:46.434943  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 437118us
I20260709 13:01:46.627404  1681 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:01:46.237006  3631 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.580605  2371 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
W20260709 13:01:46.533886  3668 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.664s	user 0.000s	sys 0.002s
I20260709 13:01:46.341893  3541 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.566454  3333 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:46.540280  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:46.714804  1533 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:46.787878  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1561) took 1202 ms. Trace:
I20260709 13:01:46.788252  1533 rpcz_store.cc:276] 0709 13:01:45.585365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.695010 (+1109645us) service_pool.cc:224] Handling call
0709 13:01:46.714489 (+ 19479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.787632 (+ 73143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.787826 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.696519  3525 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:46.732534  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.227s	user 0.053s	sys 0.065s
I20260709 13:01:46.732385  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:46.789233  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.053s	sys 0.065s
I20260709 13:01:46.789718  1690 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:46.736454  3414 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:46.735260  3607 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:46.706002  3663 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:46.798771  3663 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:46.799248  3663 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.740690  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 166) took 1366 ms. Trace:
I20260709 13:01:46.704833  3659 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.706209  3492 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.702101  3636 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:46.783334  2371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 152) took 1483 ms. Trace:
W20260709 13:01:46.782081  2369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 155) took 1374 ms (client timeout 1640 ms). Trace:
I20260709 13:01:46.711987  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:46.049697  3653 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:46.723950  1610 rpcz_store.cc:276] 0709 13:01:43.009872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.305625 (+295753us) service_pool.cc:224] Handling call
0709 13:01:43.306120 (+   495us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:43.306705 (+   585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:43.306744 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:43.307526 (+   782us) log.cc:844] Serialized 52 byte log entry
0709 13:01:43.487048 (+179522us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:44.217986 (+730938us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.570551 (+1352565us) log.cc:844] Serialized 14 byte log entry
0709 13:01:46.723277 (+1152726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.723353 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:46.723392 (+    39us) raft_consensus.cc:1685] finished
0709 13:01:46.723405 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.723533 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1397496,"prepare.queue_time_us":1623387,"prepare.run_cpu_time_us":139,"prepare.run_wall_time_us":3430,"raft.queue_time_us":987249,"raft.run_cpu_time_us":394,"raft.run_wall_time_us":5148,"thread_start_us":2051035,"threads_started":5,"wal-append.queue_time_us":592570,"wal-append.run_cpu_time_us":3358,"wal-append.run_wall_time_us":1376911}
I20260709 13:01:46.784258  3403 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:46.791226  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:46.811836  3492 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.793650  3541 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:46.820505  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:46.822006  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 170) took 1277 ms. Trace:
I20260709 13:01:46.822494  1610 rpcz_store.cc:276] 0709 13:01:45.545004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.817691 (+1272687us) service_pool.cc:224] Handling call
0709 13:01:46.821357 (+  3666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.821583 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.821622 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.821679 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:46.821733 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.821802 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.821937 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.798219  1536 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 4. Ops: []
I20260709 13:01:46.800477  1611 rpcz_store.cc:276] 0709 13:01:45.374300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.730895 (+1356595us) service_pool.cc:224] Handling call
0709 13:01:46.740206 (+  9311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.740377 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.740401 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.740441 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:46.740479 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.740527 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:46.740621 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.802965  3486 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:46.725797  3409 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:46.810248  2371 rpcz_store.cc:276] 0709 13:01:45.299593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.398977 (+ 99384us) service_pool.cc:224] Handling call
0709 13:01:46.534106 (+1135129us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:01:46.783233 (+249127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117090176}
I20260709 13:01:46.049479  3661 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:46.811313  2369 rpcz_store.cc:269] 0709 13:01:45.407745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.559575 (+151830us) service_pool.cc:224] Handling call
0709 13:01:46.687794 (+1128219us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:01:46.781941 (+ 94147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4366208}
I20260709 13:01:46.716467  2366 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:46.712899  3544 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.731637  3682 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:46.826102  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:46.855271  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:46.828080  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 161) took 3666 ms. Trace:
I20260709 13:01:46.836474  3657 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:46.790855  3681 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.786608  2362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46612 (request call id 151) took 1515 ms. Trace:
I20260709 13:01:46.809719  3333 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:46.817108  2365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 154) took 1442 ms (client timeout 1733 ms). Trace:
I20260709 13:01:46.803722  3631 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:46.817303  3636 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.801383  3525 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.860920  1608 rpcz_store.cc:276] 0709 13:01:43.161176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.451674 (+290498us) service_pool.cc:224] Handling call
0709 13:01:43.452010 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.210640 (+758630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.827812 (+2617172us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400344c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:46.827999 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664496896}
I20260709 13:01:46.863566  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:46.809870  3414 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.717547  3658 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:46.838296  3409 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.826676  3666 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:46.742719  3475 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.839526  3543 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:46.809913  3659 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:46.836474  3541 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:46.813011  3434 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:46.865780  1690 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
W20260709 13:01:47.238873  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 653405us
W20260709 13:01:46.973452  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.240054  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1486) took 1260 ms. Trace:
W20260709 13:01:47.240635  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.240945  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1305) took 1229 ms. Trace:
W20260709 13:01:47.146893  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.012s
I20260709 13:01:47.241720  1504 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:47.242159  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.014s	sys 0.012s
W20260709 13:01:47.241333  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.244616  1505 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.571s (SENT)
I20260709 13:01:47.245205  1505 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:47.146167  1687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.467s	user 0.021s	sys 0.017s
W20260709 13:01:47.245929  1687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.567s	user 0.022s	sys 0.018s
W20260709 13:01:47.246757  1505 leader_election.cc:336] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.036s (SENT)
W20260709 13:01:47.248098  1505 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.064s (SENT)
I20260709 13:01:47.248575  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:47.240517  1682 rpcz_store.cc:276] 0709 13:01:45.979254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.863023 (+883769us) service_pool.cc:224] Handling call
0709 13:01:47.239956 (+376933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.252656  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:47.246806  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 185) took 2293 ms. Trace:
I20260709 13:01:47.253379  1682 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:47.253964  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1306) took 1226 ms. Trace:
I20260709 13:01:47.254552  1682 rpcz_store.cc:276] 0709 13:01:46.027661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.252316 (+1224655us) service_pool.cc:224] Handling call
0709 13:01:47.253909 (+  1593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.241339  1690 rpcz_store.cc:276] 0709 13:01:46.013039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.854835 (+841796us) service_pool.cc:224] Handling call
0709 13:01:47.240882 (+386047us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.256006  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:47.258256  1682 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:47.251493  3606 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:47.092198  3403 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.339578  3403 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:47.340408  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:47.341256  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1308) took 1197 ms. Trace:
I20260709 13:01:47.341621  1690 rpcz_store.cc:276] 0709 13:01:46.144448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.256004 (+1111556us) service_pool.cc:224] Handling call
0709 13:01:47.341195 (+ 85191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.342664  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:47.343405  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1309) took 1135 ms. Trace:
I20260709 13:01:47.349217  1690 rpcz_store.cc:276] 0709 13:01:46.208321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.342357 (+1134036us) service_pool.cc:224] Handling call
0709 13:01:47.343346 (+   989us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:46.922034  3677 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:01:46.870096  2362 rpcz_store.cc:276] 0709 13:01:45.268508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.368705 (+100197us) service_pool.cc:224] Handling call
0709 13:01:45.507046 (+138341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.719464 (+1212418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:46.783404 (+ 63940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.259645  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1303) took 1248 ms. Trace:
I20260709 13:01:46.857184  3233 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.412305  1682 rpcz_store.cc:276] 0709 13:01:46.010990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.255575 (+1244585us) service_pool.cc:224] Handling call
0709 13:01:47.259560 (+  3985us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.851432  3673 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:47.351482  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 103442us
I20260709 13:01:46.856426  3468 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:47.259987  3666 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:47.415019  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 187) took 2455 ms. Trace:
I20260709 13:01:47.253539  1687 rpcz_store.cc:276] 0709 13:01:44.953360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.560985 (+607625us) service_pool.cc:224] Handling call
0709 13:01:45.655868 (+ 94883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.656125 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:45.678746 (+ 22621us) log.cc:844] Serialized 14 byte log entry
0709 13:01:47.246435 (+1567689us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.246490 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:47.246547 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.246622 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.246748 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":28239,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":73,"raft.queue_time_us":105,"thread_start_us":1567299,"threads_started":1}
I20260709 13:01:46.867444  3471 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:47.093021  3459 consensus_meta.cc:287] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.806s	user 0.014s	sys 0.001s
I20260709 13:01:47.237150  3598 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.261463  3636 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.411689  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:47.261294  3543 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.426702  1682 rpcz_store.cc:276] 0709 13:01:44.959505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.413906 (+2454401us) service_pool.cc:224] Handling call
0709 13:01:47.414334 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.414572 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.414612 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.414670 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:47.414718 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.414794 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.414945 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:46.991724  3661 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:46.985337  3670 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:46.890723  3600 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.413872  3414 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:46.923521  3676 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:46.992611  3544 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.249912  3404 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:46.865167  2366 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46602 (request call id 205) took 3488 ms (client timeout 1618 ms). Trace:
I20260709 13:01:47.259096  3682 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:47.345769  3541 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:47.260223  3333 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.411794  3681 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:47.428349  3596 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.010s	sys 0.019s
I20260709 13:01:47.433854  3557 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:47.439896  3437 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.011s	sys 0.029s
I20260709 13:01:47.440745  3667 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.432448  3666 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:47.457428  3647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.278s	user 0.018s	sys 0.020s
W20260709 13:01:47.451824  3663 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.650s	user 0.012s	sys 0.000s
I20260709 13:01:47.442953  3670 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.443356  3543 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:47.459215  3596 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.010s	sys 0.020s
I20260709 13:01:47.454897  3653 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:47.463932  3636 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.449244  3676 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:47.473945  3666 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.477418  3676 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.467974  3663 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.479275  3663 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:47.336508  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 94857us
I20260709 13:01:47.512647  1504 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:47.514873  1505 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.813s (SENT)
I20260709 13:01:47.515734  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:47.438558  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.022s	sys 0.017s
W20260709 13:01:47.438939  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.437796  1684 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:47.519001  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.334s	user 0.008s	sys 0.034s
W20260709 13:01:47.525871  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.341s	user 0.009s	sys 0.034s
I20260709 13:01:47.522274  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1302) took 1541 ms. Trace:
W20260709 13:01:47.251374  2365 rpcz_store.cc:269] 0709 13:01:45.374486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.158844 (+784358us) service_pool.cc:224] Handling call
0709 13:01:46.817027 (+658183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.526441  1684 rpcz_store.cc:276] 0709 13:01:46.010556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.437227 (+1426671us) service_pool.cc:224] Handling call
0709 13:01:47.437585 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.521382 (+ 83797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.521920 (+   538us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.435935  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1304) took 1424 ms. Trace:
W20260709 13:01:47.449041  2366 rpcz_store.cc:269] 0709 13:01:43.364461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.377469 (+ 13008us) service_pool.cc:224] Handling call
0709 13:01:44.447416 (+1069947us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:01:46.852996 (+2405580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30450560}
I20260709 13:01:47.528206  1690 rpcz_store.cc:276] 0709 13:01:46.011327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:47.350330 (+1339003us) service_pool.cc:224] Handling call
0709 13:01:47.435864 (+ 85534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:47.532763  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.534973  3333 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.535995  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.535719  3333 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:47.521648  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.023s	sys 0.017s
I20260709 13:01:47.544674  3333 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.545642  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1586) took 4060 ms. Trace:
W20260709 13:01:47.432468  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.003s	sys 0.036s
I20260709 13:01:47.539974  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.541689  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.538770  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:47.462592  3437 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.011s	sys 0.029s
I20260709 13:01:47.525548  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:01:47.434903  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.011s	sys 0.029s
W20260709 13:01:47.525699  1505 leader_election.cc:336] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.046s (SENT)
I20260709 13:01:47.568329  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:47.568571  3541 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:47.564245  3681 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:47.569538  3541 raft_consensus.cc:697] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:01:47.569977  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44413.2us
I20260709 13:01:47.570189  3681 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:47.568667  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:47.571259  3541 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:47.573017  1611 raft_consensus.cc:2368] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4.
W20260709 13:01:47.469238  3647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.600s	user 0.019s	sys 0.020s
I20260709 13:01:47.574954  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:47.575919  1611 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.475459  3659 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.460969  3557 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:47.578190  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.004s	sys 0.036s
I20260709 13:01:47.552207  3636 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:47.579061  3636 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:47.579617  3636 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:47.581089  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57944 (request call id 168) took 2152 ms (client timeout 2213 ms). Trace:
I20260709 13:01:47.581537  3333 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:47.581678  1609 rpcz_store.cc:269] 0709 13:01:45.428594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.555927 (+127333us) service_pool.cc:224] Handling call
0709 13:01:47.580504 (+2024577us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54002265d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:47.580778 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396106496}
I20260709 13:01:47.546674  1614 rpcz_store.cc:276] 0709 13:01:43.485311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.034207 (+2548896us) service_pool.cc:224] Handling call
0709 13:01:46.034940 (+   733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:46.737881 (+702941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.737931 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:46.742260 (+  4329us) log.cc:844] Serialized 26 byte log entry
0709 13:01:47.544830 (+802570us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:47.544930 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.545137 (+   207us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:47.545209 (+    72us) raft_consensus.cc:1685] finished
0709 13:01:47.545225 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.545492 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":612285,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":1449219,"threads_started":2,"wal-append.queue_time_us":681274}
I20260709 13:01:47.554432  3543 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.560024  3670 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:47.579757  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 1.0062e+06us
I20260709 13:01:47.554937  3475 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.563959  1608 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:47.470234  3596 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:47.565286  1610 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:47.586302  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:47.586300  1505 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.115s (SENT)
I20260709 13:01:47.589262  3596 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.590057  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1594) took 2292 ms. Trace:
I20260709 13:01:47.594197  1615 rpcz_store.cc:276] 0709 13:01:45.297266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.597814 (+1300548us) service_pool.cc:224] Handling call
0709 13:01:47.586595 (+988781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.587649 (+  1054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.587692 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.587795 (+   103us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:47.587840 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.587957 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.589588 (+  1631us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b54002265d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:47.589777 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273102208}
I20260709 13:01:47.585986  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1313) took 4525 ms. Trace:
I20260709 13:01:47.597615  1612 rpcz_store.cc:276] 0709 13:01:43.059943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.307860 (+247917us) service_pool.cc:224] Handling call
0709 13:01:45.165483 (+1857623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.220253 (+ 54770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.585369 (+2365116us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54003a2ad0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:47.585735 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4268658432}
I20260709 13:01:47.598832  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 165) took 2228 ms. Trace:
W20260709 13:01:47.591241  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.012s	sys 0.029s
W20260709 13:01:47.601634  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35722 (request call id 192) took 2640 ms (client timeout 1727 ms). Trace:
I20260709 13:01:47.604171  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 180) took 2733 ms. Trace:
W20260709 13:01:47.589941  1505 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.306s (SENT)
I20260709 13:01:47.567245  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:01:47.592796  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1584) took 4109 ms. Trace:
I20260709 13:01:47.593492  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:47.596010  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:47.596550  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1554) took 2013 ms (client timeout 1554 ms). Trace:
I20260709 13:01:47.596655  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:47.583810  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.599294  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.561184  3658 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:47.599251  1616 rpcz_store.cc:276] 0709 13:01:45.370703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.683652 (+1312949us) service_pool.cc:224] Handling call
0709 13:01:46.683939 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.421580 (+737641us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.421622 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.421684 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:47.421730 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.598344 (+176614us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54003a2fd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:47.598411 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.598663 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696030976}
W20260709 13:01:47.602169  1683 rpcz_store.cc:269] 0709 13:01:44.961092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.287937 (+326845us) service_pool.cc:224] Handling call
0709 13:01:47.601024 (+2313087us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b540006ed54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:47.601310 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871523200}
I20260709 13:01:47.610844  1608 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:47.623106  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:47.623633  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1291) took 2847 ms (client timeout 1550 ms). Trace:
W20260709 13:01:47.624131  1686 rpcz_store.cc:269] 0709 13:01:44.775937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.158847 (+382910us) service_pool.cc:224] Handling call
0709 13:01:47.623235 (+2464388us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400411754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:47.623462 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3379319552}
I20260709 13:01:47.597460  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1580) took 4115 ms. Trace:
I20260709 13:01:47.609907  1614 raft_consensus.cc:2376] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2. Re-sending same reply.
I20260709 13:01:47.612062  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.609069  1613 rpcz_store.cc:276] 0709 13:01:43.483490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.982497 (+2499007us) service_pool.cc:224] Handling call
0709 13:01:45.982865 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.217033 (+234168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.217084 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.217160 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:46.217212 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.592077 (+1374865us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001b62d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:47.592172 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.592531 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536775936}
I20260709 13:01:47.607236  3475 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:47.630926  3475 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:47.631577  3475 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:47.613322  1612 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:47.645275  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.646735  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.647328  1612 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:47.630105  2363 raft_consensus.cc:1240] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:47.609543  2366 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:47.604935  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:47.632681  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.612275  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:47.634871  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.625954  1607 rpcz_store.cc:276] 0709 13:01:43.482171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:43.486085 (+  3914us) service_pool.cc:224] Handling call
0709 13:01:43.486515 (+   430us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:44.243492 (+756977us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:44.268184 (+ 24692us) log.cc:844] Serialized 14 byte log entry
0709 13:01:45.201377 (+933193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.201430 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:45.201474 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.596946 (+2395472us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b5400420754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:47.597024 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.597258 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":839188,"prepare.queue_time_us":27803,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":845709,"spinlock_wait_cycles":1747677440,"thread_start_us":99504,"threads_started":1,"wal-append.queue_time_us":184928,"wal-append.run_cpu_time_us":5014,"wal-append.run_wall_time_us":1825617}
I20260709 13:01:47.604686  1685 rpcz_store.cc:276] 0709 13:01:44.870608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.543265 (+672657us) service_pool.cc:224] Handling call
0709 13:01:45.543539 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.657956 (+114417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.657998 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.658050 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:45.658100 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.603514 (+1945414us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54002d6254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:47.603604 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.603897 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262603008}
I20260709 13:01:47.655712  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:47.610144  1538 rpcz_store.cc:269] 0709 13:01:45.582604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.632058 (+ 49454us) service_pool.cc:224] Handling call
0709 13:01:47.595946 (+1963888us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54000cbcd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:47.596215 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382950656}
I20260709 13:01:47.666167  3658 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:47.681819  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:47.682312  3494 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:47.690778  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.679982  3658 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.692018  1615 raft_consensus.cc:2410] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:47.694428  3658 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.692790  1612 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:47.740206  3636 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:47.872251  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.873513  1612 raft_consensus.cc:2410] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:01:47.693900  3670 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:47.873714  3636 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:47.861496  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:47.751343  3563 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.998s	user 0.011s	sys 0.037s
I20260709 13:01:47.891362  2366 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:47.726478  3540 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:47.722944  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.878583  3475 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:47.902242  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1477) took 3403 ms (client timeout 2245 ms). Trace:
W20260709 13:01:47.902689  1681 rpcz_store.cc:269] 0709 13:01:44.498984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:44.499640 (+   656us) service_pool.cc:224] Handling call
0709 13:01:47.901831 (+3402191us) spinlock_profiling.cc:243] Waited 952 ms on lock 0x7b54002d5d54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:47.902055 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2188813568}
W20260709 13:01:47.904414  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 314580us
I20260709 13:01:47.712803  2368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 338) took 2261 ms. Trace:
I20260709 13:01:47.823472  1611 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:47.693179  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:47.836397  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 154819us
I20260709 13:01:47.694947  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:47.842535  3541 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:47.725425  3537 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:47.884464  3619 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:47.913617  2328 connection.cc:256] RPC call timeout handler was delayed by -2.1974060230000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
I20260709 13:01:47.881354  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:47.829706  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 145414us
W20260709 13:01:47.914120  2328 connection.cc:256] RPC call timeout handler was delayed by -1.8950570169999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 13:01:47.694320  1608 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
W20260709 13:01:47.893824  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.914966  2328 connection.cc:256] RPC call timeout handler was delayed by -1.7106229359999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 13:01:47.894143  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:47.693583  3473 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.896776  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:47.897656  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:47.898994  1653 connection.cc:256] RPC call timeout handler was delayed by -1.5228294230000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1623s for a response
W20260709 13:01:47.899341  1579 connection.cc:256] RPC call timeout handler was delayed by -2.2595890689999578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260709 13:01:47.899477  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:47.901222  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:47.683545  3494 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:47.903808  3475 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:47.912431  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:47.922190  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.922726  3540 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:01:47.923647  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:47.835299  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 236917us
W20260709 13:01:47.915378  2328 connection.cc:256] RPC call timeout handler was delayed by -1.6556684500000074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
I20260709 13:01:47.895437  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:47.927472  1653 connection.cc:256] RPC call timeout handler was delayed by -1.078229422999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 13:01:47.915066  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.915606  3543 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.920688  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.921286  2371 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:47.913408  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:47.924118  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:47.923719  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:47.925367  3492 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:47.925932  3619 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:47.926362  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.926517  1615 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
W20260709 13:01:47.927891  2328 connection.cc:256] RPC call timeout handler was delayed by -1.422065181999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260709 13:01:48.001334  1608 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
W20260709 13:01:48.001766  2328 connection.cc:256] RPC call timeout handler was delayed by -1.1095116970000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 13:01:47.967906  3473 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.968246  3620 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:01:47.984879  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.002938  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.790720  3624 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:47.962793  1612 raft_consensus.cc:2410] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:47.923740  3477 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:47.917560  3670 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:47.932988  1505 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.507s (SENT)
I20260709 13:01:47.933319  1607 raft_consensus.cc:2410] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:47.835518  3605 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:47.906555  2368 rpcz_store.cc:276] 0709 13:01:45.378366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.441222 (+1062856us) service_pool.cc:224] Handling call
0709 13:01:47.638262 (+1197040us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3e9c 00007fd02b9e3a5b 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:01:47.638696 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.639300 (+   604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:47.639344 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:47.639454 (+   110us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:47.639530 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:47.639631 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:47.639812 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10801408}
I20260709 13:01:47.926381  3494 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:47.927251  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:47.968794  1616 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:48.003159  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 72915.1us
W20260709 13:01:48.005201  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 84191.8us
I20260709 13:01:48.009635  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:48.008154  1608 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:48.011898  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:47.999446  3543 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:48.006515  3599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.162s	user 0.003s	sys 0.003s
I20260709 13:01:48.016325  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:48.008155  3503 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.361s	user 0.019s	sys 0.032s
I20260709 13:01:48.016355  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.019569  1616 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:48.024621  1616 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:48.017952  3599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.004s	sys 0.004s
I20260709 13:01:48.019537  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.027451  1611 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:48.027364  3619 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.027925  3654 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.028736  3494 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.029067  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.029821  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:48.030479  1610 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:48.030597  3652 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:48.022074  3503 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.500s	user 0.019s	sys 0.032s
W20260709 13:01:48.031978  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 108526us
I20260709 13:01:48.047061  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.035252  1615 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:48.034292  3477 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.045693  3475 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.037117  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.037495  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.046904  1685 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:48.053131  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:48.033392  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:48.062580  1579 connection.cc:256] RPC call timeout handler was delayed by -1.0010187960000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 13:01:48.061723  3605 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:48.077350  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:48.077987  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 178) took 3208 ms. Trace:
I20260709 13:01:48.078542  1689 rpcz_store.cc:276] 0709 13:01:44.869908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.541272 (+671364us) service_pool.cc:224] Handling call
0709 13:01:45.541690 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.239619 (+697929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.239667 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.239728 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:46.239784 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.075033 (+1835249us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b54002d6c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:48.077472 (+  2439us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.077748 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604549376}
I20260709 13:01:48.079600  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:48.065524  3624 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:48.082856  1611 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:48.084915  1615 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:48.076156  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.087613  3659 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:48.082571  1608 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:48.090375  1612 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:48.058080  3477 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.067749  3599 consensus_queue.cc:1243] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:48.093971  3659 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:48.093449  1607 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:48.102119  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:48.101557  3605 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:48.105782  1688 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:48.097676  3540 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:48.112700  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:48.124368  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 48007.6us
I20260709 13:01:48.125303  1610 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:01:48.131767  1504 connection.cc:256] RPC call timeout handler was delayed by -1.0243992779999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
I20260709 13:01:48.095454  3624 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.135898  3605 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.116025  3540 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:48.145792  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 66307us
I20260709 13:01:48.132390  1607 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:48.140233  3477 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:48.132241  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 214484us
W20260709 13:01:48.142378  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 77652.1us
I20260709 13:01:48.142234  3532 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:01:48.154204  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 79614.1us
I20260709 13:01:48.157214  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.100682  3670 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.160339  1689 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:01:48.160434  3532 raft_consensus.cc:697] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:48.161101  3473 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.147401  3540 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.143931  3599 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:48.173812  3624 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.175235  3659 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.177281  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1558) took 2593 ms. Trace:
I20260709 13:01:48.177750  1536 rpcz_store.cc:276] 0709 13:01:45.583946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.237013 (+653067us) service_pool.cc:224] Handling call
0709 13:01:46.237401 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.826122 (+588721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.176587 (+1350465us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54001df6d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:48.177024 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280656640}
I20260709 13:01:48.185299  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.188642  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.189224  1532 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:48.189494  1614 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:48.190788  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:48.194065  3599 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.194944  3409 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.196933  3599 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.197353  3093 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:48.197803  1505 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.590s (SENT)
I20260709 13:01:48.198606  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:48.199381  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.178399  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:48.204543  1609 raft_consensus.cc:2368] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:48.205041  2328 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:48.205602  2364 raft_consensus.cc:2376] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4. Re-sending same reply.
I20260709 13:01:48.207542  3620 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.209153  3619 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:48.187584  3673 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:01:48.211531  3532 consensus_queue.cc:237] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.218745  1616 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:01:48.221280  1616 pending_rounds.cc:85] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 2
I20260709 13:01:48.221643  1616 pending_rounds.cc:107] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:01:48.222038  1616 raft_consensus.cc:2889] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:48.223129  3241 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.224942  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.218557  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:48.227969  1505 leader_election.cc:336] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.632s (SENT)
I20260709 13:01:48.233680  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:48.235180  1611 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:48.248889  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:48.258704  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.259182  3525 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.272534  1682 raft_consensus.cc:3055] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:48.273152  1682 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:48.273627  3557 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:48.274622  3557 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:48.274462  1682 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:48.275693  1682 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:48.282203  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 74189.3us
W20260709 13:01:48.286720  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.294040  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.254968  3599 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:48.336027  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.337636  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.338593  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1540) took 2783 ms. Trace:
I20260709 13:01:48.340427  1436 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.341325  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.341389  3543 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.264021  3241 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:48.342298  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.343098  3604 consensus_queue.cc:1059] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:48.345202  3547 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:48.349336  2363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 342) took 1769 ms. Trace:
I20260709 13:01:48.350070  1537 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:48.350754  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1543) took 2794 ms. Trace:
W20260709 13:01:48.356053  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.356370  1505 leader_election.cc:336] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.111s (SENT)
W20260709 13:01:48.356889  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 82689.8us
I20260709 13:01:48.354995  3093 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:01:48.359179  1535 rpcz_store.cc:276] 0709 13:01:45.555132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.556588 (+  1456us) service_pool.cc:224] Handling call
0709 13:01:45.556905 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:46.837298 (+1280393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:46.837337 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:46.837388 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:46.837426 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.338103 (+1500677us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001dfbd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:48.338190 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.338376 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2944351488}
I20260709 13:01:48.369912  1537 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:48.370677  1534 rpcz_store.cc:276] 0709 13:01:45.557573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:45.557739 (+   166us) service_pool.cc:224] Handling call
0709 13:01:45.983426 (+425687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:45.983644 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:45.983673 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:45.983721 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:45.983759 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:45.983818 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:48.277170 (+2293352us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b5400066b50. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:48.350531 (+ 73361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978139392}
I20260709 13:01:48.382246  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.385581  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:48.357605  3703 consensus_queue.cc:1059] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:01:48.357813  3540 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:48.389155  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.390547  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:48.391383  1505 leader_election.cc:336] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.119s (SENT)
I20260709 13:01:48.391615  3599 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.391924  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:48.369585  2363 rpcz_store.cc:276] 0709 13:01:46.579716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.643300 (+ 63584us) service_pool.cc:224] Handling call
0709 13:01:46.643681 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:47.677850 (+1034169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.285643 (+607793us) spinlock_profiling.cc:243] Waited 927 ms on lock 0x7b5400580f54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:48.349228 (+ 63585us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2131934592}
I20260709 13:01:48.393761  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.367238  3532 consensus_queue.cc:1059] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:01:48.370290  3620 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.395584  1537 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:48.404637  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.405177  3599 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.405989  1436 catalog_manager.cc:5697] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 1 to 3, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:01:48.408262  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.394481  3703 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:48.394598  1683 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
W20260709 13:01:48.412412  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.411700  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:48.411725  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.412081  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.421722  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:48.423450  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.414178  3703 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:48.426121  3241 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.426234  3703 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.427219  3541 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.427193  3241 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.428097  3541 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.428874  1534 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:01:48.430217  3241 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.430490  1690 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:48.430781  3541 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.431797  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:48.432988  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:48.433934  1535 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:48.438316  3640 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:48.438585  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:48.411785  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.436723  1688 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 1.
W20260709 13:01:48.410465  3712 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.153s	user 0.004s	sys 0.001s
I20260709 13:01:48.439289  3540 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.442498  1436 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 2 to 5, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:48.455250  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.446477  3503 raft_consensus.cc:3055] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:48.460753  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:48.466991  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.463960  3093 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:48.467545  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.467795  3093 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:48.469095  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:48.469677  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:48.459401  3477 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:01:48.470432  1538 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:48.471784  1534 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:48.472102  1532 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:48.476253  1537 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.450711  3640 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:48.458484  3703 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.494447  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.495354  1685 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:48.464442  3503 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:48.499380  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:48.528604  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.529811  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:48.533463  1541 raft_consensus.cc:2393] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:48.537820  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.539271  1534 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
W20260709 13:01:48.542867  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 46388.8us
I20260709 13:01:48.485278  3599 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.544409  1538 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:01:48.546365  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47922.8us
I20260709 13:01:48.549779  1532 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:48.554257  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:48.537232  3532 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:48.557055  3599 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.557402  3503 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.559001  3503 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.560254  1536 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.560438  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.561194  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.562026  1681 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:48.562240  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.563117  1687 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:48.563391  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.563941  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.564393  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:48.565092  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.565313  1538 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:48.565768  1687 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:48.566627  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.567353  1687 raft_consensus.cc:2393] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:48.568295  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:48.569514  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.570420  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.570708  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:48.571354  1686 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.572544  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:48.572778  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:48.573536  3603 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:48.573956  3603 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.574328  3603 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:48.573956  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:48.575623  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.584986  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.586310  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.583186  3494 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:48.592151  1687 raft_consensus.cc:2376] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4. Re-sending same reply.
I20260709 13:01:48.600816  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.599010  3494 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:48.604732  2369 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:48.605921  3494 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:48.609050  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.581684  3599 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.581307  3093 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:48.611297  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:48.606369  3532 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:48.615067  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:48.612877  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.616101  1683 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:48.613191  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.617264  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.624115  3548 raft_consensus.cc:3055] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:48.624620  3548 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:48.625756  3548 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.627460  3548 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.629290  3540 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:48.630314  3540 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:48.630642  3540 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:48.631979  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:48.632792  1532 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:48.632990  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.634379  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.635460  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.631510  3540 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:48.636807  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.636768  1684 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:48.639302  1681 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:48.646256  1537 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:48.646814  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:48.648106  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.653855  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:48.654626  1683 raft_consensus.cc:2376] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6. Re-sending same reply.
I20260709 13:01:48.659456  3540 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:48.661716  3715 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:01:48.662916  3716 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:01:48.635957  3532 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:48.682893  3486 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:01:48.683282  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:48.701047  3434 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.727452  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:48.757205  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 80678.7us
W20260709 13:01:48.777421  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 192916us
I20260709 13:01:48.784533  1536 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:01:48.785749  1682 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:48.787931  1686 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:48.789809  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1551) took 3224 ms. Trace:
I20260709 13:01:48.790465  1537 rpcz_store.cc:276] 0709 13:01:45.565780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:46.236723 (+670943us) service_pool.cc:224] Handling call
0709 13:01:46.237137 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:48.280435 (+2043298us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b540012d020. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7fdc0 00007fd02eb0a1c0 00007fd02eb0b231 00007fd02eb07d8f 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c
0709 13:01:48.649370 (+368935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:48.789740 (+140370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4281046784}
I20260709 13:01:48.796506  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:48.798184  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 151479us
I20260709 13:01:48.804656  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:48.807045  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.808621  1688 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:48.806219  3532 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:48.833256  1688 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:48.841581  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.823112  3532 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:48.842432  3532 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.842753  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:48.828356  3503 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:01:48.846541  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.813503  3620 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:01:48.850121  1615 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:48.850651  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:48.854432  3486 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:01:48.856420  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:48.858296  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:48.850224  3599 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:48.865077  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:48.868854  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:48.850952  3494 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.866496  3492 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:48.879729  3537 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:48.882994  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.870158  3547 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:48.884084  3494 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:48.899484  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.900338  1614 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:48.900830  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:48.901405  1612 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.885380  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.887780  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.888123  3448 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:48.888594  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.903821  1611 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:48.867247  3599 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:48.889762  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:48.892674  1613 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:48.896577  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.897406  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:48.908106  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:48.908918  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47272.2us
I20260709 13:01:48.907048  3448 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:48.904271  3537 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.892419  3492 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.916554  1537 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:48.907060  1609 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:48.912343  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:48.918929  1610 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:48.920557  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.925283  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 98199.2us
W20260709 13:01:48.929301  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 60474.2us
I20260709 13:01:48.912767  3599 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.934639  1611 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:48.922547  3492 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.898167  3603 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:48.934283  1505 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:48.939255  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:48.940775  1615 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:48.930758  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:48.963438  2363 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:48.941193  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 184) took 10614 ms. Trace:
I20260709 13:01:48.933161  3477 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:48.941761  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:48.942119  3448 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:48.933195  1616 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:48.949550  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:48.950621  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:48.974884  3603 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:48.974725  3599 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:48.975760  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51933.2us
I20260709 13:01:48.977082  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:48.978124  3486 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:48.978629  3486 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:48.978997  3486 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:48.954651  1612 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:01:48.960592  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.983229  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:48.962363  1504 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:38063 timed out after 1.640s (SENT) [suppressed 39 similar messages]
W20260709 13:01:48.986299  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 49747.8us
I20260709 13:01:48.968777  2364 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:48.996292  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:48.981062  3599 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:48.968327  3477 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:48.991200  3547 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:01:49.005887  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.003895  3477 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.969218  3532 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.010164  3532 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:49.010201  3599 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:49.012588  3599 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.013049  3599 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:48.992694  3640 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:01:49.016476  2363 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:49.026933  1685 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:49.029066  3547 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:49.069247  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:48.967983  1437 rpcz_store.cc:276] 0709 13:01:38.306936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.326546 (+ 19610us) service_pool.cc:224] Handling call
0709 13:01:38.587140 (+260594us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea72090 00007fd02eb10f3a 00007fd0348c71cc 00007fd0349c537e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc 00007fd032e85392 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:48.921554 (+10334414us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:42.479052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:42.554887 (+ 75835us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:42.554929 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:01:42.554949 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:42.812366 (+257417us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:42.826752 (+ 14386us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:42.828407 (+  1655us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:01:42.977068 (+148661us) tablet.cc:701] Row locks acquired
0709 13:01:42.977093 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:01:42.977279 (+   186us) write_op.cc:270] Start()
0709 13:01:42.977418 (+   139us) write_op.cc:276] Timestamp: P: 1783602102977227 usec, L: 0
0709 13:01:42.977444 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:01:42.979176 (+  1732us) log.cc:844] Serialized 7132 byte log entry
0709 13:01:44.453018 (+1473842us) op_driver.cc:464] REPLICATION: finished
0709 13:01:45.252403 (+799385us) write_op.cc:301] APPLY: starting
0709 13:01:45.287198 (+ 34795us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:45.444963 (+157765us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:45.493529 (+ 48566us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:45.867636 (+374107us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:45.867969 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:01:45.868016 (+    47us) write_op.cc:312] APPLY: finished
0709 13:01:45.868457 (+   441us) log.cc:844] Serialized 124 byte log entry
0709 13:01:47.575084 (+1706627us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:47.575562 (+   478us) write_op.cc:454] Released schema lock
0709 13:01:47.575751 (+   189us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:47.576724 (+   973us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:47.576763 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":281823,"reported_tablets":37,"spinlock_wait_cycles":78430592,"child_traces":[["op",{"apply.queue_time_us":733982,"apply.run_cpu_time_us":47119,"apply.run_wall_time_us":2337556,"num_ops":18,"prepare.queue_time_us":197327,"prepare.run_cpu_time_us":22710,"prepare.run_wall_time_us":709200,"raft.queue_time_us":144586,"raft.run_cpu_time_us":15583,"raft.run_wall_time_us":380547,"replication_time_us":1452343,"spinlock_wait_cycles":33664,"thread_start_us":2339658,"threads_started":5,"wal-append.queue_time_us":1767676,"wal-append.run_cpu_time_us":34449,"wal-append.run_wall_time_us":3218078}]]}
W20260709 13:01:49.100934  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 110794us
I20260709 13:01:49.072844  3547 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.116098  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.097896  3726 raft_consensus.cc:2764] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:49.091740  3492 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.105957  3548 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:49.129937  3492 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:49.130756  3599 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.106108  3603 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:01:49.098133  3703 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:01:49.134153  3659 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:49.134605  3659 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.134939  3659 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.135285  3599 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.136283  3486 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.139509  3486 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.115600  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:49.141583  2368 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:49.120455  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:49.142845  2364 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:49.143831  3434 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:49.150511  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:49.152670  1579 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.153961  3486 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:49.153373  2367 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:49.162281  1579 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.164310  3605 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:49.164795  3670 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:49.165295  3670 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.163760  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.165704  3670 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.164857  3477 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.166790  3540 raft_consensus.cc:2764] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:01:49.164808  3605 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.171053  3605 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:49.176192  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 52764.4us
I20260709 13:01:49.181386  3477 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:49.151304  3547 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.179553  3599 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:49.188907  3599 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:49.189393  3599 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.190059  3547 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.205972  3547 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:49.208596  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.219834  3547 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:49.220175  1505 leader_election.cc:400] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:49.220600  1505 leader_election.cc:403] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:49.220701  3547 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.221172  3537 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:49.221258  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 48637.7us
I20260709 13:01:49.222265  1505 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:49.223114  3730 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.223670  3486 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:49.224151  3486 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:49.224548  3486 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.226516  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:49.227465  2369 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:49.206516  1614 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:49.229212  1682 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:49.203568  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.231804  3651 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:49.232842  3730 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:49.231949  1615 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:49.232962  3651 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:49.234396  3651 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:49.228024  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:49.235805  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:49.236114  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.240806  1614 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.240892  1616 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:49.238364  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.223250  3547 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.329335  3659 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.339419  3605 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.342603  3605 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.347443  3659 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:49.433650  3547 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:49.434598  3547 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:49.436183  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 352533us
I20260709 13:01:49.436115  3599 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.441244  1653 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.441843  3599 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.445091  1653 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:49.445137  3547 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.456549  1686 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:49.456842  3477 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:49.457232  3477 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.457971  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.458250  3477 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.458925  1686 raft_consensus.cc:2410] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:49.459928  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.461084  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.462206  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.463217  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.464308  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.465778  1686 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:49.477211  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:49.471518  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.479625  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.480108  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:49.480648  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.500680  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.495075  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.502369  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.503237  1686 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:49.504276  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.505059  1686 raft_consensus.cc:2368] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:49.505996  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.507321  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.508533  3477 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.509802  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.513253  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.498327  3486 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.522377  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.531013  1686 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.534346  3486 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.534502  3477 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:49.535624  1608 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:49.536134  3477 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:49.534631  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 367754us
I20260709 13:01:49.538673  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:49.541281  1686 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:01:49.564337  3726 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.565361  1686 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:49.566131  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:49.567040  3726 raft_consensus.cc:2764] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:01:49.568827  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:49.569689  3726 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:49.570888  1579 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.571686  3726 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:49.572158  3726 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.572579  3726 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.579429  3486 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:49.580930  3486 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.582551  3547 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.583691  3547 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.584441  3486 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.581017  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:49.585870  3659 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:49.586464  3547 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.587214  3726 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.589502  3726 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.591288  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:49.592957  1579 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.593909  3659 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:49.594305  3659 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:49.594655  3659 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:01:49.595366  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:49.595897  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.603664  3659 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.607100  3659 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:49.607712  3605 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:49.609962  3605 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:49.610342  3605 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.610387  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.612833  1683 raft_consensus.cc:2376] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4. Re-sending same reply.
I20260709 13:01:49.620476  3605 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.624568  3605 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:49.609318  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.626458  3537 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:49.627074  3537 raft_consensus.cc:697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:49.628189  3537 consensus_queue.cc:237] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:49.637936  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 400987us
I20260709 13:01:49.649073  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:49.651027  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:49.651890  3486 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:49.652420  3486 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:49.652834  3486 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.657547  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:49.644830  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.687408  1681 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:49.657213  3547 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:49.671873  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.675833  3651 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:49.680869  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 54752us
I20260709 13:01:49.695135  1579 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:49.696225  3735 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:49.697842  3735 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:49.698439  3735 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:49.699757  3735 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.702728  3547 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.703598  3547 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.645257  1614 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:49.704458  3659 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:01:49.719815  3547 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:49.720192  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 62753.2us
I20260709 13:01:49.720113  3599 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:49.723140  3599 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:49.723699  3599 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.726070  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "469f8c03f4924f809435141a09c976fa"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:49.727240  1683 raft_consensus.cc:606] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:49.727640  1683 raft_consensus.cc:614] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:49.728905  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:49.722111  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:49.732005  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:49.732764  1537 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:49.737176  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.737675  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.737915  1614 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:49.738672  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.741073  1608 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:49.739576  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.742255  1687 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:49.740242  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.732920  3547 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:49.743026  1616 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:49.744398  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:49.745019  1611 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.743556  3547 raft_consensus.cc:697] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:49.747550  1614 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:01:49.748371  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.748724  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.749053  1686 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.749117  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:49.750080  2366 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:49.747880  3547 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.751408  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:49.752333  2362 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.748396  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.748755  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:49.755362  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.747915  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.757915  1689 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.717236  3651 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:49.760792  1681 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:49.767729  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:49.768378  1614 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:49.770059  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:49.779904  1616 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:49.763574  3605 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:49.777998  1686 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:49.821223  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:49.821832  1610 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.820405  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.822975  1687 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.824241  1611 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:49.827077  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.828331  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.829021  1608 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:49.829910  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.830423  1608 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:49.827769  1614 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:01:49.717023  3486 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.833269  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.834544  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:49.834888  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:49.835309  1609 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:49.835461  1611 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.839110  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:49.841334  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.017s	sys 0.013s
I20260709 13:01:49.199942  3670 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.848999  1611 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:49.850389  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.850641  1611 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:49.851039  1608 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:01:49.852239  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.017s	sys 0.014s
I20260709 13:01:49.852478  3486 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:49.832422  3599 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.855180  3599 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.831725  3605 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.857306  3605 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.860318  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.860675  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.861119  1607 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:49.861958  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.862532  1688 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:49.869949  1610 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:49.870718  1539 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:49.871080  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:49.873857  1504 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:49.876307  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:49.877382  1608 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:49.874892  1609 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:49.882345  1687 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:49.885174  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:49.885360  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:49.885814  1534 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:49.847900  3670 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:49.878613  3599 consensus_queue.cc:1059] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:01:49.886971  3486 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:49.887676  3599 raft_consensus.cc:3055] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:49.888096  3599 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:49.889091  3599 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:49.890610  2362 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:49.885972  1687 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:49.883196  1689 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:49.894503  1688 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:49.874857  3547 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:49.897229  1689 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:01:49.898608  1504 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:49.907914  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:49.890651  3599 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:49.912014  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:49.911375  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:49.922297  1539 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:49.922565  1504 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:49.928351  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46704.5us
I20260709 13:01:49.937572  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:49.938910  1533 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:49.915820  3547 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:49.916992  3486 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:49.945034  3486 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:49.945253  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:49.945488  3486 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:49.926290  3733 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
W20260709 13:01:50.078303  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.083725  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.081707  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:49.948509  3547 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.084762  1532 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:49.999814  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:50.007467  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 85026us
I20260709 13:01:50.077682  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.084717  1534 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.141016  1533 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:49.950065  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:50.189772  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.190583  1539 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:50.203513  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.205027  1535 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.313472  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.315229  2367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 161) took 1257 ms. Trace:
I20260709 13:01:50.334347  1532 raft_consensus.cc:2393] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:01:50.336452  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080003ad00 after lost signal to thread 434
W20260709 13:01:50.337595  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080003a8c0 after lost signal to thread 1473
I20260709 13:01:50.337798  3733 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:50.336522  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.317639  2367 rpcz_store.cc:276] 0709 13:01:48.916643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:48.921957 (+  5314us) service_pool.cc:224] Handling call
0709 13:01:50.173451 (+1251494us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54004dd5d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:50.173694 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420138752}
W20260709 13:01:50.377529  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 289183us
I20260709 13:01:50.312243  3547 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:50.381893  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.390347  1504 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:50.365127  3733 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:50.384923  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.389114  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.397797  1535 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.398334  1532 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:50.373381  3742 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.399803  1536 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.402786  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.403589  1534 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:50.407388  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.412806  1689 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:50.413264  1533 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:50.388849  3547 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:50.411778  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.412401  1688 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:50.420552  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.421615  1532 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:50.421929  1536 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:50.424858  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.425472  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.427794  1533 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.429418  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.430224  1532 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.431557  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.432287  1534 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:50.430806  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.433324  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.420539  3547 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:50.440462  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.443698  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 59137.6us
W20260709 13:01:50.436088  3599 consensus_meta.cc:287] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.004s
I20260709 13:01:50.442162  3726 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:50.447548  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.448273  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.448642  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.449820  1538 raft_consensus.cc:1240] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:50.452961  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.448683  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:50.420311  3742 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:50.461536  1539 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:50.462127  1535 raft_consensus.cc:2410] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:50.454892  3726 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:50.476467  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:50.473265  1607 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:50.479305  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:50.479523  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.461717  3749 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:50.480208  1607 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:50.481525  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:50.483682  1615 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:50.476146  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:50.484992  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:50.485502  1609 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:50.485787  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1336) took 1029 ms. Trace:
I20260709 13:01:50.476418  3703 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.486195  1690 rpcz_store.cc:276] 0709 13:01:49.456699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.484680 (+1027981us) service_pool.cc:224] Handling call
0709 13:01:50.485724 (+  1044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:50.486819  3703 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:50.467183  3733 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.466172  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.477682  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.488757  1532 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:01:50.489020  3703 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:50.487885  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:50.486039  3742 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.489825  2370 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.463001  3750 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.496690  1538 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:50.500540  1653 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:50.478734  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.489672  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.490832  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.491308  3749 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:50.517104  1537 raft_consensus.cc:2393] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.491324  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.480283  1536 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:50.510746  1532 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:50.511423  1540 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:50.512174  3599 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:50.528966  1539 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:50.537416  2370 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:50.544937  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:50.465857  3726 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:50.546689  1535 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:50.648486  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:50.651189  3659 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:50.652987  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:50.654026  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:50.654672  1690 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
W20260709 13:01:50.656080  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 207519us
I20260709 13:01:50.657090  1504 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:50.657682  1614 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:50.659881  1614 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:50.580865  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:50.582252  1687 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:50.662698  1684 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:50.649075  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.660674  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.664798  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1337) took 1207 ms. Trace:
I20260709 13:01:50.698945  1684 rpcz_store.cc:276] 0709 13:01:49.456962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.574819 (+1117857us) service_pool.cc:224] Handling call
0709 13:01:50.664725 (+ 89906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:50.515501  3752 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:50.547165  3703 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.659881  3749 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.670192  1534 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:50.673682  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:50.725041  1682 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:01:50.725548  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1330) took 1271 ms (client timeout 1660 ms). Trace:
I20260709 13:01:50.674311  3599 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.674976  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.678359  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:50.624656  3486 consensus_meta.cc:287] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.000s
I20260709 13:01:50.678755  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:50.695950  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:50.725821  1682 rpcz_store.cc:269] 0709 13:01:49.454437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.673247 (+1218810us) service_pool.cc:224] Handling call
0709 13:01:50.725483 (+ 52236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:50.682627  1436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 92) took 9065 ms. Trace:
I20260709 13:01:50.696831  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:50.699702  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.702219  3751 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:50.704646  3726 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:01:50.706598  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:50.564881  2363 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.616408  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:50.708083  1614 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [3.2-6.4]
I20260709 13:01:50.709128  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:50.777122  1615 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:50.712097  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.565572  3754 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:50.728922  1538 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:50.655292  3547 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:50.730973  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52699.7us
W20260709 13:01:50.732187  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.789063  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.734603  1613 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:50.776160  1607 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.789904  1579 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:50.776365  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 112261us
I20260709 13:01:50.563753  3733 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:50.698918  1533 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:50.793390  3545 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:50.800343  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.777161  1536 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:50.780889  1532 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:01:50.787753  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:50.788017  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080032e860 after lost signal to thread 1565
W20260709 13:01:50.802502  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800292da0 after lost signal to thread 1566
I20260709 13:01:50.794477  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:50.803661  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080037ab60 after lost signal to thread 1640
W20260709 13:01:50.804014  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080030cd60 after lost signal to thread 1641
I20260709 13:01:50.804164  1535 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:01:50.805104  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080038ca60 after lost signal to thread 1714
I20260709 13:01:50.806532  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.807122  1532 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:50.806377  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 109660us
I20260709 13:01:50.804284  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.808187  1504 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:50.808632  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080033cca0 after lost signal to thread 2395
W20260709 13:01:50.808923  1470 debug-util.cc:398] Leaking SignalData structure 0x7b08002fcee0 after lost signal to thread 2396
I20260709 13:01:50.809149  1579 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:50.809652  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:50.809964  1539 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:50.810395  1681 raft_consensus.cc:606] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:50.778822  3749 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:50.783001  3742 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:50.823431  3742 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:50.734287  3599 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:50.826356  3599 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:50.832340  1538 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:50.731526  3486 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:50.815325  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0032878119999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:01:50.811498  3670 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:50.730858  3752 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:50.820683  1579 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:50.821334  3751 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:50.821647  3540 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:50.821974  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:50.852587  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.853008  1613 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.822455  1540 raft_consensus.cc:2368] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:01:50.729795  1436 rpcz_store.cc:276] 0709 13:01:41.616938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:41.628775 (+ 11837us) service_pool.cc:224] Handling call
0709 13:01:50.682538 (+9053763us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:48.880163 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:48.937944 (+ 57781us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:48.937999 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:01:48.938036 (+    37us) tablet.cc:662] Decoding operations
0709 13:01:48.938726 (+   690us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:48.938820 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:48.938848 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:01:48.939310 (+   462us) tablet.cc:701] Row locks acquired
0709 13:01:48.939372 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:01:48.939548 (+   176us) write_op.cc:270] Start()
0709 13:01:48.939707 (+   159us) write_op.cc:276] Timestamp: P: 1783602108939479 usec, L: 0
0709 13:01:48.939730 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:49.021898 (+ 82168us) log.cc:844] Serialized 1364 byte log entry
0709 13:01:49.284686 (+262788us) op_driver.cc:464] REPLICATION: finished
0709 13:01:49.331552 (+ 46866us) write_op.cc:301] APPLY: starting
0709 13:01:49.331667 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:49.331863 (+   196us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:49.332204 (+   341us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:49.336827 (+  4623us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:49.337225 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:01:49.337274 (+    49us) write_op.cc:312] APPLY: finished
0709 13:01:49.337622 (+   348us) log.cc:844] Serialized 34 byte log entry
0709 13:01:49.338560 (+   938us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:49.338666 (+   106us) write_op.cc:454] Released schema lock
0709 13:01:49.338719 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:49.356385 (+ 17666us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:49.356424 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":505534,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":46519,"apply.run_cpu_time_us":3697,"apply.run_wall_time_us":24777,"num_ops":3,"prepare.queue_time_us":224592,"prepare.run_cpu_time_us":7282,"prepare.run_wall_time_us":232917,"raft.queue_time_us":137948,"raft.run_cpu_time_us":2988,"raft.run_wall_time_us":47000,"replication_time_us":344750,"thread_start_us":340404,"threads_started":4,"wal-append.queue_time_us":97234,"wal-append.run_cpu_time_us":13126,"wal-append.run_wall_time_us":1217693}]]}
I20260709 13:01:50.833931  3547 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.793876  3754 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:50.834161  3742 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:50.811010  3434 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:50.835105  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.835388  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.807068  3545 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:50.835834  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.840188  1615 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:01:50.843200  1607 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:50.845037  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:50.864535  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.859349  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.865147  1539 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:50.859673  1537 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:50.812888  3733 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:50.847716  1608 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:50.867087  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.867612  1535 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:50.871402  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.875612  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:50.854707  3659 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:50.876343  1681 raft_consensus.cc:606] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:50.890570  1681 raft_consensus.cc:614] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:50.876295  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.891577  1541 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:50.892912  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.896997  1533 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:50.897042  1539 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
W20260709 13:01:50.916478  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63471.2us
I20260709 13:01:50.913100  1532 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:01:50.912995  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:50.913834  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.919035  1541 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.921370  1537 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:01:50.923735  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 115633us
I20260709 13:01:50.900146  3659 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:50.931258  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:50.867262  3434 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:50.931986  1681 raft_consensus.cc:606] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:50.931483  1504 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:50.932857  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:50.931092  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.934346  3545 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.914532  3486 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.944123  3764 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.927311  2363 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 347) took 1879 ms. Trace:
I20260709 13:01:50.945195  2363 rpcz_store.cc:276] 0709 13:01:49.044409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.045793 (+  1384us) service_pool.cc:224] Handling call
0709 13:01:50.564622 (+1518829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:50.791270 (+226648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.911890 (+120620us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54004dd5d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:50.923600 (+ 11710us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3492275456}
I20260709 13:01:50.936539  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:50.946700  3434 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.909652  3759 consensus_queue.cc:1059] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.218s
I20260709 13:01:50.948943  3759 raft_consensus.cc:3055] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:50.949285  3603 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:01:50.949689  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:50.950405  3754 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.949312  3759 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:50.952863  3759 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:50.954363  3759 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:50.955879  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:50.956512  1681 raft_consensus.cc:606] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:50.927263  3735 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:01:50.950472  3603 raft_consensus.cc:3055] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:50.958246  3603 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:50.930429  3670 raft_consensus.cc:697] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:50.959592  1504 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:50.963255  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1628) took 1103 ms. Trace:
I20260709 13:01:50.963562   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:50.967175  1611 rpcz_store.cc:276] 0709 13:01:49.859665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:49.882063 (+ 22398us) service_pool.cc:224] Handling call
0709 13:01:50.707883 (+825820us) spinlock_profiling.cc:243] Waited 875 us on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:01:50.711510 (+  3627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:50.730621 (+ 19111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:50.730656 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:50.786270 (+ 55614us) log.cc:844] Serialized 26 byte log entry
0709 13:01:50.906496 (+120226us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:50.906558 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:50.906665 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:50.958704 (+ 52039us) raft_consensus.cc:1685] finished
0709 13:01:50.958732 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:50.963151 (+  4419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12623,"raft.queue_time_us":29108,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9250,"spinlock_wait_cycles":2011392,"thread_start_us":75663,"threads_started":1,"wal-append.queue_time_us":129499}
I20260709 13:01:50.968907  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.969273  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.969493  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.970158  1536 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.970216  1533 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.971728  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.975400   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:50.964321  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.970158  1539 raft_consensus.cc:2393] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.976792  1541 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:50.965193  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:50.950294  1688 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:50.982184  3752 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:50.992524  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:50.933456  3540 raft_consensus.cc:697] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:51.005517  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.006279  1537 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:01:51.007189  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 140858us
I20260709 13:01:51.010448  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.010674  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.011693  1532 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:01:51.013561  1541 raft_consensus.cc:2410] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:01:51.013588  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 74945.2us
I20260709 13:01:51.010344  3754 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.017705  3659 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.015128  3540 consensus_queue.cc:237] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.017628  3754 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:51.026575  3754 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.027101  2368 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:51.027858  2368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 350) took 1294 ms. Trace:
I20260709 13:01:51.031419  1504 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:50.980558  3767 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:51.032256  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.034112  1537 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:51.033023  2368 rpcz_store.cc:276] 0709 13:01:49.733164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.616074 (+882910us) service_pool.cc:224] Handling call
0709 13:01:51.027760 (+411686us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:51.036603  1653 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:51.037976  3733 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.038403  3670 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.033358  3767 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:51.040217  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.040982  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:51.041337  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.041086  3767 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.041729  1536 raft_consensus.cc:2376] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5. Re-sending same reply.
I20260709 13:01:51.042013  1533 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:51.039665  1541 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:51.041015  1538 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:51.043454  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:51.044129  1536 raft_consensus.cc:2376] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5. Re-sending same reply.
I20260709 13:01:51.044718  1532 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:51.035292  3771 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.045719  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.058624  1536 raft_consensus.cc:2376] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5. Re-sending same reply.
I20260709 13:01:51.059304  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:51.059827  1536 raft_consensus.cc:2368] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:01:51.039912  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:51.060354  1539 raft_consensus.cc:2376] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3. Re-sending same reply.
I20260709 13:01:51.061214  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.061698  1539 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:51.062294  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.062660  1539 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:51.063153  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.063794  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.046852  1613 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:51.064922  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.064951  1539 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:51.042477  3767 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.048249  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.048722  3773 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.048992  1535 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:51.049448  3774 raft_consensus.cc:993] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:01:51.051035  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.092401  3774 raft_consensus.cc:1081] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:01:51.092496  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.051317  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.052549  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:51.053877  3765 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:51.093566  1538 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:51.054102  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.034191  3735 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:01:51.020561  3755 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:01:51.104305  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 176) took 12796 ms (client timeout 15000 ms). Trace:
I20260709 13:01:51.056282  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:51.105285  1608 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.057675  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.065822  1536 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:01:51.110666  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.046852  1579 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:51.067060  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.066390  3486 consensus_queue.cc:1059] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:01:51.082784  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 100114us
I20260709 13:01:51.091830  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.093197  1541 raft_consensus.cc:2393] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:51.093251  1540 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:01:51.031976  3603 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.055550  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:51.111552  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 64773.5us
I20260709 13:01:51.130473  1537 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
W20260709 13:01:51.110904  1435 rpcz_store.cc:269] 0709 13:01:38.307634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:38.344369 (+ 36735us) service_pool.cc:224] Handling call
0709 13:01:38.594071 (+249702us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea72090 00007fd02eb10f3a 00007fd0348c71cc 00007fd0349c537e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc 00007fd032e85392 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:51.104063 (+12509992us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":39,"spinlock_wait_cycles":19174784}
I20260709 13:01:51.131358  3767 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.131912  3547 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.060537  3703 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.064481  3733 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.145895  3767 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.178476  3751 raft_consensus.cc:3055] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:51.179003  3751 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.186569  3603 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.192536  1608 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:51.197083  3754 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.067777  3771 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.210047  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.210794  1608 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:51.179966  3751 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.198486  3767 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:51.200721  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 276188us
W20260709 13:01:51.201248  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 143642us
W20260709 13:01:51.188135  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 53744us
I20260709 13:01:51.212275  1609 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:01:51.212422  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:51.222891  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.206132  3764 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.241608  1504 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.231417  3771 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.231683  3754 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:51.235642  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.247011  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.249028  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.255997  3775 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:51.257813  3775 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:01:51.249280  1537 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:51.249585  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.263967  1608 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:51.249868  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.251538  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:51.250203  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:51.267998  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 55670.5us
I20260709 13:01:51.268537  1611 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.270584  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.271227  1609 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:51.271376  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:51.272353  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.272949  1608 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:01:51.273554  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.273770  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.274293  1607 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:51.274441  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:51.268002  3547 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.262401  3751 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.243942  3733 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:01:51.248591  3752 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:01:51.275959  3773 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:51.278893  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.300381  1538 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:51.280267  3754 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.301730  3754 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.302158  3754 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.284596  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:51.305827  1613 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:51.287909  3651 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:01:51.278013  1504 leader_election.cc:400] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:01:51.288225  1439 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 6, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:51.309479  3767 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.310859  1612 raft_consensus.cc:2368] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:51.288398  3773 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:51.311033  1439 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:01:51.311841  3773 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:51.312914  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.297683  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:51.308768  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.281792  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:51.315054  2329 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:51.311949  3767 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.316452  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.317307  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.317354  3547 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.321416  3547 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.321579  3771 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.321882  3547 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.324244  1684 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:51.293998  3434 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:01:51.316489  3640 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.327711  3434 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:51.328202  3434 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:51.329202  3434 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.330976  3434 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.292774  3774 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:01:51.332404  3771 consensus_queue.cc:1059] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:01:51.332294  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52049.9us
I20260709 13:01:51.333987  3640 raft_consensus.cc:3055] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:51.319434  1439 catalog_manager.cc:5697] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:51.290963  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:51.316653  3707 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:51.340413  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 66925.8us
I20260709 13:01:51.342346  1504 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:51.335690  2328 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:51.345602  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.349030  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.349287  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.349977  1684 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.346370  3703 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:51.334450  3640 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:01:51.353977  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.344513  3707 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.344877  3486 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:51.346223  3659 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.353488  1439 catalog_manager.cc:5697] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 3, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
W20260709 13:01:51.334362  3651 consensus_queue.cc:1175] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 13:01:51.359831  3749 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:51.354912  3764 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:51.386096  3749 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.387197  3754 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.357821  3707 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.347078  3540 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:01:51.369869  3547 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.370512  3670 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:51.377115  3659 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:51.349922  3733 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:01:51.350411  3771 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.377372  3703 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.348719  3742 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:51.386246  3764 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.387398  3749 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:51.362023  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 71141.3us
I20260709 13:01:51.363623  3640 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.353901  3774 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.409286  1684 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
W20260709 13:01:51.411608  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 59037.8us
W20260709 13:01:51.416394  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63547us
I20260709 13:01:51.375644  3773 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.420737  3547 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.420903  3754 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.418511  3771 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.431135  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.418308  3659 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.432890  1579 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:51.435020  3742 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:01:51.450312  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 139829us
I20260709 13:01:51.435974  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.425755  3774 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:51.438251  3603 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:51.438812  3640 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.432747  3771 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.444819  3764 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.455899  3773 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:51.460788  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 111584us
I20260709 13:01:51.462258  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:51.465158  1504 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:51.465626  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:51.468209  1504 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.469028  3754 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.470314  3754 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.470791  3754 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.469161  3486 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:51.476003  3486 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.476981  3486 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.478247  3486 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.480410  3726 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.480840  3726 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:51.481204  3726 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.454465  3774 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.489274  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.490885  1505 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.491590  3792 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:51.502295  3486 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:51.502846  3486 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:51.503234  3486 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.496555  3751 raft_consensus.cc:3055] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:51.504484  3751 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.505298  3751 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.506417  3751 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.500047  3733 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.508857  3733 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:51.465029  3547 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:51.517498  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.518225  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.519479  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.519850  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.521029  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.521597  1688 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:51.521411  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.494578  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:51.523866  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.524463  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.527935  1681 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:51.530946  1654 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:51.532696  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:01:51.538046  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.538698  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:51.539052  1504 connection.cc:256] RPC call timeout handler was delayed by -1.2775966639999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
I20260709 13:01:51.546850  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.548883  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.550462  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.551301  1685 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:51.519345  3733 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.555858  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.556799  1685 raft_consensus.cc:2368] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:51.554210  1684 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.554648  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.557550  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37894
I20260709 13:01:51.558133  1538 raft_consensus.cc:606] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:01:51.558475  1538 raft_consensus.cc:614] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:51.561331  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:51.561563  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:51.562223  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.523809  3547 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.563057  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:51.563992  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:51.559196  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 126396us
I20260709 13:01:51.527076  3707 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.568871  3733 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.570683  3707 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.571280  1685 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:01:51.519244  3792 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:51.558754  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.581758  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.572786  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:51.573350  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49274.8us
I20260709 13:01:51.573837  2365 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:51.563083  3547 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.579680  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:51.587406  1687 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.587330  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.588285  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:51.591845  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.490103  3754 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.559691  3703 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:01:51.608418  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 173003us
I20260709 13:01:51.618755  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:01:51.610168  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 51910.9us
I20260709 13:01:51.595927  3794 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:51.613888  1612 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:51.614611  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 81993.9us
I20260709 13:01:51.612089  1688 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:51.596341  3751 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.626474  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.627157  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.631541  2370 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:51.634527  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.614293  3764 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.622963  3703 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:51.650950  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.640959  3773 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.657363  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:51.658442  3726 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.658986  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:51.659359  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.660002  3755 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:51.659871  3781 consensus_queue.cc:1059] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:51.660470  3755 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:51.625761  3788 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.663866  3794 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.658990  3486 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.668133  3794 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.639259  3764 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.669624  3764 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.670257  3486 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.660599  3797 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:01:51.672108  3796 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.672601  3796 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:51.668136  3754 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.676947  1688 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:51.677776  1681 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:51.678040  1687 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:51.684933  1612 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:51.644524  3749 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.688731  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.625056  3775 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:01:51.694497  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 60052.3us
I20260709 13:01:51.647073  3703 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:51.688731  2329 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:51.719599  1505 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:51.673065  3796 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.661005  3755 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:51.663972  3751 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.724215  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:51.726641  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:51.685214  3603 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:01:51.674026  3804 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:51.699986  3749 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:51.774595  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50452.5us
I20260709 13:01:51.776587  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:01:51.728646  3801 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:01:51.759359  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:51.777565  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 150583us
I20260709 13:01:51.724193  3781 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:51.686066  3735 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:01:51.727947  3545 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:51.826722  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.815330  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.819244  3794 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.757182  3603 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:51.757931  3799 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:51.719120  3540 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:01:51.757968  3733 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:51.819566  3795 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:51.758340  2363 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:51.794529  3749 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.818769  3788 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:51.816109  3804 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.721081  3791 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 13:01:51.878188  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.880288  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:51.845185  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 85878.3us
W20260709 13:01:51.846907  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:51.882440  1534 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:51.878887  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:51.882149  1538 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:51.881035  1504 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.841262  1532 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:51.884784  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.885432  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.818475  3781 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:51.832906  3794 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:51.834277  3773 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:51.834820  3603 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:51.835975  3799 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:51.897493  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:51.899163  3799 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.905589  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:51.906908  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:51.907912  1537 raft_consensus.cc:2410] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:01:51.910924  1540 raft_consensus.cc:2410] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:51.910772  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.875944  3811 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:51.844632  3768 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:51.881122  3726 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.920322  3797 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.936513  3804 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.931834  3811 raft_consensus.cc:697] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.939355  3811 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.940510  3781 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.942410  3781 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.943192  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:51.931512  3800 log.cc:927] Time spent T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:01:51.897657  3788 raft_consensus.cc:697] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:51.872372  3810 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:01:51.944803  3788 consensus_queue.cc:237] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.934669  3815 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:51.937995  3771 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.906563  3794 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.892802  3733 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:01:51.928599  3805 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:01:51.725414  3792 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.935635  3768 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.918427  3754 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:01:51.961630  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:51.969933  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 88993.7us
I20260709 13:01:51.970844  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.978965  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:51.957197  3771 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:51.981675  1504 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:51.983631   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:51.989378  3733 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:51.963107  3797 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:51.969091  3670 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:51.994613  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:52.057771  3803 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 13:01:52.079069  3806 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.322s	user 0.002s	sys 0.000s
W20260709 13:01:52.183212  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 187626us
W20260709 13:01:52.191957  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.183921  3770 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.184840  3547 consensus_meta.cc:287] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.572s	user 0.014s	sys 0.004s
I20260709 13:01:52.185578  3703 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.186522  3726 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:51.981473  3545 raft_consensus.cc:697] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:51.952236  3774 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:51.978087  3754 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:51.956058  3659 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.195842  1504 leader_election.cc:400] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:52.192636  3810 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.278126  1504 leader_election.cc:403] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:01:52.283044  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 87349.1us
W20260709 13:01:52.277107  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 282598us
I20260709 13:01:52.284608  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:52.188145  3742 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:52.285892  1580 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.292933  1682 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:52.276834  3769 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.270547  3603 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.304955  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.271404  3547 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.299630  3742 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.320185  3603 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:52.320467  3547 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.268482  3770 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.321085  3742 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.321306  3547 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:52.323027  3770 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.301821  3754 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:52.320986  3764 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.651s	user 0.006s	sys 0.011s
I20260709 13:01:52.318755  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.304741  3726 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:01:52.338554  3825 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:01:52.340260  3802 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.510s	user 0.002s	sys 0.006s
I20260709 13:01:52.330142  3767 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.342337  3659 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.342830  3767 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:52.343434  3767 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.322896  3545 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.348173  3819 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.348816  3819 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.352873  3788 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.318842  3799 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.355219  3774 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.353616  3788 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:01:52.323083  3796 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.565s	user 0.006s	sys 0.007s
I20260709 13:01:52.361636  3796 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.361838  3788 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.362036  3799 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.364378  3796 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.377802  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:52.382228  3768 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.383167  3703 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.304014  3820 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:52.388906  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:52.395004  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.397204  1688 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:52.400844  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 82206.8us
I20260709 13:01:52.403045  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:52.382292  3755 consensus_meta.cc:287] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.012s
I20260709 13:01:52.392629  3820 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:52.412213  3799 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:01:52.412675  3820 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.413437  3794 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.414214  3735 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.415176  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:52.415771  1690 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:52.417317  3794 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.418015  3759 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:52.419097  3759 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:01:52.419507  3771 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:52.420079  3771 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:52.421149  3771 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.421525  1580 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.422523  3759 raft_consensus.cc:3055] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.423024  3759 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:52.423830  3819 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.367226  3764 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.425241  3735 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:52.425954  3735 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:52.426379  3735 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.426802  3764 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.404250  3540 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:52.428645  3540 raft_consensus.cc:697] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:52.428965  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.429646  3540 consensus_queue.cc:237] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.423893  3759 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.431495  3759 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.422565  3771 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:52.424512  3659 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:52.407444  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:52.443261  1688 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:52.449270  1580 leader_election.cc:400] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:01:52.449798  1580 leader_election.cc:403] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:52.451292   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:52.454074  2370 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:01:52.454444  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.458865  1681 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:52.466733  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:52.468637  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.015s	sys 0.000s
W20260709 13:01:52.469014  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.016s	sys 0.000s
W20260709 13:01:52.469336  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 749444us
I20260709 13:01:52.470021  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:52.478377  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:01:52.455202  3749 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.009s
I20260709 13:01:52.485071  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.487897  1688 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:52.488380  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:52.450380  3726 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.492316  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:52.493563  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:52.492374  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:52.495302  1688 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
W20260709 13:01:52.487900  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 203116us
I20260709 13:01:52.489512  2328 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:52.502332  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:52.504236  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:52.505366  1538 raft_consensus.cc:2410] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:01:52.510742  1487 auto_rebalancer.cc:893] Removing replace marker failed: Replica c98c328741aa493d87abafbf08f04944 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:52.510924  3774 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:01:52.511230  1487 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:01:52.511624  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:01:52.512511  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:52.513198  3827 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:52.514569  3827 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:52.514911  3827 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:52.514961  3820 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.492209  3797 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.516716  3603 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:52.519160  1684 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:52.520484  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:52.493940  3726 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:52.521631  3726 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.494073  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:52.524513  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:52.525295  1690 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:52.512518  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:52.531423  3768 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:52.532122  3768 raft_consensus.cc:697] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:52.532224  3781 raft_consensus.cc:2764] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:52.532393  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:52.533182  1613 raft_consensus.cc:2368] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5.
I20260709 13:01:52.477475  3742 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:01:52.470636  3810 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.534771  1611 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:52.442170  3755 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.541862  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:52.542408  1685 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:52.543439  1608 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:52.544250  1685 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:52.544786  1609 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
W20260709 13:01:52.545773  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.546662  1504 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:52.511562  3774 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.551578  3774 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:52.553592  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 68754.8us
I20260709 13:01:52.554396  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:52.559271  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:52.535591  3795 consensus_meta.cc:287] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.640s	user 0.017s	sys 0.000s
I20260709 13:01:52.568665  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.545125  1685 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.579344  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:52.579480  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:52.580271  1613 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:52.580747  1682 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 2. Current term is 3. Ops: []
W20260709 13:01:52.581619  1654 connection.cc:256] RPC call timeout handler was delayed by -1.8890352680000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:01:52.582047  1654 connection.cc:256] RPC call timeout handler was delayed by -1.8458352680000303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:01:52.582352  1654 connection.cc:256] RPC call timeout handler was delayed by -1.7738352680000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 13:01:52.582643  1654 connection.cc:256] RPC call timeout handler was delayed by -1.7387352680000276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 13:01:52.582937  1654 connection.cc:256] RPC call timeout handler was delayed by -1.7207352680000554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:01:52.583228  1654 connection.cc:256] RPC call timeout handler was delayed by -1.6928352680000671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 13:01:52.583513  1654 connection.cc:256] RPC call timeout handler was delayed by -1.5281352680000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 13:01:52.583786  1654 connection.cc:256] RPC call timeout handler was delayed by -1.4831352680000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
I20260709 13:01:52.586517  3752 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:52.609992  1654 connection.cc:256] RPC call timeout handler was delayed by -1.4741352680000546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
I20260709 13:01:52.610316  3752 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:52.610419  1654 connection.cc:256] RPC call timeout handler was delayed by -1.3814352680000184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21640000000000004s for a response
I20260709 13:01:52.571491  3742 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.580623  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.613162  3752 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.614959  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.616003  3792 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.616269  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.616997  3792 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.617141  3742 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:52.617668  3742 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:52.618106  3742 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:01:52.624228  1654 connection.cc:256] RPC call timeout handler was delayed by -1.3265352680000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
I20260709 13:01:52.617403  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:52.625365  1654 connection.cc:256] RPC call timeout handler was delayed by -1.3238352680000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 13:01:52.625726  1688 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:01:52.625909  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:52.625737  1654 connection.cc:256] RPC call timeout handler was delayed by -1.3229352680000375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 13:01:52.626984  1654 connection.cc:256] RPC call timeout handler was delayed by -1.2833352680000303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
I20260709 13:01:52.627207  2328 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:52.627888  3770 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.628194  3752 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:52.628649  3752 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:52.628959  3752 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.629194  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.594786  3840 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.638535  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:52.490783  3749 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.552407  3797 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:01:52.637452  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 66374.2us
I20260709 13:01:52.646180  1685 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.656577  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:52.684996  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46888.9us
I20260709 13:01:52.711406  1611 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:01:52.712487  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.713888  1689 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:52.714509  1689 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:52.706350  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:52.718634  1682 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:52.719064  1682 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:52.719914  1536 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:52.722617  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:52.723512  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:52.724313  1532 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 1.
I20260709 13:01:52.724097  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:52.719416  3486 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.705482  3640 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:52.727385  1682 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.728072  3640 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:52.728550  3640 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:52.729009  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:52.729704  1540 raft_consensus.cc:2376] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4. Re-sending same reply.
I20260709 13:01:52.729509  3640 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.727464  3486 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.706058  3781 consensus_queue.cc:1059] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:01:52.732733  1689 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.734254  1689 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.728562  1682 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:52.737746  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.710464  3799 consensus_queue.cc:1059] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:01:52.744315  3829 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:01:52.745645  3777 consensus_queue.cc:1059] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:01:52.747042  3434 raft_consensus.cc:3055] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:52.747434  3434 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:52.748345  3434 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.755638  3751 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:52.755894  3781 raft_consensus.cc:3055] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:52.756409  3781 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:52.756311  3751 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.757381  3781 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.657507  3840 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.758239  3733 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.759045  3733 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:52.759591  3733 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.760623  3755 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.758546  3781 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:52.762435  3820 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.764259  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:52.767383  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:52.768154  1534 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:52.540072  3827 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.769786  3827 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.771987  3752 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.774814  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:52.775612  1533 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:52.776803  3788 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:52.778484  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 282539us
W20260709 13:01:52.779495  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.723479  1541 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:01:52.780802  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.781392  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
W20260709 13:01:52.668325  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.783895  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 145459us
I20260709 13:01:52.641376  3769 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.786197  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.640203  3742 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.636991  3795 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:52.647652  3770 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:52.786916  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:52.794795  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.715411  3547 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.794065  3769 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:52.553079  3810 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.805015  1536 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:52.636608  3830 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:52.811229  1682 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:52.779106  3797 raft_consensus.cc:697] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:52.815791  3841 raft_consensus.cc:2764] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:01:52.854303  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 59640.6us
I20260709 13:01:52.817461  3819 raft_consensus.cc:3055] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:52.817914  3829 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:52.818718  3751 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.833534  3769 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.797657  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:01:52.820560  3486 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.825773  3821 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:52.827121  3794 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:52.828457  3547 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:52.829370  3834 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:01:52.830559  3840 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:52.793869  3434 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:52.790757  3640 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:52.834357  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:52.835492  2329 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:52.836460  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 49621.9us
I20260709 13:01:52.890775  1681 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.840344  1689 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:52.841662  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:52.842883  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.891340  1654 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:52.891680  1608 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:52.853865  1533 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:52.803962  3770 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:52.855533  1505 leader_election.cc:400] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:52.856118  1685 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:01:52.898901  1685 pending_rounds.cc:85] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 3
I20260709 13:01:52.856930  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:52.858603  1532 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:01:52.899106  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 43811.4us
W20260709 13:01:52.899511  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 64146.7us
I20260709 13:01:52.819108  3752 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.839031  3703 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:52.884138  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:52.907258  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.812431  3811 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 13:01:52.857991  3819 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:52.852566  1535 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:52.891235  1534 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:52.860253  3829 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:52.898234  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.899986  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.899151  1685 pending_rounds.cc:107] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:01:52.897943  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:52.915319  1685 raft_consensus.cc:2889] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:52.801213  3768 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.909351  1689 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:52.863375  3791 consensus_queue.cc:1059] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:01:52.910090  1538 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:52.903270  3770 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:52.968109  2363 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:52.971791  3742 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:52.964483  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 66651us
I20260709 13:01:52.973757  1538 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:52.957916  1608 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
W20260709 13:01:52.928679  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.936830  3830 raft_consensus.cc:697] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:52.984400  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:52.984668  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:52.985283  1611 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:52.963732  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:52.985934  1533 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 2: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:52.987048  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:52.987291  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:52.962883  1534 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:52.988343  3809 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.967144  3659 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:52.989110  3816 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:52.989365  3603 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:52.990108  3603 raft_consensus.cc:993] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:01:52.990664  3603 raft_consensus.cc:1081] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Signalling peer e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:01:52.990788  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:52.980322  3749 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:52.994145  3547 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.981228  1532 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:52.981786  3836 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.995959  3651 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:52.982082  1537 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:52.996480  3836 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.998749  3836 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:52.982590  3742 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:52.982615  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:52.984514  3830 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:52.908110  3804 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:01:52.972780  3837 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:52.884493  3735 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.919418  3829 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:53.028645  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:01:53.007324  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.008471  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:53.022626  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:52.974294  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:52.963799  3840 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:53.065047  1614 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:53.067714  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:53.068101  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:53.065917  1610 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.069079  1611 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.070775  1689 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:01:53.033780  1613 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:01:53.072674  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:53.073037  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:53.073473  1689 raft_consensus.cc:2393] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:53.073670  1685 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:53.067430  3764 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.076829  3844 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:01:52.882594  3821 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:53.078810  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 104625us
W20260709 13:01:53.093344  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.034286  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:53.080458  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:53.097713  1608 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:53.100100  1612 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
W20260709 13:01:53.120258  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52224.2us
W20260709 13:01:53.029438  3670 consensus_meta.cc:287] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.788s	user 0.011s	sys 0.003s
I20260709 13:01:53.033707  3751 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.126463  1609 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:53.121289  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:53.129976  1614 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:53.076905  3764 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.003376  3726 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.004287  3703 consensus_queue.cc:1059] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 13:01:52.999411  3733 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:52.999773  3742 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.151588  1613 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:53.153147  1611 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:53.149664  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:53.158284  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 258402us
I20260709 13:01:53.155296  2371 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:01:53.160488  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 171979us
I20260709 13:01:53.161549  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:53.140304  3670 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.164346  3856 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.141038  3659 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.179100  3856 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.168762  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:53.133519  3840 raft_consensus.cc:697] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:53.169986  1607 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:53.075829  3769 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.182441  1610 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:53.175662  1535 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:53.176782  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:53.178519  1616 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:01:53.183537  1616 pending_rounds.cc:85] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 2
I20260709 13:01:53.183844  1616 pending_rounds.cc:107] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:01:53.184141  1616 raft_consensus.cc:2889] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.179342  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:53.185927  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.189249  1608 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:53.181627  3856 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:53.199016  1539 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:01:53.155158  3799 raft_consensus.cc:2764] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:53.149996  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:53.210372  1532 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:53.175537  2329 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:53.181098  3840 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:53.182049  3659 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:53.201799  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 277888us
I20260709 13:01:53.204281  1681 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:01:53.141184  3547 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
W20260709 13:01:53.173467  3767 consensus_meta.cc:287] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.010s
I20260709 13:01:53.208510  2369 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:53.143229  3486 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:01:53.209420  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:53.156860  3751 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
W20260709 13:01:53.215550  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.214699  1608 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:53.084956  3819 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:53.000281  3797 consensus_queue.cc:237] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.211920  1532 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:53.229821  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:53.353756  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 192332us
I20260709 13:01:53.399586  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:53.343658  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.386082  3848 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.391969  1532 pending_rounds.cc:85] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 2
I20260709 13:01:53.252843  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:53.508190  1532 pending_rounds.cc:107] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:53.388230  3670 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.339551  3827 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:53.398581  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.440076  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:53.402005  1539 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:01:53.522101  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.401551  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:53.522337  1689 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:01:53.457841  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 336044us
I20260709 13:01:53.205996  3755 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:53.257927  1681 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:53.229146  3810 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.481055  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:53.508724  1532 raft_consensus.cc:2889] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:53.532126  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:53.533301  1532 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:53.254491  3603 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.523988  1504 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:53.385377  3735 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.539444  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:53.542160  1539 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:53.550201  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:53.551149  1532 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:53.553490  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 72753.6us
I20260709 13:01:53.560598  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:53.232527  3767 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.402531  3770 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.620319  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:53.621488  1532 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:53.621567  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:53.622524  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:53.623818  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:53.642175  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 240685us
W20260709 13:01:53.646302  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 183767us
W20260709 13:01:53.648561  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:53.649289  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:53.549226  3547 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:53.549623  3810 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:53.657653  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:53.660701  1615 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:53.661612  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:53.661886  1683 raft_consensus.cc:3055] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:53.657984  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:53.666097  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:53.662448  1683 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:53.666869  1688 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:53.603538  3735 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.529582  3670 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.540830  3827 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:53.674558  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:53.539594  3755 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.674289  1683 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.685432  1689 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:53.684309  3726 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.695992  3861 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:53.696450  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:53.660015  3486 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:53.713107  1683 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:53.519711  3848 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.669870  3777 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.718598  2364 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:01:53.670204  3821 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:53.674090  3735 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.686561  3771 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:53.696518  3839 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:01:53.709625  3733 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.688174  3764 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.671034  3810 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:53.687722  3742 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:53.697068  3855 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:01:53.672055  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:53.665791  3547 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:53.687245  3814 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:53.731104  3777 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:53.796463  3755 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:53.783162  3852 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.738751  3735 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.739023  3821 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:53.734874  3769 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.797461  3868 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:53.812011  3864 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:01:53.801126  3858 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:01:53.798513  3754 consensus_meta.cc:287] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.464s	user 0.009s	sys 0.005s
W20260709 13:01:53.800298  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 142424us
I20260709 13:01:53.758404  3486 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:53.790102  2366 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:53.782860  3877 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:53.748847  3771 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:53.797231  3852 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.804158  3733 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:53.809306  3767 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.811949  3868 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.810055  3770 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.758016  3866 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.197s
I20260709 13:01:53.778512  3764 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:01:53.837687  1683 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:53.839875  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:53.866940  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1655) took 1223 ms. Trace:
W20260709 13:01:53.899600  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 59867.1us
I20260709 13:01:53.900058  1612 rpcz_store.cc:276] 0709 13:01:52.643402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.646517 (+  3115us) service_pool.cc:224] Handling call
0709 13:01:52.646885 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.100711 (+453826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.866570 (+765859us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b5400345654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:53.866843 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041669888}
I20260709 13:01:53.901683  3871 raft_consensus.cc:2764] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:01:53.900765  1654 leader_election.cc:400] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5.
I20260709 13:01:53.833819  3754 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 2. Current term is 3.
I20260709 13:01:53.902491  1654 leader_election.cc:403] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:01:53.909363  3873 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:53.910197  3873 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:53.876307  3788 consensus_meta.cc:287] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.099s	user 0.005s	sys 0.008s
W20260709 13:01:53.872642  3859 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.361s	user 0.000s	sys 0.002s
W20260709 13:01:53.882030  3781 consensus_meta.cc:287] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.120s	user 0.017s	sys 0.002s
W20260709 13:01:53.873989  3774 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.322s	user 0.012s	sys 0.000s
I20260709 13:01:53.853965  3863 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.258s
I20260709 13:01:53.916489  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:53.878386  3670 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.919251  3777 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:53.920372  3848 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:53.921590  3810 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:53.929988  3759 consensus_meta.cc:287] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 1.498s	user 0.010s	sys 0.005s
I20260709 13:01:53.931185  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1654) took 1292 ms. Trace:
I20260709 13:01:53.965752  1607 rpcz_store.cc:276] 0709 13:01:52.638354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.638488 (+   134us) service_pool.cc:224] Handling call
0709 13:01:52.638787 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.182356 (+543569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.930799 (+748443us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b540014afd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:53.931095 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221171456}
I20260709 13:01:53.931334  3547 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:53.916399  3888 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5.
I20260709 13:01:53.935940  3735 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:53.939302  2368 consensus_meta.cc:287] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
W20260709 13:01:53.877029  3867 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:01:53.861889  3877 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:53.950325  1537 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
W20260709 13:01:53.936446  2363 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 360) took 1483 ms (client timeout 1794 ms). Trace:
I20260709 13:01:53.882261  3868 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:53.862944  3827 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:53.961740  1534 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:01:53.965032  3781 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:53.980620  3781 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:53.981084  3781 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:53.984019  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1613) took 1011 ms. Trace:
I20260709 13:01:53.984726  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1619) took 1004 ms. Trace:
I20260709 13:01:53.985200  1533 rpcz_store.cc:276] 0709 13:01:52.980696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.987936 (+  7240us) service_pool.cc:224] Handling call
0709 13:01:53.042272 (+ 54336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.147455 (+105183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.147487 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:53.147530 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:53.147558 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.984460 (+836902us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400066654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:53.984512 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:53.984662 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241266048}
I20260709 13:01:53.959321  3774 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:53.984452  1535 rpcz_store.cc:276] 0709 13:01:52.972821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.972953 (+   132us) service_pool.cc:224] Handling call
0709 13:01:52.973257 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.182946 (+209689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.983734 (+800788us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b540006b654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:53.983950 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464947456}
I20260709 13:01:53.983661  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:53.972680  2368 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:01:53.994051  1654 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:54.005509  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 210141us
I20260709 13:01:54.033759  1684 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:54.033828  3670 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:53.977445  2363 rpcz_store.cc:269] 0709 13:01:52.452529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.453184 (+   655us) service_pool.cc:224] Handling call
0709 13:01:53.936127 (+1482943us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54001a5c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:53.936350 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694074624}
I20260709 13:01:54.046927  3887 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:01:54.050222  3832 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.012s	sys 0.024s
I20260709 13:01:54.035030  3863 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:54.073412  3670 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:54.097656  3832 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.012s	sys 0.025s
I20260709 13:01:53.973807  3877 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.076023  3887 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:54.166029  2365 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:54.166294  3790 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.142519  3814 raft_consensus.cc:697] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:54.167093  3804 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:54.167425  3774 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:54.168012  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 174070us
W20260709 13:01:54.168501  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 510958us
I20260709 13:01:54.168608  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1614) took 1189 ms. Trace:
W20260709 13:01:54.166033  3885 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.082s	user 0.000s	sys 0.002s
I20260709 13:01:54.198002  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.187178  3790 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.183591  3816 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.175699  3873 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.226482  2370 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:54.196615  3804 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:54.197227  1538 rpcz_store.cc:276] 0709 13:01:52.978992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.983184 (+  4192us) service_pool.cc:224] Handling call
0709 13:01:52.983488 (+   304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:53.064442 (+ 80954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:53.064491 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:53.075730 (+ 11239us) log.cc:844] Serialized 52 byte log entry
0709 13:01:53.146232 (+ 70502us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:53.194128 (+ 47896us) log.cc:844] Serialized 14 byte log entry
0709 13:01:53.195475 (+  1347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:53.195607 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.127207 (+931600us) raft_consensus.cc:1685] finished
0709 13:01:54.127232 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.168523 (+ 41291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98574,"prepare.queue_time_us":108530,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":68,"raft.queue_time_us":366932,"raft.run_cpu_time_us":456,"raft.run_wall_time_us":44511,"thread_start_us":103473,"threads_started":3,"wal-append.queue_time_us":151366}
I20260709 13:01:54.176018  3887 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.204551  3547 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:54.215307  3816 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.204114  3845 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:01:54.270748  3781 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.215596  3771 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.262096  3814 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:54.277627  3829 consensus_meta.cc:287] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.156s	user 0.008s	sys 0.007s
W20260709 13:01:54.283550  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 86977.6us
I20260709 13:01:54.289263  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:54.284584  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 86671.5us
I20260709 13:01:54.290333  1505 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:54.223379  3868 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.292343  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:54.283396  3670 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.297046  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:54.294518  3547 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:54.291080  3829 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.297076  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.301553  3829 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.300125  1541 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:54.293500  3845 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:01:54.301594  3848 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:01:54.302448  1541 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.296657  3892 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:54.300715  3840 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.303723  3892 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:54.304091  3840 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:54.304623  3840 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.304857  3892 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.302181  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.306982  3848 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:54.313035  3876 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.314559  3876 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:54.314380  3774 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.315065  3876 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.294411  3882 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:01:54.316273  3863 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:01:54.321190  3863 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.321702  3781 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:54.316373  3821 consensus_queue.cc:1059] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:54.316699  3774 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:54.321702  3863 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:54.323045  3821 consensus_queue.cc:1243] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer c98c328741aa493d87abafbf08f04944 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:01:54.323901  3755 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.324368  3755 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:54.316366  3861 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:01:54.325431  3819 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.325217  3755 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.325911  3821 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:54.315999  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:54.318523  3804 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.336421  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1382) took 1766 ms. Trace:
I20260709 13:01:54.323933  3863 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.336648  3821 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:54.337178  1684 rpcz_store.cc:276] 0709 13:01:52.541491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.541630 (+   139us) service_pool.cc:224] Handling call
0709 13:01:54.307854 (+1766224us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54002ebdd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:54.308023 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3410602368}
I20260709 13:01:54.338084  3821 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.339349  3821 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.299381  3547 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:54.340457  3547 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.341140  3752 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:54.341764  3752 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.344177  3790 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.344667  3863 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.310585  1541 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.348670  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:54.356261  1607 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:54.348752  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:54.357308  1614 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:54.349416  3603 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.357641  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:54.349531  3755 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.351428  3820 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.352631  3774 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.349545  1616 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:01:54.354956  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:54.359277  1607 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:01:54.359694  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:54.363638  1612 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:54.359856  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:54.360891  1540 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 4. Ops: []
I20260709 13:01:54.364880  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:54.364058  1579 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:54.365624  1608 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:54.361255  3797 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.375159  3796 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:54.376582  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:54.345702  3735 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:54.367434  3603 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.377027  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:54.379977  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1605) took 1535 ms. Trace:
W20260709 13:01:54.389531  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:54.390023  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.387810  1609 raft_consensus.cc:2393] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:54.396322  3791 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.396327  3883 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:54.381176  3796 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:54.397645  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:54.398316  3707 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:54.398084  3796 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.399226  3707 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.346145  3752 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.382863  3877 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:54.380828  3797 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.381088  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:54.400971  3877 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:54.401513  2363 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:54.402029  3877 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.402772  3797 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.403353  3877 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.405449  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:54.389420  1536 rpcz_store.cc:276] 0709 13:01:52.845079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.845295 (+   216us) service_pool.cc:224] Handling call
0709 13:01:52.845773 (+   478us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:52.846248 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:52.846285 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:52.847000 (+   715us) log.cc:844] Serialized 52 byte log entry
0709 13:01:53.169965 (+322965us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:53.383202 (+213237us) log.cc:844] Serialized 14 byte log entry
0709 13:01:54.379282 (+996080us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b18000e6f20. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287
0709 13:01:54.379455 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:54.379544 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:54.379595 (+    51us) raft_consensus.cc:1685] finished
0709 13:01:54.379702 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:54.379906 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25180,"prepare.queue_time_us":295310,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":237085,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":33804,"spinlock_wait_cycles":69336832,"thread_start_us":645584,"threads_started":3,"wal-append.queue_time_us":305800}
W20260709 13:01:54.418646  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51107.7us
I20260709 13:01:54.354219  3781 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:01:54.360773  3799 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.424081  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.385975  3603 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:54.392095  3829 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:54.434262  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.398159  3791 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:01:54.368249  3820 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.432745  3797 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:01:54.469751  3907 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:01:54.426560  3547 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.475333  3547 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:54.477380  3804 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:54.480954  3707 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.483170  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:54.434264  3735 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:01:54.433974  3770 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:01:54.450796  3790 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:54.432390  3799 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.436172  3829 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.502226  3735 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:54.514122  3735 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:54.516223  3905 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:01:54.517963  3840 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.519698  3792 raft_consensus.cc:3055] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:54.520218  3792 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:54.521159  3792 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.522477  3792 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:54.522657  3799 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:54.525053  3898 log.cc:927] Time spent T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:01:54.527244  1539 raft_consensus.cc:3055] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:54.527637  1539 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:54.527827  3749 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:54.528371  1539 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.557476  3820 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.557992  1539 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.528903  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:54.566198  3840 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:54.569770  1532 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:01:54.570278  1532 pending_rounds.cc:85] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 4
I20260709 13:01:54.570609  1532 pending_rounds.cc:107] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:01:54.570942  1532 raft_consensus.cc:2889] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.541249  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:54.578653  1536 raft_consensus.cc:2368] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5.
W20260709 13:01:54.592026  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.636785  2329 leader_election.cc:400] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5.
I20260709 13:01:54.637431  2329 leader_election.cc:403] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:54.641940  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 61562.4us
I20260709 13:01:54.528344  3749 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.505609  3790 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.540521  3860 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.573365  3819 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.490307  3797 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.157s
I20260709 13:01:54.638110  3781 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:54.668090  2363 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:01:54.647774  3899 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:01:54.647877  3893 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.662338  3790 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:54.669878  3804 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:01:54.695266  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 248113us
I20260709 13:01:54.697039  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.669718  3860 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.699440  1684 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:01:54.700870  3860 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:54.702987  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.709478  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.673389  3819 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.716763  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:54.717667  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:54.681701  3781 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.717666  3912 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:54.708635  3799 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:54.704566  3770 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:54.713101  3820 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:54.728556  1536 pending_rounds.cc:85] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 5
I20260709 13:01:54.885861  1536 pending_rounds.cc:107] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:01:54.886324  1536 raft_consensus.cc:2889] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:54.730675  3919 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:54.697417  3893 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.702862  3804 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.726281  3911 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:54.759268  3876 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.897831  3836 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:54.857319  3819 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.903924  3876 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:54.760797  3883 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:01:54.904851  3877 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.501s	user 0.003s	sys 0.012s
W20260709 13:01:54.907202  3887 consensus_meta.cc:287] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.006s
I20260709 13:01:54.907802  3912 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:54.909373  3912 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.913947  3804 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.722491  3814 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:54.726680  3790 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:54.914729  3821 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.575s	user 0.009s	sys 0.005s
I20260709 13:01:54.766139  3774 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:54.915608  3814 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.916827  3774 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:54.917273  3774 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:54.917508  3893 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.918246  3774 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.919596  3774 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:54.772104  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44682.1us
I20260709 13:01:54.772677  3914 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:54.762037  2365 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 359) took 2309 ms (client timeout 1554 ms). Trace:
I20260709 13:01:54.929970  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:54.720588  3796 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:01:54.901162  3913 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:01:54.769956  3749 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:54.919509  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:54.920200  3790 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.931087  1682 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:54.907894  3887 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.928263  3814 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.896108  3770 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.940218  1690 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:01:54.937614  3914 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.946336  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:54.951946  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:54.949038  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:54.953635  1539 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:54.899528  3781 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:54.959724  3749 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:54.961176  3916 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:54.965341  3916 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:54.965165  3749 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:54.965727  3916 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:54.955158  3796 raft_consensus.cc:697] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:54.936717  3759 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:01:54.962569  3814 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:54.975553  3796 consensus_queue.cc:237] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:54.932473  2365 rpcz_store.cc:269] 0709 13:01:52.452226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.453242 (+  1016us) service_pool.cc:224] Handling call
0709 13:01:54.761770 (+2308528us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54006d1854. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:54.761915 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3333687168}
W20260709 13:01:54.988796  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.982698  3749 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:54.994578  3799 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:54.995244  3799 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:54.997392  3799 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:54.999357  3799 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:54.999944  3799 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.000284  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.003156  1609 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:01:54.981788  3814 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.015722  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.016145  1609 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.017484  1608 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.018985  3887 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:55.020942  2368 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:01:55.024392  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.024843  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1608) took 2158 ms. Trace:
I20260709 13:01:55.015911  1614 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:01:55.025532  1653 connection.cc:256] RPC call timeout handler was delayed by -1.1972817820000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 13:01:55.025393  1540 rpcz_store.cc:276] 0709 13:01:52.866982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.867219 (+   237us) service_pool.cc:224] Handling call
0709 13:01:52.867643 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.364671 (+1497028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.024590 (+659919us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400440cd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:55.024779 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3423807232}
W20260709 13:01:55.031810  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.032852  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:54.993172  3920 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.034909  1690 raft_consensus.cc:1240] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:55.036608  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.037863  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.039258  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.041306  1687 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:55.006891  3829 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.047894  1653 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:55.237339  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 189601us
I20260709 13:01:55.237526  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.238113  1653 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:55.238283  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.238878  1533 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.238960  3809 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:55.239329  1653 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:55.240149  3860 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:55.240309  1683 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:01:55.240710  3860 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:55.241523  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.241675  3860 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.242439  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.061064  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.243333  1535 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:55.050092  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.233716  3921 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.031530  3821 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.244733  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.245188  3921 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.246099  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.217234  3916 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.246716  1538 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.248279  3794 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.248853  3794 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.244227  3883 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:55.249940  3883 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:55.250388  3916 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.250850  3883 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.251160  3920 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.251706  3659 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.238474  1540 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:55.235031  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1653) took 2678 ms. Trace:
I20260709 13:01:55.084389  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.085515  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.031072  3887 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:55.233350  1541 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.179088  3733 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:55.088757  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.178946  3882 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.062341  1614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:57548
W20260709 13:01:55.030755  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 301188us
I20260709 13:01:55.252977  1615 rpcz_store.cc:276] 0709 13:01:52.557125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.557361 (+   236us) service_pool.cc:224] Handling call
0709 13:01:52.557745 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:53.661124 (+1103379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.234610 (+1573486us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003a39d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:55.234905 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2536325504}
I20260709 13:01:55.253358  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.088371  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:55.245359  3821 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.242280  1683 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:55.255473  3868 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.257704  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:37906 (request call id 1602) took 2460 ms. Trace:
I20260709 13:01:55.264448  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.263890  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.256927  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.323819  1614 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:55.085012  1616 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:55.324659  1614 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.178308  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:55.319294  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 80057.2us
I20260709 13:01:55.244288  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.085091  1609 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.255342  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.319746  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.335064  1681 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.025328  3814 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.323724  1541 rpcz_store.cc:276] 0709 13:01:52.797270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.797510 (+   240us) service_pool.cc:224] Handling call
0709 13:01:55.232063 (+2434553us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400440cd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eaffa3d 00007fd033acfcd0 00007fd02d054254 00007fd02d0541e2 00007fd02d054111 00007fd02d05408c 00007fd02d053342 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:55.257604 (+ 25541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3305322240}
W20260709 13:01:55.342262  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 164111us
I20260709 13:01:55.343144  1682 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:55.324457  1538 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
W20260709 13:01:55.331357  1653 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:38365 timed out after 1.673s (SENT) [suppressed 51 similar messages]
I20260709 13:01:55.326964  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:55.348845  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.349841  1540 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:01:55.066769  1689 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.354136  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.333451  1612 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:55.355098  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.014482  3799 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.326740  1535 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:55.253520  3920 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.337929  1533 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:55.259137  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.363270  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:55.223106  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.324730  1690 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:55.319746  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.343447  1686 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:55.364521  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.365653  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.366250  1688 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:55.367023  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.367523  1688 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:55.086277  3770 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.372881  1533 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:01:55.373345  1533 pending_rounds.cc:85] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 4
I20260709 13:01:55.373767  1533 pending_rounds.cc:107] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:01:55.374187  1533 raft_consensus.cc:2889] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:55.377563  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.355965  1538 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
W20260709 13:01:55.356832  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.357306  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:55.191146  3899 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5.
I20260709 13:01:55.321244  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:55.248862  3921 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.359359  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.197975  3892 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:55.390796  1681 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:55.090219  3914 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.397224  3703 raft_consensus.cc:3055] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:55.397734  3703 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:55.398875  3925 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:01:55.402071  3735 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.086371  3877 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.080452  3912 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.409281  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:55.094285  2369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 363) took 2259 ms (client timeout 1673 ms). Trace:
I20260709 13:01:55.257889  3816 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.251988  3794 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.239360  3809 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:55.368650  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.364647  1541 raft_consensus.cc:2410] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:55.202737  3815 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.155s
I20260709 13:01:55.369123  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.371328  1614 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.259791  3733 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.390805  3851 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.360733  1685 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.426131  1685 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:55.362869  3774 consensus_queue.cc:1059] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:01:55.356446  3797 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:01:55.392086  1687 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.204105  3876 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 13:01:55.433478  1683 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:55.354766  3670 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:01:55.394927  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.395018  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.262468  3882 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.341529  3829 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.391780  2329 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:01:55.443347  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51693.4us
W20260709 13:01:55.412734  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:55.410209  2369 rpcz_store.cc:269] 0709 13:01:52.834827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.834961 (+   134us) service_pool.cc:224] Handling call
0709 13:01:55.094058 (+2259097us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001a6b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:55.094199 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410396544}
I20260709 13:01:55.258383  3887 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.356647  3911 consensus_queue.cc:1059] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:01:55.385937  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:55.445899  1615 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.446494  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:55.362427  3810 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:01:55.472527  3774 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.358336  3749 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.427331  1685 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.413277  3868 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:55.423897  3809 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:55.451139  1681 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.453953  3733 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.455067  2368 raft_consensus.cc:2393] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:55.455353  1614 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.457307  3882 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.457736  3829 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:55.460505  3887 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.460600  3876 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:55.461442  3911 raft_consensus.cc:3055] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:01:55.463426  2366 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:55.464016  3852 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.464561  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1555) took 2297 ms. Trace:
I20260709 13:01:55.464797  1534 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:01:55.515630  1537 rpcz_store.cc:276] 0709 13:01:53.167504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.168464 (+   960us) service_pool.cc:224] Handling call
0709 13:01:55.464351 (+2295887us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b54000fbed4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:55.464485 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675690624}
I20260709 13:01:55.465994  1540 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:01:55.517545  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.467306  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.468140  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.468762  3771 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.470527  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:55.422412  3794 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.472065  3863 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:55.473032  3774 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.420503  3912 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.512080  3876 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:55.416843  3892 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:55.482437  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 74282.5us
I20260709 13:01:55.515364  3821 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:55.478047  1539 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
W20260709 13:01:55.483305  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 152002us
I20260709 13:01:55.484329  1685 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.491430  1615 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:01:55.547796  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.418161  3877 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.549252  1615 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.550429  1615 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.550953  1532 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:01:55.553277  1537 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.440349  3670 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.514351  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1415) took 1155 ms. Trace:
I20260709 13:01:55.551842  1615 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:01:55.518867  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.520300  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.524519  2370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46612 (request call id 171) took 2731 ms. Trace:
I20260709 13:01:55.556078  1612 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:01:55.524729  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:55.529140  2369 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:55.511502  3816 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:55.534729  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:55.481814  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.558440  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.558959  1616 raft_consensus.cc:2393] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:55.512609  3911 raft_consensus.cc:740] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:55.494563  3868 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:55.472307  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 144907us
I20260709 13:01:55.508098  3434 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:01:55.557420  1611 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:55.565030  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.565771  1538 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:55.553566  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.566632  1686 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:55.566701  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.557888  1579 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:55.567369  1681 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:55.552690  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.560433  1537 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.568207  1687 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:01:55.556170  2370 rpcz_store.cc:276] 0709 13:01:52.788531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:52.788653 (+   122us) service_pool.cc:224] Handling call
0709 13:01:52.788925 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:54.246884 (+1457959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.519376 (+1272492us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54004dd5d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:55.519551 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3305650048}
I20260709 13:01:55.569082  1533 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:55.569420  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.562263  1615 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:01:55.562587  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.570344  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.563864  1580 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:55.570899  1533 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.564477  1684 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:55.564711  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.571725  1541 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:55.567246  1614 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:55.572749  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:55.573273  2371 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.573880  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.574054  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:55.555440  2365 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:55.563709  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.575002  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.578215  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.578549  1688 raft_consensus.cc:2410] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:55.578810  1537 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:55.579180  3914 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.580884  3815 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.581377  3815 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.554028  1610 rpcz_store.cc:276] 0709 13:01:54.358838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.358943 (+   105us) service_pool.cc:224] Handling call
0709 13:01:54.359208 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.573828 (+214620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.573860 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:54.640736 (+ 66876us) log.cc:844] Serialized 26 byte log entry
0709 13:01:54.714451 (+ 73715us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:54.714504 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.506794 (+792290us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400226ad4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:55.506868 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:55.506937 (+    69us) raft_consensus.cc:1685] finished
0709 13:01:55.506958 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.514258 (+  7300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1897,"raft.queue_time_us":23019,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"spinlock_wait_cycles":296591488,"thread_start_us":117339,"threads_started":2,"wal-append.queue_time_us":53153}
I20260709 13:01:55.546552  3852 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:55.539973  3794 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.576318  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.576567  3735 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:01:55.575789  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.575693  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.531204  3771 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.540580  3873 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:01:55.552570  3840 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.593413  2368 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:01:55.557451  3670 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:55.552276  3887 consensus_queue.cc:1059] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:01:55.594579  2371 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:55.541430  3863 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.575711  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:55.576016  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:55.666091  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 90157us
I20260709 13:01:55.669441  1614 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:55.630584  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:55.617122  2370 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.657321  1533 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:01:55.661967  1686 raft_consensus.cc:3055] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:55.664002  1610 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:01:55.662086  1541 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:55.670723  1614 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:55.611860  1579 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:55.676110  2369 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:55.672734  1686 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:55.593484  3914 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:55.718266  3863 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.710117  1610 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:55.718743  3914 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.670184  3920 consensus_queue.cc:1059] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:01:55.720664  3920 raft_consensus.cc:3055] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:55.720957  3930 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.327s	user 0.004s	sys 0.000s
I20260709 13:01:55.721131  3920 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:55.619350  3911 consensus_queue.cc:260] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.623433  3868 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.619556  3876 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.727028  1612 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.722208  3920 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.709120  3733 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:01:55.713009  3771 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.618854  3912 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.750916  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.717669  3810 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.751649  3860 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:55.752216  3860 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:55.751857  3810 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.754187  3810 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.754748  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.751770  1612 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:55.619457  3852 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.758085  3852 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.758718  1538 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.728806  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.762161  2370 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:55.677343  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:55.573553  3814 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.690146  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.765293  1540 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:01:55.685564  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:55.767016  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.682914  1541 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:55.734980  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:55.736225  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 59949us
I20260709 13:01:55.577927  3797 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.617854  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.618204  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:01:55.744550  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 168920us
I20260709 13:01:55.779506  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:55.779706  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:55.744663  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 132906us
I20260709 13:01:55.781605  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.782090  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:55.782516  1616 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:55.736162  1686 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.784281  1686 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:55.620694  3877 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:55.625253  3892 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.747227  3876 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.747365  3790 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:55.617192  3774 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:55.747934  3836 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:55.748433  3794 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.749805  3809 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.678323  3882 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:55.717831  3703 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.622382  3829 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:55.729205  1610 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:01:55.677752  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:55.771246  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.771454  1535 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:55.769742  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:55.785959  1538 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:55.787292  1579 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:55.788470  1533 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:01:55.790844  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:55.790982  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:55.794019  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1389) took 2714 ms. Trace:
I20260709 13:01:55.922828  1616 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:01:55.676434  3840 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.810019  1653 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:55.923576  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 132693us
I20260709 13:01:55.817150  1686 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:55.924685  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:55.926039  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:55.806772  3797 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:55.897639  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 118065us
I20260709 13:01:55.940013  3797 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.898371  3771 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.943559  3771 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:55.808898  3920 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.946405  3771 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:55.947232  3912 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.947789  3912 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.948251  3912 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:55.952343  3799 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:01:55.954382  3799 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:55.898993  3659 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:55.956840  3659 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:55.958102  3659 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:55.806684  3790 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:55.901675  1612 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:55.960655  3790 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:55.914891  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.923265  1685 rpcz_store.cc:276] 0709 13:01:53.079768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.079911 (+   143us) service_pool.cc:224] Handling call
0709 13:01:53.080312 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.360640 (+2280328us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540035d2a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7fdc0 00007fd02eb0a1c0 00007fd02eb0b231 00007fd02eb07d8f 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c
0709 13:01:55.789803 (+429163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.789834 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:55.789873 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:55.789911 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.793802 (+  3891us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:55.793955 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5045,"raft.queue_time_us":28923,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":1343078656,"thread_start_us":223127,"threads_started":1}
I20260709 13:01:55.745308  3932 consensus_queue.cc:1059] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
W20260709 13:01:55.902364  3856 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:01:55.900457  3887 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.930109  1689 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:01:55.932621  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 145409us
W20260709 13:01:55.936442  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:55.986970  1579 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:55.938530  3840 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:55.924436  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 114511us
I20260709 13:01:55.994269  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.995112  1686 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:55.797092  3755 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:55.900919  3892 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:55.900271  3836 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:55.929945  3809 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:55.929966  3749 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:55.986392  1540 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:55.990969  1579 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:56.021054  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.022013  1682 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:55.996189  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.996897  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:55.975924  2365 raft_consensus.cc:2393] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:01:55.797245  3781 consensus_queue.cc:1059] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.179s
I20260709 13:01:56.004810  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:55.986223  3887 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:56.008389  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:56.010473  1539 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:01:56.024063  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.997886  3932 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.020725  3829 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.005523  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.038682  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:55.918898  3774 consensus_queue.cc:1059] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:01:56.028090  1616 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.039471  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:56.000650  3799 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:56.001483  3755 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:56.012203  3770 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.025856  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.036515  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:56.054630  1686 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.037204  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.019434  3840 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:56.001003  3735 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.040652  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.016911  3882 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.016736  3836 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.042735  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.028159  3921 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:56.064246  1532 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:01:56.082402  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:56.119292  1610 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.036170  3887 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.044330  3799 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.056495  3755 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.038241  3932 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:56.016422  3892 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.114929  3774 consensus_queue.cc:1243] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer 9d926c10b90f452ba52d80dab6a50351 log is divergent from this leader: its last log entry 3.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:56.036485  3873 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 13:01:56.135329  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:56.091611  3939 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:01:56.141248  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 723739us
I20260709 13:01:56.145213  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1572) took 2525 ms. Trace:
I20260709 13:01:56.053851  1683 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:01:56.160292  1534 rpcz_store.cc:276] 0709 13:01:53.619986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:53.979286 (+359300us) service_pool.cc:224] Handling call
0709 13:01:55.464490 (+1485204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.515744 (+ 51254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.144971 (+629227us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000fbed0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:56.145147 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3414355840}
I20260709 13:01:56.164335  3815 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:56.166926  3911 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:01:56.168169  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.168427  3821 raft_consensus.cc:3055] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:56.168759  3821 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:56.169199  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.169936  1609 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:56.169603  3821 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.133818  3749 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.143746  3799 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.057462  3829 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.175928  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.148365  3932 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.084513  3770 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.157425  3809 raft_consensus.cc:3055] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:56.119982  3882 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:56.230404  1505 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.030s	sys 0.034s
W20260709 13:01:56.230893  1505 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.030s	sys 0.034s
W20260709 13:01:56.231248  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 578819us
I20260709 13:01:56.192343  1610 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:56.111315  3735 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.173067  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:56.207113  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.262653  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 89740.2us
I20260709 13:01:56.182945  1616 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:01:56.160576  3939 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.260288  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.201408  3749 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.211938  3809 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:56.279145  3809 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.280912  3809 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:56.157460  3940 consensus_queue.cc:1059] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:01:56.292198  1534 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:56.285712  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:56.300977  1609 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.287778  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.287500  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.295650  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.300145  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.285773  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.290553  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.304797  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.306842  1541 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:56.308746  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.306461  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.309605  1610 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:01:56.309907  1616 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:01:56.314146  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.314743  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.314917  1539 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:56.311331  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.314894  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.318174  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.311058  1689 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:01:56.318801  1541 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:01:56.257490  1686 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:01:56.321187  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.322218  1533 raft_consensus.cc:1240] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 1. Current term is 2. Ops: []
I20260709 13:01:56.323252  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:56.283362  3914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.002s	sys 0.035s
W20260709 13:01:56.284776  3936 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:01:56.407083  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.285844  3821 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:01:56.578709  3816 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:56.579234  3816 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:56.333668  3921 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.247s
I20260709 13:01:56.581692  3921 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.582177  3921 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.334124  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:56.478910  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.034s
W20260709 13:01:56.585813  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.008s	sys 0.045s
I20260709 13:01:56.585886  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:56.586083  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 619417us
I20260709 13:01:56.586944  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.589120  1654 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:56.333640  1541 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:01:56.468945  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.393184  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.373984  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.594851  1616 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:56.596856  1616 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:01:56.259089  3919 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.587697  3856 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:56.269465  3939 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:56.637346  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.638386  1538 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:56.636234  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.650364  1532 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:56.653534  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.655484  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.660454  1532 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:01:56.540014  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.012s
W20260709 13:01:56.693789  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.011s	sys 0.012s
I20260709 13:01:56.694855  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:56.695585  2368 raft_consensus.cc:2376] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3. Re-sending same reply.
I20260709 13:01:56.337592  1688 raft_consensus.cc:2393] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 2: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:56.696516  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:56.697229  2366 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:01:56.697427  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.448204  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.698002  3938 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:01:56.324350  1533 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:56.286791  3771 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:56.698951  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.700021  1533 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:56.388957  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:01:56.604583  2329 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.017s
W20260709 13:01:56.702775  2329 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.006s	sys 0.017s
I20260709 13:01:56.614544  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1610) took 1571 ms. Trace:
W20260709 13:01:56.615451  1684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.036s	sys 0.070s
I20260709 13:01:56.615741  1681 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:56.614614  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:56.703195  1689 rpcz_store.cc:276] 0709 13:01:55.043342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.359600 (+316258us) service_pool.cc:224] Handling call
0709 13:01:56.614322 (+1254722us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54002d6c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:56.614477 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268989824}
W20260709 13:01:56.703876  1684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.036s	sys 0.071s
W20260709 13:01:56.679878  3920 consensus_meta.cc:287] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.735s	user 0.006s	sys 0.003s
W20260709 13:01:56.604130  3914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.011s	sys 0.038s
I20260709 13:01:56.461948  3749 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:56.467434  1613 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:56.613303  3815 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:56.628587  1690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.013s	sys 0.050s
I20260709 13:01:56.334602  3940 consensus_queue.cc:1243] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer c98c328741aa493d87abafbf08f04944 log is divergent from this leader: its last log entry 3.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:01:56.535894  3794 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:01:56.628208  3921 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:56.665488  1685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.024s	sys 0.056s
I20260709 13:01:56.599756  3877 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:01:56.619977  3774 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:56.661183  1538 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:01:56.698539  3938 raft_consensus.cc:697] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:56.606500  3799 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.676134  3829 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:56.702607  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:56.754822  2367 raft_consensus.cc:2368] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7.
I20260709 13:01:56.704535  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.755885  1689 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
W20260709 13:01:56.705133  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 657616us
I20260709 13:01:56.480396  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.610646  1609 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:01:56.759497  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1629) took 1210 ms. Trace:
I20260709 13:01:56.759904  1681 rpcz_store.cc:276] 0709 13:01:55.548857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.568060 (+ 19203us) service_pool.cc:224] Handling call
0709 13:01:56.615297 (+1047237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.703646 (+ 88349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.759291 (+ 55645us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002d6c50. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:56.759429 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2382237056}
W20260709 13:01:56.694324  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 672087us
I20260709 13:01:56.763206  1579 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:56.296720  3814 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:56.709317  3863 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:56.670360  3892 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:56.784842  3892 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:56.604627  1686 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:56.785760  3892 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:56.787763  1686 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:01:56.788200  3892 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:56.785763  3814 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:01:56.711423  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.792263  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.793105  1539 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:56.631850  3919 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:56.713434  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:56.714280  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.714794  1607 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.000s	sys 0.013s
W20260709 13:01:56.710896  3840 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.004s	sys 0.008s
W20260709 13:01:56.698408  3790 consensus_meta.cc:287] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.737s	user 0.012s	sys 0.000s
I20260709 13:01:56.731763  1683 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:01:56.732362  1690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.013s	sys 0.050s
I20260709 13:01:56.669364  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 246) took 1941 ms. Trace:
I20260709 13:01:56.808502  1536 rpcz_store.cc:276] 0709 13:01:54.727804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:54.727954 (+   150us) service_pool.cc:224] Handling call
0709 13:01:54.728356 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:54.887128 (+158772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:54.887182 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.515726 (+628544us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b2c00000f48. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:01:55.516133 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:01:55.764968 (+248835us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:55.765011 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:55.765110 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.662240 (+897130us) raft_consensus.cc:1685] finished
0709 13:01:56.662264 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.669287 (+  7023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9060096,"thread_start_us":248544,"threads_started":1,"wal-append.queue_time_us":603458}
W20260709 13:01:56.739895  1685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.024s	sys 0.056s
I20260709 13:01:56.698714  3882 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:56.746588  1534 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:56.747802  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.026s	sys 0.069s
W20260709 13:01:56.813079  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.027s	sys 0.069s
W20260709 13:01:56.813514  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.731760  3821 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:56.795951  1682 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:01:56.796422  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.796391  1607 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.000s	sys 0.013s
I20260709 13:01:56.821498  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1687) took 1080 ms. Trace:
I20260709 13:01:56.713528  3770 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:56.745850  3876 consensus_meta.cc:287] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.851s	user 0.013s	sys 0.000s
W20260709 13:01:56.814334  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:56.802771  3840 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.004s	sys 0.009s
W20260709 13:01:56.815825  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:56.817355  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.818542  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.832418  1689 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:01:56.833324  1683 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:01:56.833606  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:56.822331  1579 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:56.710773  3659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.004s	sys 0.010s
I20260709 13:01:56.698700  3860 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:56.829996  2328 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.007s	sys 0.017s
W20260709 13:01:56.837610  2328 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.007s	sys 0.017s
W20260709 13:01:56.837967  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 574023us
I20260709 13:01:56.805649  3920 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:56.742362  3749 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:01:56.850869  1653 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:01:56.847470  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:56.852103  1682 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:01:56.800092  3735 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:56.844550  1579 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:56.856398  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.857481  1608 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:56.741111  3815 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.860661  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
W20260709 13:01:56.837154  3659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.004s	sys 0.010s
I20260709 13:01:56.865598  1689 raft_consensus.cc:606] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:56.871122  1689 raft_consensus.cc:614] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:56.868001  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:56.754066  3774 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.818437  3883 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:56.836709  3703 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:56.851092  3670 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.174s	user 0.014s	sys 0.000s
W20260709 13:01:56.875622  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.003s	sys 0.015s
W20260709 13:01:56.888353  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 471912us
I20260709 13:01:56.842353  3863 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.877095  1653 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:56.839082  3840 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:56.883667  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:56.891433  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:56.862211  1435 catalog_manager.cc:5697] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:56.817559  3797 consensus_queue.cc:1059] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:01:56.848361  3829 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:56.864717  3921 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:56.822897  3790 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.911019  1653 leader_election.cc:400] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7.
I20260709 13:01:56.918413  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:56.830981  3821 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:56.902458  3941 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:01:56.922003  1653 leader_election.cc:403] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:01:56.841431  3770 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:01:56.945366  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:56.946331  1536 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:01:56.947451  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:56.948956  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:56.926056  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:56.957736  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:56.959399  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:56.964201  1536 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:01:56.994567  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.018s	sys 0.035s
W20260709 13:01:56.914391  3932 consensus_meta.cc:287] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 13:01:56.908335  3735 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:56.879484  3948 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:01:56.995528  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 77964.6us
I20260709 13:01:57.002106  1579 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:56.898743  3920 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:56.933555  1535 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.045s
I20260709 13:01:56.901080  3882 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:56.998481  1610 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:01:57.005333  1535 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.013s	sys 0.046s
W20260709 13:01:57.006494  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.003s	sys 0.015s
I20260709 13:01:56.919181  3877 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:56.938910  3797 raft_consensus.cc:3055] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:56.916735  3937 raft_consensus.cc:3055] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:01:56.932862  3486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.010s	sys 0.014s
I20260709 13:01:56.916646  3950 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:56.912982  3670 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:56.996493  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.018s	sys 0.035s
I20260709 13:01:56.926784  3794 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:56.916528  3863 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:56.918944  3952 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:56.890031  3883 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.024935  2329 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:57.026479  1536 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:01:56.917035  3921 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.027503  1533 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:01:57.014241  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.003s	sys 0.015s
I20260709 13:01:57.003715  3735 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:57.016690  3486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.010s	sys 0.014s
I20260709 13:01:57.018164  3937 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:56.924465  3829 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.042999  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:57.047659  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 223) took 1848 ms. Trace:
W20260709 13:01:57.048107  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.004s	sys 0.015s
I20260709 13:01:57.011929  3797 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:01:57.040026  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 338920us
I20260709 13:01:56.923458  3938 consensus_queue.cc:237] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.011406  3882 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.005126  3932 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:57.198240  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.141100  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.017570  3957 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:57.201720  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 478779us
W20260709 13:01:57.047820  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 208691us
I20260709 13:01:56.821877  1607 rpcz_store.cc:276] 0709 13:01:55.741612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.741778 (+   166us) service_pool.cc:224] Handling call
0709 13:01:55.742131 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.745096 (+  2965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.745136 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.745694 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.056578 (+310884us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:56.820929 (+764351us) log.cc:844] Serialized 14 byte log entry
0709 13:01:56.821185 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.821263 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:56.821299 (+    36us) raft_consensus.cc:1685] finished
0709 13:01:56.821309 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:56.821440 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2513,"raft.queue_time_us":8631,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":1074430,"threads_started":2,"wal-append.queue_time_us":875351}
W20260709 13:01:57.191809  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 232505us
I20260709 13:01:57.051585  1616 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:01:57.206161  1611 rpcz_store.cc:276] 0709 13:01:55.199651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.573711 (+374060us) service_pool.cc:224] Handling call
0709 13:01:55.574012 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.574372 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.574400 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.574846 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.083334 (+508488us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:56.083390 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.083494 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.047391 (+963897us) raft_consensus.cc:1685] finished
0709 13:01:57.047418 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.047584 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71360,"raft.queue_time_us":3544,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1936,"thread_start_us":470877,"threads_started":1,"wal-append.queue_time_us":1035321}
I20260709 13:01:57.206073  1504 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:57.215314  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1640) took 1480 ms. Trace:
I20260709 13:01:57.233464  1537 rpcz_store.cc:276] 0709 13:01:55.734899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.736321 (+  1422us) service_pool.cc:224] Handling call
0709 13:01:55.736638 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:55.736868 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:56.045137 (+308269us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.214847 (+1169710us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.214905 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:57.214951 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.215032 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.215234 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":913340,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":3943,"thread_start_us":1471026,"threads_started":3}
W20260709 13:01:57.103542  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 192724us
I20260709 13:01:57.033890  3794 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.206064  1608 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:01:57.033215  3876 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:57.161026  3958 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:01:57.156922  3951 log.cc:927] Time spent T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:01:57.159876  3887 consensus_meta.cc:287] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.011s	user 0.008s	sys 0.003s
W20260709 13:01:57.241995  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.156998  3942 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:01:57.271550  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.038870  3856 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7.
W20260709 13:01:57.163157  3949 log.cc:927] Time spent T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:01:57.033105  3771 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:57.038727  3952 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:57.167402  3953 log.cc:927] Time spent T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 13:01:57.289260  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 264409us
I20260709 13:01:57.232203  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:57.263532  3877 raft_consensus.cc:697] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:01:57.216547  3755 consensus_meta.cc:287] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.060s	user 0.009s	sys 0.005s
I20260709 13:01:57.268520  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:57.270328  3970 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.040298  3956 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.041815  3967 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:57.276352  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 269149us
I20260709 13:01:57.285838  3981 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:01:57.158052  3873 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.156052  3799 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.051672  3921 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.270680  3876 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.217500  3735 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.286813  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:57.241384  3794 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.250761  3774 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:57.272214  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.283998  3887 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.310379  1532 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:57.281203  3964 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.320104  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.098925  3914 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.160537  3920 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.289503  3952 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:57.044487  3840 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.288486  3960 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:01:57.380103  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 148102us
W20260709 13:01:57.381019  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 175101us
I20260709 13:01:57.153331  3974 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.404862  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1396) took 1412 ms. Trace:
I20260709 13:01:57.451937  1685 rpcz_store.cc:276] 0709 13:01:55.992932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.993134 (+   202us) service_pool.cc:224] Handling call
0709 13:01:55.993581 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.994050 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.994091 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.994692 (+   601us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.810763 (+816071us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:56.810831 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.810933 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.404581 (+593648us) raft_consensus.cc:1685] finished
0709 13:01:57.404608 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.404789 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42003,"raft.queue_time_us":144074,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":5896,"thread_start_us":800301,"threads_started":1,"wal-append.queue_time_us":985986}
I20260709 13:01:57.296064  3486 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:57.405905  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1633) took 1856 ms. Trace:
I20260709 13:01:57.408674  1683 raft_consensus.cc:2410] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:01:57.370995  3912 consensus_meta.cc:287] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.422s	user 0.015s	sys 0.001s
I20260709 13:01:57.418218  3774 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:01:57.406443  1534 consensus_meta.cc:287] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.588s	user 0.016s	sys 0.000s
I20260709 13:01:57.370004  3790 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.354420  3670 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.373769  3856 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:57.368672  3956 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.272096  3957 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.307600  3755 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.451678  1504 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:57.462858  3821 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.457940  3796 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:57.410974  3981 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:57.416527  3815 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.460552  1684 rpcz_store.cc:276] 0709 13:01:55.549864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.579918 (+ 30054us) service_pool.cc:224] Handling call
0709 13:01:55.580283 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:55.774465 (+194182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:55.774514 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:55.787070 (+ 12556us) log.cc:844] Serialized 26 byte log entry
0709 13:01:56.704306 (+917236us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:56.704346 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.704421 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.405596 (+701175us) raft_consensus.cc:1685] finished
0709 13:01:57.405624 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.405818 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9992,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":69,"thread_start_us":917419,"threads_started":2,"wal-append.queue_time_us":959490}
W20260709 13:01:57.542040  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 91178.8us
W20260709 13:01:57.414857  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.337160  3970 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.334591  3797 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:57.461210  3966 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:01:57.553682  1689 raft_consensus.cc:2410] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:01:57.449267  3659 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:01:57.492997  3965 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 13:01:57.494674  3836 consensus_meta.cc:287] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.352s	user 0.004s	sys 0.010s
I20260709 13:01:57.495352  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:57.579773  3939 consensus_meta.cc:287] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.922s	user 0.010s	sys 0.000s
I20260709 13:01:57.474277  3774 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.496660  3882 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.474499  3980 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:57.450119  3960 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:01:57.336997  3937 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:57.409509  3873 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:57.415467  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 162966us
I20260709 13:01:57.419580  3964 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.460510  3486 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:57.511462  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 66379.6us
I20260709 13:01:57.470719  3877 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:57.453059  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 98744.1us
I20260709 13:01:57.601747  2328 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:57.625036  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:57.624013  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 80620.7us
W20260709 13:01:57.525295  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 228774us
I20260709 13:01:57.497714  3969 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:57.421379  3914 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.469753  3983 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.498175  3816 consensus_meta.cc:287] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.919s	user 0.014s	sys 0.000s
I20260709 13:01:57.510918  3790 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.510779  4006 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.462657  3771 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.549603  3755 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.549860  3932 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:57.550923  3703 consensus_meta.cc:287] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.003s
I20260709 13:01:57.451684  3974 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.551446  3956 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.562646  1684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "469f8c03f4924f809435141a09c976fa"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
W20260709 13:01:57.563732  3962 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:01:57.541642  3781 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:57.564585  3977 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:01:57.564872  3981 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.624205  3486 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.567216  3952 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.568985  3797 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.571023  3919 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.571851  3892 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:57.573119  4002 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:01:57.573705  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1609) took 1158 ms. Trace:
I20260709 13:01:57.574476  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1589) took 1276 ms. Trace:
I20260709 13:01:57.579952  1683 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:01:57.419795  3978 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:01:57.579515  3836 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.580602  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1422) took 1575 ms. Trace:
I20260709 13:01:57.534330  3796 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:57.558460  3976 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:57.690724  3976 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.691311  3976 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.647584  3996 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:57.692349  3996 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.692752  3996 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.584235  3883 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.471199  3912 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.698017  3912 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.698415  3887 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.584875  3959 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:01:57.699345  3989 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:57.522413  3856 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.688321  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1420) took 1053 ms. Trace:
I20260709 13:01:57.701913  3856 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.700852  1681 rpcz_store.cc:276] 0709 13:01:56.635044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.795181 (+160137us) service_pool.cc:224] Handling call
0709 13:01:56.797854 (+  2673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.920680 (+122826us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:57.258493 (+337813us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.605513 (+347020us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.605573 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:57.605626 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.687346 (+ 81720us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b18002bc060. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419
0709 13:01:57.688090 (+   744us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54003a4b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:57.688133 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.688260 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":548716,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":137,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":10812,"spinlock_wait_cycles":298209024,"thread_start_us":610253,"threads_started":2,"wal-append.queue_time_us":386782}
I20260709 13:01:57.555169  3829 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:57.611819  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.704867  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.666555  3735 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.627125  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:01:57.597129  3863 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:57.615468  3911 consensus_meta.cc:287] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.448s	user 0.010s	sys 0.003s
I20260709 13:01:57.596802  3960 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:57.638770  3770 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:01:57.645119  3790 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.644404  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:57.567140  3970 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.649288  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:57.729434  1608 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:01:57.649940  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:57.650408  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1403) took 1655 ms. Trace:
W20260709 13:01:57.704160  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:57.733348  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.732616  1687 rpcz_store.cc:276] 0709 13:01:55.995372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.587756 (+592384us) service_pool.cc:224] Handling call
0709 13:01:56.595796 (+  8040us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.596937 (+  1141us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:57.013472 (+416535us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.263959 (+250487us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.264584 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.264763 (+   179us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:57.264803 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.264880 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.650191 (+385311us) raft_consensus.cc:1685] finished
0709 13:01:57.650208 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.650334 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":859074,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2542,"raft.queue_time_us":44574,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":39657,"thread_start_us":621748,"threads_started":2,"wal-append.queue_time_us":585683}
I20260709 13:01:57.654644  3914 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.655225  3950 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.739153  3790 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.739283  3950 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.739760  3911 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:57.664011  3957 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.649685  3816 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.741856  2368 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:57.736902  3770 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.743054  3816 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.656442  1684 raft_consensus.cc:606] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:57.744946  1684 raft_consensus.cc:614] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:57.746528  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:57.665081  3794 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.743225  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:57.657384  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1399) took 1663 ms. Trace:
I20260709 13:01:57.661938  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1423) took 1004 ms. Trace:
I20260709 13:01:57.755429  1686 rpcz_store.cc:276] 0709 13:01:56.657975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.788836 (+130861us) service_pool.cc:224] Handling call
0709 13:01:56.789270 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.789778 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.789823 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.790479 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.201189 (+410710us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:57.201234 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.201337 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.661649 (+460312us) raft_consensus.cc:1685] finished
0709 13:01:57.661687 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.661858 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9891,"raft.queue_time_us":7694,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":12061,"thread_start_us":410193,"threads_started":1,"wal-append.queue_time_us":546053}
I20260709 13:01:57.659154  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1603) took 1310 ms. Trace:
I20260709 13:01:57.666672  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1608) took 1316 ms. Trace:
I20260709 13:01:57.760555  1533 rpcz_store.cc:276] 0709 13:01:56.349958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.704645 (+354687us) service_pool.cc:224] Handling call
0709 13:01:56.704886 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.027370 (+322484us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:01:57.241739 (+214369us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.604432 (+362693us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.607261 (+  2829us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.607987 (+   726us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:57.608050 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.608135 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.666436 (+ 58301us) raft_consensus.cc:1685] finished
0709 13:01:57.666464 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.666609 (+   145us) inbound_call.cc:177] Queueing success response
0709 13:01:57.690016 (+ 23407us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b1800399ee0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
Metrics: {"mutex_wait_us":7228,"raft.queue_time_us":229182,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":14505,"spinlock_wait_cycles":5850368,"thread_start_us":676947,"threads_started":3,"wal-append.queue_time_us":302742}
W20260709 13:01:57.677213  3961 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:01:57.677604  4002 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.642486  3994 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:01:57.677623  1541 rpcz_store.cc:276] 0709 13:01:56.415692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.705650 (+289958us) service_pool.cc:224] Handling call
0709 13:01:56.705900 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.202063 (+496163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.202106 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.202929 (+   823us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.277577 (+ 74648us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:57.277631 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.277729 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.573448 (+295719us) raft_consensus.cc:1685] finished
0709 13:01:57.573472 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.573631 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112024,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":13015,"thread_start_us":499004,"threads_started":2,"wal-append.queue_time_us":322314}
I20260709 13:01:57.677739  1540 rpcz_store.cc:276] 0709 13:01:56.297778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.297910 (+   132us) service_pool.cc:224] Handling call
0709 13:01:56.298297 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:56.298817 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.298856 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:56.316815 (+ 17959us) log.cc:844] Serialized 52 byte log entry
0709 13:01:56.880886 (+564071us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:01:56.880944 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:56.881044 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.574130 (+693086us) raft_consensus.cc:1685] finished
0709 13:01:57.574168 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.574401 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":698,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":26530,"thread_start_us":406732,"threads_started":1,"wal-append.queue_time_us":759244}
I20260709 13:01:57.647938  4006 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.688319  3836 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.689178  3796 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.552915  4001 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:57.703099  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:57.683571  1614 rpcz_store.cc:276] 0709 13:01:56.004797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.004939 (+   142us) service_pool.cc:224] Handling call
0709 13:01:56.005258 (+   319us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:01:56.005653 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.005682 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:01:56.006460 (+   778us) log.cc:844] Serialized 78 byte log entry
0709 13:01:56.450955 (+444495us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b18003807a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:01:57.031448 (+580493us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:57.260280 (+228832us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.294096 (+ 33816us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.435267 (+141171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.435387 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.580346 (+144959us) raft_consensus.cc:1685] finished
0709 13:01:57.580369 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.580522 (+   153us) inbound_call.cc:177] Queueing success response
0709 13:01:57.583623 (+  3101us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b18003807a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b522 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
Metrics: {"prepare.queue_time_us":364618,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":440955,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":8855,"spinlock_wait_cycles":18046208,"thread_start_us":914471,"threads_started":4,"wal-append.queue_time_us":1112154}
I20260709 13:01:57.755358  1690 rpcz_store.cc:276] 0709 13:01:55.994154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.996311 (+  2157us) service_pool.cc:224] Handling call
0709 13:01:55.996616 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.807888 (+811272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.807935 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.821165 (+ 13230us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.082365 (+261200us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:57.082425 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.082540 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.657132 (+574592us) raft_consensus.cc:1685] finished
0709 13:01:57.657155 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.657318 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5590,"raft.queue_time_us":155219,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":22242,"thread_start_us":1023696,"threads_started":2,"wal-append.queue_time_us":813654}
I20260709 13:01:57.657225  3781 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:57.657056  3974 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.719882  3829 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:57.612478  3980 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.782227  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:57.734707  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1427) took 1728 ms. Trace:
I20260709 13:01:57.749743  3873 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.595060  3939 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.824190  2368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 376) took 1116 ms. Trace:
I20260709 13:01:57.824584  2368 rpcz_store.cc:276] 0709 13:01:56.707598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.710320 (+  2722us) service_pool.cc:224] Handling call
0709 13:01:56.710615 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:57.742352 (+1031737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.823904 (+ 81552us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006d1854. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:57.824122 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2371259776}
I20260709 13:01:57.825546  3939 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.826874  3735 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.826692  3976 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.751739  3952 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:57.662331  3983 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.754019  1681 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:01:57.774745  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:57.782980  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:57.835636  1681 pending_rounds.cc:85] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 2
I20260709 13:01:57.836400  1681 pending_rounds.cc:107] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:01:57.836290  1689 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:57.836951  1681 raft_consensus.cc:2889] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:57.787835  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:57.708686  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:57.795904  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:57.795972  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 92968.6us
I20260709 13:01:57.743060  3770 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.799223  3816 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:57.844988  3770 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.799691  3774 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:57.781741  3790 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:01:57.799860  4001 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.787910  4002 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:57.781116  3957 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.800518  3860 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:57.858390  3957 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.859202  4006 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.803037  3950 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:57.862628  4001 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:57.769444  3911 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:57.749941  3794 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.658561  3964 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.794973  3994 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:57.822409  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:57.823640  3863 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:57.844816  3976 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:57.799335  3796 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:57.845353  3816 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.842147  3829 raft_consensus.cc:697] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:01:57.794010  3960 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.835632  3939 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:01:57.846577  3921 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.898648  3994 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:57.905210  3863 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:57.864192  3781 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:58.029037  3863 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:58.029210  3781 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:57.520293  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 68736.4us
I20260709 13:01:57.762801  1532 rpcz_store.cc:276] 0709 13:01:56.348504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.687734 (+339230us) service_pool.cc:224] Handling call
0709 13:01:56.688790 (+  1056us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:57.008697 (+319907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.008741 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:57.010289 (+  1548us) log.cc:844] Serialized 590 byte log entry
0709 13:01:57.310171 (+299882us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:01:57.435968 (+125797us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.440975 (+  5007us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.621854 (+180879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.621939 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.658940 (+ 37001us) raft_consensus.cc:1685] finished
0709 13:01:57.658960 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.659096 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":217,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":365202,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":257,"thread_start_us":772470,"threads_started":4,"wal-append.queue_time_us":616129}
W20260709 13:01:57.985035  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.754757  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1646) took 1124 ms. Trace:
I20260709 13:01:58.127022  1538 rpcz_store.cc:276] 0709 13:01:56.630460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.740901 (+110441us) service_pool.cc:224] Handling call
0709 13:01:56.741250 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:56.741496 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:56.741778 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 13:01:57.754160 (+1012382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:57.754230 (+    70us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:57.754291 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.754376 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.754693 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":93148,"prepare.queue_time_us":1373,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":309596,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":14936,"thread_start_us":920664,"threads_started":2,"wal-append.queue_time_us":909300}
W20260709 13:01:57.988967  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 191132us
I20260709 13:01:58.144853  3980 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:57.804386  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1419) took 1800 ms. Trace:
I20260709 13:01:57.821026  1610 rpcz_store.cc:276] 0709 13:01:56.006276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.388636 (+382360us) service_pool.cc:224] Handling call
0709 13:01:57.734526 (+1345890us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54000b1dd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:57.734649 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679933312}
I20260709 13:01:57.779680  1615 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:01:58.146191  1612 rpcz_store.cc:276] 0709 13:01:56.003740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.007483 (+  3743us) service_pool.cc:224] Handling call
0709 13:01:56.010983 (+  3500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.387810 (+376827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.387859 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.473687 (+ 85828us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.013962 (+540275us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:57.014020 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.772002 (+757982us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54001b62d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:57.772103 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:57.804103 (+ 32000us) raft_consensus.cc:1685] finished
0709 13:01:57.804122 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:57.804324 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":245643,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":746131712,"thread_start_us":440930,"threads_started":1,"wal-append.queue_time_us":839207}
W20260709 13:01:58.148288  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1683) took 2518 ms (client timeout 2054 ms). Trace:
W20260709 13:01:58.148808  1615 rpcz_store.cc:269] 0709 13:01:55.629768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.629916 (+   148us) service_pool.cc:224] Handling call
0709 13:01:58.147849 (+2517933us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54003f7d54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:58.148052 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4510322944}
W20260709 13:01:57.787340  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.150494  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.150913  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.802207  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:57.823122  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:58.156826  1682 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:58.158058  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:58.159075  1684 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:57.839888  1686 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:57.840210  1685 raft_consensus.cc:2410] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:01:57.840181  1690 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:57.844988  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:58.015923  2367 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:58.020362  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:57.840881  2329 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:01:57.719789  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 92740us
I20260709 13:01:58.032841  3967 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:58.034457  3921 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:58.037379  3983 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:58.038641  3957 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:57.926801  3996 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:58.044070  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1436) took 1928 ms. Trace:
I20260709 13:01:57.925771  4004 raft_consensus.cc:3055] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:01:58.050136  4017 log.cc:927] Time spent T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:01:58.052328  4018 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260709 13:01:58.052599  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:58.054483  4020 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:01:58.055339  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:58.012005  1641 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:33773 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:33773 timed out after 15.000s (SENT)
I20260709 13:01:58.072947  2371 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:58.074540  3486 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:58.070567  3829 consensus_queue.cc:237] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:58.044436  4002 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:58.046962  1435 catalog_manager.cc:5697] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 2 to 4, term changed from 2 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to <none>, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193), VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194), VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195), VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:58.123829  1688 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:58.126156  3876 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:01:58.161901  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.162849  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:58.224112  3948 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:58.224367  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.224998  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.224901  3948 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:58.225524  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:58.226205  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 253) took 1467 ms. Trace:
I20260709 13:01:58.227386  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:58.256865  4025 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:01:58.274380  1687 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:58.275065  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:58.276054  1686 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:58.276279  3486 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:58.277016  4004 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:58.275940  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
W20260709 13:01:58.294916  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.608860  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.350746  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.683640  2371 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 247) took 1051 ms. Trace:
I20260709 13:01:57.909192  3816 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:58.226778  1539 rpcz_store.cc:276] 0709 13:01:56.758642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.825439 (+ 66797us) service_pool.cc:224] Handling call
0709 13:01:56.853626 (+ 28187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:56.862237 (+  8611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:56.862279 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:56.862825 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:01:57.585137 (+722312us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b180006ea40. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:01:57.986940 (+401803us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:01:57.987154 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:57.987403 (+   249us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:58.225483 (+238080us) raft_consensus.cc:1685] finished
0709 13:01:58.225508 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.225859 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8074,"raft.queue_time_us":8194,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9843,"spinlock_wait_cycles":7969152,"thread_start_us":401054,"threads_started":1,"wal-append.queue_time_us":1063233}
I20260709 13:01:58.372160  1682 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:58.299667  1689 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:58.278633  1616 rpcz_store.cc:276] 0709 13:01:56.115361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.642925 (+527564us) service_pool.cc:224] Handling call
0709 13:01:56.643172 (+   247us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.233580 (+590408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.043022 (+809442us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400421154. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:58.043661 (+   639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938775424}
W20260709 13:01:58.941229  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.941990  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.942384  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.943295  1686 consensus_meta.cc:287] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.666s	user 0.007s	sys 0.005s
I20260709 13:01:58.943789  1686 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:01:58.944555  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1661) took 1168 ms. Trace:
I20260709 13:01:58.945021  1686 rpcz_store.cc:276] 0709 13:01:57.775847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.274537 (+498690us) service_pool.cc:224] Handling call
0709 13:01:58.944479 (+669942us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:58.351751  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 510869us
I20260709 13:01:58.351440  1687 raft_consensus.cc:606] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
W20260709 13:01:58.563973  1688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1426) took 1881 ms (client timeout 1743 ms). Trace:
I20260709 13:01:58.931541  2371 rpcz_store.cc:276] 0709 13:01:57.632401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.632678 (+   277us) service_pool.cc:224] Handling call
0709 13:01:57.643465 (+ 10787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.294704 (+651239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.679999 (+385295us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54006d0bd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:58.683525 (+  3526us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889962752}
W20260709 13:01:58.950227  1684 consensus_meta.cc:287] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.003s
W20260709 13:01:58.951285  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:58.338050  1504 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:58.951193  1684 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:01:58.950589  1688 rpcz_store.cc:269] 0709 13:01:56.682941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.697186 (+ 14245us) service_pool.cc:224] Handling call
0709 13:01:58.563628 (+1866442us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400411254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:58.563857 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3277228928}
I20260709 13:01:58.953079  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1642) took 1241 ms. Trace:
I20260709 13:01:58.703712  1435 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 3 to 4, term changed from 3 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to <none>, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:01:58.352380  3771 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:58.947465  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1638) took 1228 ms. Trace:
I20260709 13:01:58.953789  1684 rpcz_store.cc:276] 0709 13:01:57.711532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.157411 (+445879us) service_pool.cc:224] Handling call
0709 13:01:58.952979 (+795568us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:58.836637  3799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.010s	sys 0.025s
I20260709 13:01:58.338229  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:58.897037  3960 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:58.709836  4011 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:58.337280  3937 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:58.951922  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1657) took 1177 ms. Trace:
W20260709 13:01:58.520388  3797 consensus_meta.cc:287] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.840s	user 0.012s	sys 0.007s
I20260709 13:01:58.161963  4000 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.958050  1687 raft_consensus.cc:614] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:58.620213  3989 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.230036  3996 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:58.896852  3948 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:58.959417  1689 rpcz_store.cc:276] 0709 13:01:57.710408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.298132 (+587724us) service_pool.cc:224] Handling call
0709 13:01:58.298859 (+   727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.938022 (+639163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.938536 (+   514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:59.048333  1682 rpcz_store.cc:276] 0709 13:01:57.774934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.801858 (+ 26924us) service_pool.cc:224] Handling call
0709 13:01:58.947338 (+1145480us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:58.972239  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:58.975907  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 670300us
I20260709 13:01:58.963796  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1639) took 1253 ms. Trace:
I20260709 13:01:58.975512  4011 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.067035  1681 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:01:59.069715  4011 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.069972  3735 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.070787  3735 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.069708  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1647) took 1351 ms. Trace:
W20260709 13:01:58.962080  3799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.488s	user 0.011s	sys 0.030s
W20260709 13:01:58.985147  4033 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.304s	user 0.000s	sys 0.008s
I20260709 13:01:59.060796  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60148 (request call id 13) took 1035 ms. Trace:
I20260709 13:01:58.966914  1579 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:59.077551  1535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.006s	sys 0.041s
I20260709 13:01:59.066102  1690 rpcz_store.cc:276] 0709 13:01:57.710690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.300501 (+589811us) service_pool.cc:224] Handling call
0709 13:01:58.301112 (+   611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:58.963265 (+662153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:58.963302 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:58.963356 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:01:58.963398 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:58.963475 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:58.963621 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":661965,"raft.queue_time_us":657844,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":3588}
I20260709 13:01:59.106940  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:59.108351  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:58.974781  3876 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:59.109906  1690 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.101718  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:58.976470  3980 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 13:01:59.110524  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1651) took 1383 ms. Trace:
I20260709 13:01:59.110877  1690 rpcz_store.cc:276] 0709 13:01:57.732098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.109214 (+1377116us) service_pool.cc:224] Handling call
0709 13:01:59.109638 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.110306 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.110472 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:59.102402  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:58.978871  3983 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.102666  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:59.100477  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:59.103611  3989 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.104602  2369 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.083941  4002 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:58.966100  3771 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:59.071632  4000 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.109572  3876 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:59.112562  1535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.071s	user 0.006s	sys 0.057s
I20260709 13:01:59.100455  3735 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.095604  1687 rpcz_store.cc:276] 0709 13:01:58.014375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.275613 (+261238us) service_pool.cc:224] Handling call
0709 13:01:59.049601 (+773988us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:59.082348  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:59.071800  1681 rpcz_store.cc:276] 0709 13:01:57.718716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.518197 (+799481us) service_pool.cc:224] Handling call
0709 13:01:58.518727 (+   530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.067683 (+548956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.069417 (+  1734us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400411754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:01:59.069639 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220614400}
I20260709 13:01:58.997341  3781 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:59.128507  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 755692us
I20260709 13:01:58.975999  3860 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.001454  1435 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 6 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.557149  4004 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:59.146643  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 179944us
W20260709 13:01:59.138998  4013 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.016s	sys 0.050s
W20260709 13:01:59.144855  2365 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.030s	sys 0.051s
I20260709 13:01:59.154217  1685 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:01:59.152486  1688 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.151774  4011 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.160917  3799 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.161926  3876 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:59.158856  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1643) took 1447 ms. Trace:
I20260709 13:01:59.168892  4011 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.159667  1682 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:01:59.165371  1685 rpcz_store.cc:276] 0709 13:01:57.711809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.334806 (+622997us) service_pool.cc:224] Handling call
0709 13:01:59.119958 (+785152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.158557 (+ 38599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.158795 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:59.157505  2365 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.030s	sys 0.051s
I20260709 13:01:59.171578  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1649) took 1440 ms. Trace:
I20260709 13:01:59.175235  1688 rpcz_store.cc:276] 0709 13:01:57.719597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.047790 (+1328193us) service_pool.cc:224] Handling call
0709 13:01:59.126829 (+ 79039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.156939 (+ 30110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.159390 (+  2451us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:01:59.159266  4013 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.016s	sys 0.051s
I20260709 13:01:59.171382  3799 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.187800  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1654) took 1406 ms. Trace:
I20260709 13:01:59.188292  1690 rpcz_store.cc:276] 0709 13:01:57.774269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.111627 (+1337358us) service_pool.cc:224] Handling call
0709 13:01:59.127666 (+ 16039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.180104 (+ 52438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.180159 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:59.180233 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:59.180291 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.180397 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.180592 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:59.147771  3983 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.197506  1688 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:59.198645  4011 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.178351  3876 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:59.190310  3799 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.199931  1681 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:01:59.206768  2371 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:01:59.209761  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1655) took 1435 ms. Trace:
I20260709 13:01:59.193039  3948 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:59.210235  1681 rpcz_store.cc:276] 0709 13:01:57.774496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.134475 (+1359979us) service_pool.cc:224] Handling call
0709 13:01:59.174013 (+ 39538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.209449 (+ 35436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.209684 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:59.185037  3781 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.208811  4002 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.233098  3948 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.236264  3948 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.233366  4002 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.221616  4011 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:59.197328  3860 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:01:59.246829  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.226119  3967 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:59.265391  3797 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.266248  3797 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.248245  4011 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.259590  3735 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.225364  3771 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.246755  3876 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.277016  3796 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.284473  4011 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.307310  4011 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.307542  3921 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:59.289762  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 169) took 16601 ms (client timeout 15000 ms). Trace:
I20260709 13:01:59.312439  3921 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.314221  4001 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:01:59.270001  3967 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.321329  3860 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:59.321512  3781 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.321425  4001 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:01:59.307917  4035 log.cc:927] Time spent T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.184s	user 0.001s	sys 0.001s
I20260709 13:01:59.308133  4011 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.279347  3735 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.319921  3921 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.330071  3983 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:59.315112  3876 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:59.284917  3796 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.331884  3921 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:59.328131  3989 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.330796  3797 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:59.349730  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.323540  4001 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.355970  3829 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:01:59.356873  3829 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.359190  3829 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:01:59.362527  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 378901us
W20260709 13:01:59.368268  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.373106  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.373217  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.364614  4011 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.367386  4002 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:59.381844  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.382298  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.382705  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.389730  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:59.393102  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.394409  3981 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:01:59.401393  1683 raft_consensus.cc:2410] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:01:59.411036  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.402567  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:01:59.429319  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 1.09166e+06us
I20260709 13:01:59.430636  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:01:59.432233  3797 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:59.436594  3876 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:01:59.415853  4032 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.246s	user 0.009s	sys 0.000s
I20260709 13:01:59.430757  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.399869  3967 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.445977  3937 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:01:59.308981  1439 rpcz_store.cc:269] 0709 13:01:42.687120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:42.687374 (+   254us) service_pool.cc:224] Handling call
0709 13:01:59.288368 (+16600994us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:51.448333 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:51.477844 (+ 29511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:51.477888 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:01:51.477913 (+    25us) tablet.cc:662] Decoding operations
0709 13:01:51.478570 (+   657us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:51.478659 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:51.478689 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:51.479125 (+   436us) tablet.cc:701] Row locks acquired
0709 13:01:51.479146 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:01:51.479308 (+   162us) write_op.cc:270] Start()
0709 13:01:51.479435 (+   127us) write_op.cc:276] Timestamp: P: 1783602111479262 usec, L: 0
0709 13:01:51.479458 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:01:51.489236 (+  9778us) log.cc:844] Serialized 1700 byte log entry
0709 13:01:52.813002 (+1323766us) op_driver.cc:464] REPLICATION: finished
0709 13:01:53.077441 (+264439us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02b9fe0ac 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd03253eef0
0709 13:01:54.211301 (+1133860us) write_op.cc:301] APPLY: starting
0709 13:01:54.211407 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:54.211591 (+   184us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:54.211616 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:54.212865 (+  1249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:54.213083 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:01:54.213141 (+    58us) write_op.cc:312] APPLY: finished
0709 13:01:54.215535 (+  2394us) log.cc:844] Serialized 40 byte log entry
0709 13:01:54.267735 (+ 52200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:54.282855 (+ 15120us) write_op.cc:454] Released schema lock
0709 13:01:54.285588 (+  2733us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:54.311188 (+ 25600us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:54.334126 (+ 22938us) write_op.cc:454] Released schema lock
0709 13:01:55.247092 (+912966us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0532a 00007fd02ea8af14 00007fd02ea8aec3 00007fd02ea8ae38 00007fd02ea8adf3 00007fd02ea8a0dc 00007fd02eab3e16 00007fd02ea9bcbb 00007fd02ea8639d 00007fd02ea89d75
Metrics: {"mutex_wait_us":26523,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":1372583,"apply.run_cpu_time_us":9351,"apply.run_wall_time_us":82956,"num_ops":4,"prepare.queue_time_us":34148,"prepare.run_cpu_time_us":14448,"prepare.run_wall_time_us":132209,"raft.queue_time_us":302845,"raft.run_cpu_time_us":43346,"raft.run_wall_time_us":2542098,"replication_time_us":1311898,"spinlock_wait_cycles":20763264,"thread_start_us":1526892,"threads_started":5,"wal-append.queue_time_us":252164,"wal-append.run_cpu_time_us":34211,"wal-append.run_wall_time_us":3049352}]]}
I20260709 13:01:59.450340  3937 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.402772  4000 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.452981  3937 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:59.447085  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1650) took 1720 ms. Trace:
I20260709 13:01:59.448407  3960 consensus_queue.cc:1059] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:59.449304  3873 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:01:59.437463  4001 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:01:59.460527  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 145368us
I20260709 13:01:59.462805  3921 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:01:59.463333  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:59.455245  1684 rpcz_store.cc:276] 0709 13:01:57.726900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.076920 (+1350020us) service_pool.cc:224] Handling call
0709 13:01:59.101400 (+ 24480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:59.101907 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:01:59.378283 (+276376us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.446569 (+ 68286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:59.446661 (+    92us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:59.446723 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.446840 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.446993 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":506,"prepare.queue_time_us":167435,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2290,"raft.queue_time_us":10900,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"thread_start_us":327099,"threads_started":2}
I20260709 13:01:59.464676  4000 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.465095  4000 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:01:59.465492  4000 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.470357  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.471711  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.473017  1532 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:59.473732  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.474095  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.474165  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.474629  1536 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.474788  1533 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:01:59.474951  1532 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:59.475821  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.476661  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.475965  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.473043  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.476627  1533 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:01:59.477241  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.479257  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.479137  1532 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:01:59.479811  1537 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.480240  1533 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:01:59.481105  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.481367  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.481796  1533 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:59.482303  1532 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:59.482699  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.478027  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.486126  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:01:59.489079  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.487484  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.489413  1532 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:59.490499  1540 raft_consensus.cc:2410] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:01:59.490522  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:59.479280  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.493022  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.493427  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.493991  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.495056  1540 raft_consensus.cc:2368] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6.
I20260709 13:01:59.495651  1541 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:01:59.497784  3921 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.498555  3921 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.499006  3921 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.497953  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:59.501858  3797 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.502249  3797 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.502575  3797 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.503422  1537 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:01:59.437295  4047 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.507146  1536 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:01:59.512599  4055 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:01:59.510823  3967 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:01:59.531710  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.531244  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.511683  3796 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.526806  3735 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.545773  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:59.526291  4000 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.531896  4011 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:59.553510  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:59.552976  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:01:59.560711  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 130087us
I20260709 13:01:59.543140  4047 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.566351  1682 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.591972  1615 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:59.571193  1681 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:01:59.600252  4049 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:59.600862  3816 consensus_meta.cc:287] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.528s	user 0.014s	sys 0.000s
W20260709 13:01:59.600998  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 72587.1us
I20260709 13:01:59.601485  3816 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.606137  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:01:59.606915  1684 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
W20260709 13:01:59.607604  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.608337  3957 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:59.609638  4044 log.cc:927] Time spent T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:01:59.610183  4047 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:59.610337  1504 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:59.611490  4054 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:59.565444  3796 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.615003  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:01:59.615636  1681 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:01:59.616226  4053 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.072s	user 0.002s	sys 0.003s
I20260709 13:01:59.616566  2364 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:01:59.617767  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1658) took 1842 ms. Trace:
I20260709 13:01:59.618343  1687 rpcz_store.cc:276] 0709 13:01:57.775170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.147484 (+1372314us) service_pool.cc:224] Handling call
0709 13:01:59.185112 (+ 37628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.209102 (+ 23990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:59.209150 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.244572 (+ 35422us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.457901 (+213329us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:59.457942 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.458014 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.617535 (+159521us) raft_consensus.cc:1685] finished
0709 13:01:59.617556 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.617701 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122554,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":137,"thread_start_us":183395,"threads_started":1,"wal-append.queue_time_us":258196}
I20260709 13:01:59.619388  1689 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:01:59.621677  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 93663.3us
I20260709 13:01:59.622430  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:59.622939  1579 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:59.623821  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1592) took 3322 ms. Trace:
I20260709 13:01:59.624375  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:01:59.624964  4051 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.625229  2371 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
W20260709 13:01:59.610452  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 151334us
I20260709 13:01:59.617844  2367 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:01:59.615914  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.601142  4049 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:01:59.646327  1681 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:01:59.643102  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1648) took 1924 ms (client timeout 2507 ms). Trace:
I20260709 13:01:59.648732  1684 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:01:59.624018  1579 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:59.613507  1504 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:01:59.648787  1683 rpcz_store.cc:269] 0709 13:01:57.719002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.051711 (+332709us) service_pool.cc:224] Handling call
0709 13:01:59.594179 (+1542468us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400411c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:01:59.643033 (+ 48854us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542985472}
I20260709 13:01:59.609617  3957 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:01:59.619582  3797 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.624890  3873 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:01:59.608381  4011 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.667182  4000 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.669590  2365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 248) took 1896 ms. Trace:
I20260709 13:01:59.669687  4011 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.670900  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.671801  1538 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.657675  4051 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.676421  4042 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.678399  4049 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:59.666527  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:59.683107  1615 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.624261  1535 rpcz_store.cc:276] 0709 13:01:56.301157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:56.302727 (+  1570us) service_pool.cc:224] Handling call
0709 13:01:56.303034 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.006083 (+703049us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:01:57.032667 (+ 26584us) log.cc:844] Serialized 14 byte log entry
0709 13:01:58.041533 (+1008866us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b1800042d60. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a823a 00007fd02eb12a2a
0709 13:01:59.160228 (+1118695us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:59.203801 (+ 43573us) log.cc:844] Serialized 26 byte log entry
0709 13:01:59.204012 (+   211us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:01:59.336855 (+132843us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:01:59.424716 (+ 87861us) log.cc:844] Serialized 14 byte log entry
0709 13:01:59.426065 (+  1349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.439937 (+ 13872us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.623535 (+183598us) raft_consensus.cc:1685] finished
0709 13:01:59.623557 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.623733 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265520,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":100307,"raft.run_cpu_time_us":536,"raft.run_wall_time_us":13048,"spinlock_wait_cycles":76319872,"thread_start_us":1995693,"threads_started":3,"wal-append.queue_time_us":2052034}
I20260709 13:01:59.682972  3873 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:59.684938  3873 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.679651  3921 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.670070  2365 rpcz_store.cc:276] 0709 13:01:57.772979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:57.782733 (+  9754us) service_pool.cc:224] Handling call
0709 13:01:57.798107 (+ 15374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:57.820917 (+ 22810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:57.824457 (+  3540us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:57.825070 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 13:01:58.305712 (+480642us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b18003983e0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:01:59.222724 (+917012us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:59.230257 (+  7533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:59.669150 (+438893us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5400523b20. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7fdc0 00007fd02eb0ba02 00007fd02eb08dde 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:01:59.669249 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:59.669317 (+    68us) raft_consensus.cc:1685] finished
0709 13:01:59.669343 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:59.669528 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8111,"raft.queue_time_us":23512,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":9254,"spinlock_wait_cycles":50983040,"thread_start_us":869298,"threads_started":1,"wal-append.queue_time_us":1366066}
I20260709 13:01:59.662256  3957 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:59.691452  3957 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.692819  3921 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.693008  1683 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:01:59.699229  4047 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:01:59.699896  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 76017.4us
I20260709 13:01:59.700388  4047 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.700805  4047 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:59.700977  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:59.702134  4047 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.703505  1615 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:01:59.697911  1653 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:59.693147  3957 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.697350  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:59.738484  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:01:59.739192  1615 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:59.739838  3921 consensus_queue.cc:1059] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:01:59.739979  1610 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:01:59.724193  3876 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:01:59.744942  3816 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:01:59.745225  3876 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.745780  3876 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.741541  3836 consensus_queue.cc:1059] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:01:59.746714  3796 consensus_queue.cc:1059] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:01:59.743101  1682 raft_consensus.cc:2410] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:01:59.751494  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.752197  1536 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:59.751652  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 71885.6us
W20260709 13:01:59.754266  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 140885us
I20260709 13:01:59.729107  4001 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:01:59.720449  4000 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:01:59.740473  3735 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:01:59.709529  4049 consensus_queue.cc:1059] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:01:59.749185  4047 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.740985  3921 raft_consensus.cc:3055] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:01:59.765189  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:59.765352  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:01:59.711428  3996 consensus_queue.cc:1059] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:01:59.769178  1682 raft_consensus.cc:606] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:59.771188  1682 raft_consensus.cc:614] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:01:59.772289  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.776012  1535 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:01:59.740394  4056 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:01:59.782655  3797 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.741205  4045 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:01:59.768282  3816 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:01:59.783970  3948 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:01:59.788792  3948 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:59.789923  3948 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.790721  4042 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:01:59.791272  3948 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:01:59.791500  4042 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.784489  4013 raft_consensus.cc:3055] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:59.792852  4013 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:01:59.793843  4013 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.795157  4013 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.768680  3921 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:59.785594  4051 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:01:59.786516  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 92775.2us
I20260709 13:01:59.797108  3921 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.798290  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.798662  3921 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.800524  1538 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
W20260709 13:01:59.816147  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.819065  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.822207  4001 raft_consensus.cc:697] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:59.824314  4001 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:01:59.827824  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.829556  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:59.834161  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 52589.6us
I20260709 13:01:59.835723  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:01:59.836277  1682 raft_consensus.cc:606] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:01:59.836563  1682 raft_consensus.cc:614] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:59.838397  1504 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.788380  4000 raft_consensus.cc:3055] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:01:59.840714  4000 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:59.841864  4000 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.843343  4000 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:01:59.845846  4042 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.849658  4042 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.849889  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:01:59.856350  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 58170.1us
I20260709 13:01:59.858911  2329 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.777637  3735 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:59.859949  3771 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:01:59.786841  3816 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.840152  3978 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:01:59.801690  3836 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:01:59.869410  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 111073us
W20260709 13:01:59.876416  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.864172  3816 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:01:59.864496  3836 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:01:59.880923  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:01:59.866504  3771 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:01:59.880354  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 137930us
I20260709 13:01:59.882573   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:59.884742  1532 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:59.885414  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:59.886323  4040 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.884523  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.887492   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:59.888540  3799 consensus_meta.cc:287] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.004s
I20260709 13:01:59.884588  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:01:59.888949  3799 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.891296  3799 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:01:59.894151  4004 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.896778  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:01:59.898397  1539 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:01:59.898330  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.898713  3964 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:01:59.866298  4045 consensus_queue.cc:1243] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer 9d926c10b90f452ba52d80dab6a50351 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:59.899787  3964 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.896695  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:01:59.887360  4050 raft_consensus.cc:3055] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:01:59.900259  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.858834  3876 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.898361  1532 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:01:59.865899  4042 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 13:01:59.917234  4063 log.cc:927] Time spent T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:01:59.918323  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:01:59.920303  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 142958us
I20260709 13:01:59.922461  1504 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:01:59.909222  3735 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.924705  3771 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.926743  3948 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:01:59.909400  3964 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:01:59.930714  3981 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:01:59.936163  3799 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:01:59.878973  3860 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:01:59.940268  4070 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.940812  4070 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.941174  4070 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:01:59.942919  3836 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:01:59.908546  4050 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:01:59.945226  4050 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.946625  4050 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:01:59.946774  3816 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:01:59.944140  3836 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:59.948261  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 110260us
I20260709 13:01:59.951289  4075 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:01:59.953755  4075 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:01:59.954710  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.954938  1536 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
W20260709 13:01:59.965109  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:59.967902  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:59.968968  3957 raft_consensus.cc:2764] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:01:59.969532  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:01:59.970402  3957 raft_consensus.cc:2764] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:01:59.973381  3876 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:01:59.977020  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:01:59.977720  2365 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:01:59.985023  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 73046.8us
I20260709 13:01:59.989718  1579 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:00.000020  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.006234  4064 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.210s	user 0.002s	sys 0.000s
W20260709 13:02:00.008457  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 108290us
I20260709 13:02:00.008643  4074 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:00.010859  4074 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:00.011612  4065 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.214s	user 0.000s	sys 0.003s
I20260709 13:02:00.012183  4074 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:00.010871  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 86850.9us
I20260709 13:01:59.966176  4075 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.019572  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:00.021636  4074 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.022109  1504 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.022984  2364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 251) took 1066 ms. Trace:
I20260709 13:02:00.023404  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.011751  3873 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.032258  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:00.039978  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.023542  2364 rpcz_store.cc:276] 0709 13:01:58.956599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:58.960388 (+  3789us) service_pool.cc:224] Handling call
0709 13:01:58.966724 (+  6336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:59.617062 (+650338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.022590 (+405528us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54004f3b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:00.022901 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493653760}
I20260709 13:02:00.049942  1685 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:00.026949  3816 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:00.032219  3964 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.052982  3876 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:00.053471  3876 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:00.053869  3876 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:00.054165  3964 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:00.056656  1682 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:00.057132  1682 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:00.058282  1682 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.059540  1682 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.060338  4071 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:02:00.035003  4051 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.040334  3799 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:00.064822  3799 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.065317  3799 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.066941  2365 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
W20260709 13:02:00.068655  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 86002.8us
I20260709 13:02:00.069993  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:00.070514  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 50426.4us
I20260709 13:02:00.073230  4000 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:00.076318  1579 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.077381  3981 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.090265  1653 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.093119  3735 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.093174  3964 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:00.093986  3735 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:00.095481  3964 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:00.095168  3735 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.094400  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.095930  3964 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.097011  3964 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.097258  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:00.098006  1685 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:00.097466  3797 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.098484  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:00.100636  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:00.101320  1688 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:00.102181  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:00.102293  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:00.103286  1684 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:02:00.103565  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:00.105568  1686 raft_consensus.cc:2410] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:02:00.107510  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 84216us
I20260709 13:02:00.107874  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35722 (request call id 266) took 1129 ms. Trace:
I20260709 13:02:00.108640  1686 rpcz_store.cc:276] 0709 13:01:58.978402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:59.100159 (+121757us) service_pool.cc:224] Handling call
0709 13:02:00.107621 (+1007462us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b5400118ad4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:00.107795 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266529024}
W20260709 13:02:00.122507  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 201758us
I20260709 13:02:00.123605  2329 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.108907  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.136057  2329 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:00.137444  1504 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.141072  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:00.142046  1684 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:02:00.141018  1682 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:02:00.145725  1682 pending_rounds.cc:85] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 7
I20260709 13:02:00.108525  4047 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:00.108240  3980 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.147732  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:00.146747  1682 pending_rounds.cc:107] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:02:00.144912  3816 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:00.158012  1682 raft_consensus.cc:2889] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:00.158457  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 116681us
I20260709 13:02:00.164348  1688 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.165700  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:00.161756  3816 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.160285  4071 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.171900  1580 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.145665  3836 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:02:00.166443  3981 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:00.182832  2365 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:02:00.184273  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 55854.7us
I20260709 13:02:00.185127  1504 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.186532  1504 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.188570  3836 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:00.189253  3836 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:00.190289  4000 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:00.177075  3781 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:02:00.192552  4042 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:00.193190  4042 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:00.193342  4000 consensus_queue.cc:1059] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:00.173285  3816 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.194367  4000 raft_consensus.cc:3055] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:00.194213  4042 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.181529  3964 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.164885  4047 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:00.196316  4047 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.197252  3964 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:00.194831  4000 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:00.198963  4000 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.200250  4000 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:00.205490  1688 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:00.170462  4013 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:00.230546  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50371.3us
I20260709 13:02:00.231815  3981 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:00.166332  3989 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:02:00.163033  3980 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.244927  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:00.245579  1686 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:00.248050  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.255787  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.255023  1686 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:02:00.256013  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 90448.9us
I20260709 13:02:00.266319  2329 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:00.266556  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 80150.3us
W20260709 13:02:00.268433  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 89329.3us
I20260709 13:02:00.278625  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:00.284242  1686 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.229776  4040 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.294626  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:00.296579  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.300745  1580 leader_election.cc:400] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6.
I20260709 13:02:00.301193  1580 leader_election.cc:403] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:00.293076  3996 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:00.307571  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:00.252497  4013 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:00.312211  1504 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:00.316440  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47069.8us
I20260709 13:02:00.317306  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:00.316006  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:00.319659  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:00.320168  1683 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:00.321812  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.293143  3960 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:02:00.319626  1684 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.280495  3799 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:00.328886  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 73261.4us
I20260709 13:02:00.308969  4051 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:00.330920  1686 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:00.306433  4070 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.356252  4086 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:00.357894  1683 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
W20260709 13:02:00.360101  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 57157.8us
I20260709 13:02:00.360970  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:00.337854  1689 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:02:00.331718  4074 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:00.339274  1612 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.342365  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.326529  3735 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.345217  3876 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:00.346107  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.348430  2365 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:02:00.351477  1579 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.352114  4040 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.353788  3799 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:00.316143  4077 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:02:00.362414  3981 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:00.362950  1504 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:00.366164  1684 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:02:00.366952  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.412317  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.336826  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:00.414721  1686 raft_consensus.cc:2410] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:00.365661  1683 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:00.364876  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.055s (SENT) [suppressed 18 similar messages]
W20260709 13:02:00.420749  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 55907.5us
W20260709 13:02:00.406268  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 91736.8us
I20260709 13:02:00.361713  4051 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:00.429621  1686 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:00.366242  4070 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:00.439073  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 87662.9us
I20260709 13:02:00.409373  2365 pending_rounds.cc:85] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Aborting all ops after (but not including) 6
I20260709 13:02:00.445642  2365 pending_rounds.cc:107] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:02:00.367856  4074 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:00.447190  1681 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:00.447568  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:00.453472  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 111194us
I20260709 13:02:00.447361  1579 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.467442  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:00.470501  1579 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.372490  4075 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.451857  2365 raft_consensus.cc:2889] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:00.447712  4001 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:00.478557  4013 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.460788  4071 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:00.485073  1615 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:00.455385  4074 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:00.506459  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.445036  3989 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:02:00.510046  1612 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
W20260709 13:02:00.513674  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.514631  1683 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:00.514690  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:02:00.513747  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 150889us
W20260709 13:02:00.516436  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.476713  3799 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:00.517648  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47582.3us
I20260709 13:02:00.489544  4001 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.508162  4000 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:00.506278  4051 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:00.516825  3796 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:00.551649  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.520490  3799 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.524333  4086 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.522485  3876 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:00.564692  3799 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.484859  3816 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:00.573506  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52998.2us
I20260709 13:02:00.597544  3816 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:00.582266  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.588877  4075 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:00.527244  4071 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:00.535275  4001 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:00.606918  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:00.629107  1681 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.539714  4050 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:00.579780  4086 raft_consensus.cc:697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:00.602741  3836 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.555637  3796 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:00.660192  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 189804us
I20260709 13:02:00.661666  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:00.662801  4086 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.661051  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.665133  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.666014  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.666706  3735 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6.
I20260709 13:02:00.666913  1579 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.667580  3735 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:00.669327  3735 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:00.670311  3735 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.672806  4075 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:00.672924  3836 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:00.673444  4075 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:00.674503  4075 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.676666  4071 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.678725  1681 raft_consensus.cc:2410] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:02:00.668287  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:00.634685  4050 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.683321  1616 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:00.649781  3796 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:00.694072  1579 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.700183  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:00.688777  4050 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.705415  1616 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:00.709023  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 111434us
I20260709 13:02:00.685865  4100 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.690389  3996 raft_consensus.cc:697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:00.724303  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:00.711958  4069 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:00.747020  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:00.748178  1536 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:00.754696  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:00.728516  4100 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:00.764925  1616 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:00.759106  3816 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:00.784828  1616 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:00.782253  3816 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:00.786429  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:00.783110  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 89008.3us
I20260709 13:02:00.792316  3996 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:00.798213  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.796526  1579 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:00.775166  4070 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:00.813987  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:00.825148  4001 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.826606  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:00.828662  3796 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.830838  3796 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:00.794989  2365 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:00.838164  4100 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.840845  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:00.842906  4099 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.185s	user 0.000s	sys 0.003s
I20260709 13:02:00.851387  1536 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:00.843917  4070 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:00.868866  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.870244  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 95046.3us
W20260709 13:02:00.870244  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 76559.1us
I20260709 13:02:00.856518  3796 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:00.887025  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.888311  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.892838  1612 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:00.902801  1613 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:00.871995  4069 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:00.920727  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:00.921502  1612 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:00.928745  4070 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:00.918792  1613 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:02:00.938136  4001 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:00.912539  3796 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:00.946738  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.950515  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:00.951431  3980 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:00.962486  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.988027  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:00.989010  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:00.991338  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:00.997062  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:00.997848  1616 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:00.998459  1612 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:01.004314  4108 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.345s	user 0.003s	sys 0.000s
W20260709 13:02:01.007750  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.008682  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.024616  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.026157  1608 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:01.034961  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:01.036377  4095 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.464s	user 0.000s	sys 0.003s
I20260709 13:02:01.036301  2365 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:01.038471  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.039621  1616 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:01.051188  1613 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:01.071985  1612 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:01.041146  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.099999  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.100347  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.101466  1616 raft_consensus.cc:2393] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:01.101794  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.102162  1611 raft_consensus.cc:2410] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:00.991757  4050 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.104966  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.106156  1613 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:00.990928  3836 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:02:01.009734  4074 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:01.114326  1608 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:01.384565  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.110743  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:01.535995  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:01.334903  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.114629  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.152323  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 181702us
W20260709 13:02:01.546411  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.546651  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.104027  1616 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:00.928632   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:01.111331  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:01.260937  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.207748  4050 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:01.552286  1609 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:01.552640  4050 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.254240  4125 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.553040  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.553875  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 242) took 1244 ms. Trace:
W20260709 13:02:01.381389  4088 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.813s	user 0.000s	sys 0.001s
I20260709 13:02:01.554279  1609 rpcz_store.cc:276] 0709 13:02:00.310123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.316221 (+  6098us) service_pool.cc:224] Handling call
0709 13:02:00.327951 (+ 11730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:01.552678 (+1224727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:01.553644 (+   966us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003a2fd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:01.553813 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815164288}
W20260709 13:02:01.380254  4091 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.872s	user 0.000s	sys 0.003s
I20260709 13:02:01.378717  4000 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:01.556347  4000 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:01.554811  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.557320  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1682) took 1312 ms. Trace:
I20260709 13:02:01.557700  1688 rpcz_store.cc:276] 0709 13:02:00.245178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.245327 (+   149us) service_pool.cc:224] Handling call
0709 13:02:00.245792 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.246121 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.246158 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.246815 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.322189 (+ 75374us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:00.322243 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.322315 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.379448 (+1057133us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:01.556999 (+177551us) raft_consensus.cc:1685] finished
0709 13:02:01.557021 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.557219 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3761920,"thread_start_us":74908,"threads_started":1,"wal-append.queue_time_us":194349}
I20260709 13:02:01.548846  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.561754  1615 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:01.553561  4125 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.206789  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.563494  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:01.058773  4094 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.470s	user 0.002s	sys 0.002s
W20260709 13:02:01.240584  3799 consensus_meta.cc:287] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.003s
I20260709 13:02:01.573634  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.570693  1609 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:01.562779  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:01.546324  1654 connection.cc:256] RPC call timeout handler was delayed by -2.3451584750000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260709 13:02:01.543736  1504 connection.cc:256] RPC call timeout handler was delayed by -4.1195077369999922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:02:01.035339  4069 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.553092  4050 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.586475  4074 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:01.586872  4125 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:01.587212  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 472276us
I20260709 13:02:01.587503  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.596163  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:01.598093  4096 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.023s	user 0.003s	sys 0.000s
W20260709 13:02:01.598507  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.601193  3816 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:01.599712  1615 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:02:01.602061  1613 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:01.094732  3796 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.100136  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:01.605559  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.604202  4000 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:01.609681  3978 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.610029  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.617029  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:01.665678  1616 raft_consensus.cc:2393] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:01.617651  2367 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:01.642416  4114 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.019s	sys 0.039s
I20260709 13:02:01.627211  1435 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 93) took 10267 ms. Trace:
I20260709 13:02:01.630237  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.670471  1608 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:01.644435  1654 connection.cc:256] RPC call timeout handler was delayed by -2.1714584750000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 13:02:01.643903  1532 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
W20260709 13:02:01.671357  1654 connection.cc:256] RPC call timeout handler was delayed by -1.2786584749999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2979s for a response
I20260709 13:02:01.239518  3964 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.206833  3980 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:01.642086  4042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.010s	sys 0.028s
I20260709 13:02:01.622478  4040 raft_consensus.cc:476] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:02:01.682762  4040 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:01.683420  4040 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.684600  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:01.685855  4040 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:01.687263  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:01.688359  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.689698  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 276) took 1375 ms. Trace:
I20260709 13:02:01.668257  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:01.645215  1504 connection.cc:256] RPC call timeout handler was delayed by -4.0304077369999618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16570000000000001s for a response
I20260709 13:02:01.672425  1536 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:02:01.648454  4106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.013s	sys 0.028s
I20260709 13:02:01.679013  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.693655  1616 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:01.651528  4113 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.034s
I20260709 13:02:01.680187  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.680323  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:01.669988  4114 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.019s	sys 0.040s
I20260709 13:02:01.690171  1535 rpcz_store.cc:276] 0709 13:02:00.314628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.314741 (+   113us) service_pool.cc:224] Handling call
0709 13:02:00.315097 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.332565 (+ 17468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.332596 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.349080 (+ 16484us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.451488 (+102408us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:00.451530 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.451597 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.597270 (+1145673us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:01.689302 (+ 92032us) raft_consensus.cc:1685] finished
0709 13:02:01.689326 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.689610 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":196,"raft.queue_time_us":10727,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":65736064,"thread_start_us":101997,"threads_started":1,"wal-append.queue_time_us":185003}
I20260709 13:02:01.704937  1681 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:02:01.705680  1681 pending_rounds.cc:85] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 6
I20260709 13:02:01.706097  1681 pending_rounds.cc:107] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:02:01.705888  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.706722  1681 raft_consensus.cc:2889] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:01.707947  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.708400  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:01.709311  1682 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:01.709484  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.710872  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:01.725881  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.670835  3978 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:01.699105  1689 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:02:01.729648  1689 pending_rounds.cc:85] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 5
I20260709 13:02:01.729966  1689 pending_rounds.cc:107] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:02:01.730295  1689 raft_consensus.cc:2889] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:01.691310  4042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.010s	sys 0.028s
W20260709 13:02:01.695744  4113 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.009s	sys 0.034s
W20260709 13:02:01.694679  4106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.028s
I20260709 13:02:01.696183  1611 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:01.651795  3799 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.742413  2369 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:02:01.716785  1504 connection.cc:256] RPC call timeout handler was delayed by -3.6911077369999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260709 13:02:01.670132  1435 rpcz_store.cc:276] 0709 13:01:51.359841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:51.363341 (+  3500us) service_pool.cc:224] Handling call
0709 13:02:01.627137 (+10263796us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:59.503802 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:59.504605 (+   803us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:59.504663 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:01:59.504683 (+    20us) tablet.cc:662] Decoding operations
0709 13:01:59.505377 (+   694us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:59.505484 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:59.505513 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:59.506057 (+   544us) tablet.cc:701] Row locks acquired
0709 13:01:59.506119 (+    62us) write_op.cc:260] PREPARE: finished
0709 13:01:59.506288 (+   169us) write_op.cc:270] Start()
0709 13:01:59.506453 (+   165us) write_op.cc:276] Timestamp: P: 1783602119506224 usec, L: 0
0709 13:01:59.506489 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:01:59.614551 (+108062us) log.cc:844] Serialized 1743 byte log entry
0709 13:01:59.929689 (+315138us) spinlock_profiling.cc:243] Waited 9.77 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb03e28 00007fd03253e581 00007fd03253dd58 00007fd0325429f1 00007fd0325429a9 00007fd032542939 00007fd032542901 00007fd032541b2d 000000000038f354 000000000038f199
0709 13:02:00.010372 (+ 80683us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:00.131778 (+121406us) op_driver.cc:464] REPLICATION: finished
0709 13:02:00.180646 (+ 48868us) write_op.cc:301] APPLY: starting
0709 13:02:00.225627 (+ 44981us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:00.280642 (+ 55015us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:00.291009 (+ 10367us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:00.565375 (+274366us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:00.565712 (+   337us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:02:00.565776 (+    64us) write_op.cc:312] APPLY: finished
0709 13:02:00.566148 (+   372us) log.cc:844] Serialized 40 byte log entry
0709 13:02:00.566375 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.566496 (+   121us) write_op.cc:454] Released schema lock
0709 13:02:00.566576 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:00.567131 (+   555us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:00.567164 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1818699,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":27266,"apply.run_cpu_time_us":4485,"apply.run_wall_time_us":398786,"num_ops":4,"prepare.queue_time_us":116481,"prepare.run_cpu_time_us":49332,"prepare.run_wall_time_us":426116,"raft.queue_time_us":118340,"raft.run_cpu_time_us":1984,"raft.run_wall_time_us":2044,"replication_time_us":625066,"spinlock_wait_cycles":32976640,"thread_start_us":313005,"threads_started":4,"wal-append.queue_time_us":182118,"wal-append.run_cpu_time_us":10603,"wal-append.run_wall_time_us":1772375}]]}
I20260709 13:02:01.701783  4040 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:01.748546  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.734302  1615 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:01.681089  3964 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.732793  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 239) took 1440 ms. Trace:
I20260709 13:02:01.693555  3921 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:02:01.751672  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.752651  1535 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:01.691193  3980 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:01.755659  1536 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:01.759265  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:01.760299  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.751484  1610 rpcz_store.cc:276] 0709 13:02:00.292707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.292841 (+   134us) service_pool.cc:224] Handling call
0709 13:02:00.305334 (+ 12493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:00.305860 (+   526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:00.305901 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:00.316092 (+ 10191us) log.cc:844] Serialized 26 byte log entry
0709 13:02:00.488237 (+172145us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:00.488277 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:00.488363 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:01.005888 (+517525us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:01.726601 (+720713us) raft_consensus.cc:1685] finished
0709 13:02:01.726633 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:01.732707 (+  6074us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10024,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":6199,"spinlock_wait_cycles":21660032,"thread_start_us":149745,"threads_started":1,"wal-append.queue_time_us":260059}
I20260709 13:02:01.761207  1607 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:01.764464  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.765457  1609 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:01.766371  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.766925  1609 raft_consensus.cc:2376] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6. Re-sending same reply.
I20260709 13:02:01.767882  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.768649  1609 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:01.769377  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.769841  1609 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:01.770535  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.771117  3964 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:01.772434  1609 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 7: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:01.772913  4000 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:01.773288  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.774511  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.774865  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.748066  3816 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:01.776491  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.776610  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.777179  1609 raft_consensus.cc:2376] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3. Re-sending same reply.
I20260709 13:02:01.777417  1610 raft_consensus.cc:2410] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:01.778323  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.783157  1609 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:01.784525  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.778350  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.785495  1610 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.775893  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.786756  1612 raft_consensus.cc:2393] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:01.783649  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:01.791654  1535 raft_consensus.cc:2368] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4.
I20260709 13:02:01.793555  1616 raft_consensus.cc:2410] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:01.794720  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:01.799088  1536 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:01.801925  1612 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:01.807363  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:01.808765  1615 raft_consensus.cc:2410] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:01.811333  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.773424  3980 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:01.814313  3980 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.814893  3980 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:01.794234  4113 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:01.831188  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:01.835328  1608 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:01.835793  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.836709  1536 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:01.840224  1616 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:01.828900  4113 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:01.846761  4113 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:01.848438  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.849222  1535 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:01.849654  3978 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:01.850242  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:01.850880  1537 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:01.851475  4130 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:02:01.764379  4040 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:01.887413  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.894328  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:01.894724  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.895285  1540 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:01.895675  1532 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:01.896386  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.897234  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:01.898078  1539 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:01.899950  1536 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:01.900446  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.902179  1541 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:01.903659  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.904459  1533 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:01.903613  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.908317  1534 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:01.887473  4113 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:01.873194  4050 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:01.911718  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:01.912672  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:01.949858  1610 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:01.951068  1609 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:01.910435  4107 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.016s	sys 0.011s
W20260709 13:02:01.987434  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.988350  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:01.992507  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 305342us
I20260709 13:02:01.995144  1537 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
W20260709 13:02:01.997395  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.001834  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:01.923992  4050 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:01.991446  4107 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.183s	user 0.017s	sys 0.011s
I20260709 13:02:02.009186  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.011857  1532 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:01.923630  4104 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.996904  4000 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.001353  4137 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:01.956288  3978 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:02:02.010967  4050 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:02.044896  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:02.045780  1532 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:02.060957  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.066466  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 502664us
I20260709 13:02:02.044523  4050 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.043278  4106 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:02.044072  3980 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:02.024556  4104 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.035665  4000 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:02.075107  3799 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:02.068677  4145 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.115988  4145 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.118134  2329 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:02.118059  3960 consensus_queue.cc:1059] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:02.089203  4042 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:02:02.119380  3960 raft_consensus.cc:3055] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:02.119761  3960 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:02.090978  4121 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:02:02.120466  4042 consensus_queue.cc:1059] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:02.074786  4137 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.121718  4137 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.090204  4074 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.120826  3960 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:02.124010  4137 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:02.129273  4137 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.129755  4137 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.090132  4106 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:02.118386  4145 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:02.120282  4087 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:02.135998  4106 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:02.136601  4087 raft_consensus.cc:697] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:02.137760  4087 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:02.097167  3980 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.139180  3980 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.101178  4040 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:02.114063  4000 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:02.141971  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:02.131804  4137 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:02:02.187413  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:02.195554  1532 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:02.195768  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:02.197079  1612 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:02.140810  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.198580  2329 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:02.192322  1539 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:02.179204  1540 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:02.210404  1609 pending_rounds.cc:85] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 8
I20260709 13:02:02.211494  1609 pending_rounds.cc:107] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:02:02.212335  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:02.212651  1610 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:02.213701  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:02.214002  1609 raft_consensus.cc:2889] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:02.214745  1607 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:02.206512  4152 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:02.216200  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 74309.7us
I20260709 13:02:02.217033  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:02.124653  4154 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.124442  4149 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.225401  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.231410  1683 raft_consensus.cc:2368] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:02:02.232996  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.233112  1654 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:02.234009  1681 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:02.232996  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.234736  1538 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:02.229763  1539 raft_consensus.cc:3055] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:02.128422  3960 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:02.227896  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:02.242846  1689 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:02.236622  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:02.243717  1681 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:02.235893  1539 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:02.237041  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.244683  1687 raft_consensus.cc:2410] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:02:02.203188  4126 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.031s	sys 0.071s
I20260709 13:02:02.238299  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.239954  1682 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:02.124437  4104 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:02.207312  4148 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.257964  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.228418  4121 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:02.259027  4126 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.031s	sys 0.071s
I20260709 13:02:02.237663  4149 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.125569  4074 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.370178  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.366113  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.371541  1690 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:02.372248  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:02.373021  1684 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:02.380719  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.381311  1684 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
W20260709 13:02:02.348901  4150 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:02:02.384238  1532 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:02.245287  3816 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 13:02:02.245635  4154 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.318254  4137 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:02.302111  4040 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:02.388727  1539 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:02.384810  4121 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:02.515626  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.438897  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 221648us
I20260709 13:02:02.418391  1540 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
W20260709 13:02:02.417747  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.009s
I20260709 13:02:02.400360  4154 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:02.420509  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:02.577381  1534 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:02.401520  4149 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:02.416339  4137 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:02.424499  1690 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:02:02.394892  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:02.572551  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.004s	sys 0.009s
I20260709 13:02:02.583441  1539 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.587631  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.588368  1690 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:02.588663  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.590045  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:02.594348  1505 connection.cc:256] RPC call timeout handler was delayed by -1.083110855999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.35640000000000005s for a response
W20260709 13:02:02.594523  1685 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.073s	sys 0.104s
W20260709 13:02:02.594806  1505 connection.cc:256] RPC call timeout handler was delayed by -1.0811163899999769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20390000000000003s for a response
W20260709 13:02:02.595261  1685 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.074s	sys 0.105s
W20260709 13:02:02.595391  1505 leader_election.cc:336] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.502s (SENT)
I20260709 13:02:02.456820  4162 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.400851  3980 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:02.602432  1505 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.591s (SENT)
I20260709 13:02:02.546095  4155 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:02.599360  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 192105us
I20260709 13:02:02.303318  4148 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.585371  4137 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.607205  2328 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:02.595626  4149 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.593703  4074 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:02.617797  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.617005  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:02.617167  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.620311  1654 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:02.620852  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.584539  4040 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:02.609866  4050 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.005s
I20260709 13:02:02.624691  1539 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:02:02.635625  1539 pending_rounds.cc:85] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 6
I20260709 13:02:02.636466  1539 pending_rounds.cc:107] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:02:02.637207  1539 raft_consensus.cc:2889] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:02.604074  4162 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.737309  4155 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:02.738003  4155 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.738436  4155 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.739509  4162 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:02.739691  1685 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:02.741454  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:02.741772  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:02.744356  1532 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:02.745849  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:02.746773  1532 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:02.748716  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:02.755604  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.756517  1541 raft_consensus.cc:2393] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:02.757159  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:02.757467  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.758528  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.758946  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.759284  1541 raft_consensus.cc:2410] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:02.759668  1533 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:02.759915  1538 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4. Re-sending same reply.
I20260709 13:02:02.620007  4149 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:02.763638  4149 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:02.766152  4040 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:02.767738  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.784578  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.786975  4121 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:02.791428  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.849905  1534 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:02.618245  3980 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 13:02:02.618115  4145 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:02.756297  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:02.858266  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:02.881757  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 133161us
I20260709 13:02:02.891876  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:02.910835  1683 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:02.892992  1540 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:02.914927  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:02.854504  3960 consensus_meta.cc:287] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.003s
I20260709 13:02:02.913730  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:02.897846  1535 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:02.924515  1534 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:02:02.939658  1683 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:02.932689  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:02.909138  4157 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:02.953992  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:02.890163  4160 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:02.918809  4145 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:02.970757  4145 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:02.971586  4145 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:02.931468  3996 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:02.972352  3996 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:02.972916  3996 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:02.933902  4162 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:02.976257  4152 consensus_meta.cc:287] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.004s
I20260709 13:02:02.977015  4152 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:02.978132  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:02.979483  4040 raft_consensus.cc:2764] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:02:02.981905  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:02.985767  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1450) took 2233 ms. Trace:
I20260709 13:02:02.988961  1437 catalog_manager.cc:5697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 6, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.962314  1683 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:02:02.751339  4050 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:02.993755  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.004170  4145 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.998251  1614 rpcz_store.cc:276] 0709 13:02:00.752798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:00.782558 (+ 29760us) service_pool.cc:224] Handling call
0709 13:02:02.985478 (+2202920us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b540040a6d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:02.985679 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4927378176}
I20260709 13:02:03.020145  4145 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.021202  4050 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:03.021939  1688 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:03.022239  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:03.022846  1683 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:03.024066  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:03.024430  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.024767  1688 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:02:03.025692  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:03.026780  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:03.027295  1688 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:03.027704  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.046693  1683 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:03.065083  4145 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.056638  1437 catalog_manager.cc:5697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.070765  1437 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 3 to 4, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.076256  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 454759us
I20260709 13:02:03.095448  4093 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:03.096513  4145 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:03.099139  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.099972  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.104204  1683 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:03.105567  1688 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:02.992676  4157 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:03.111236  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 129451us
I20260709 13:02:03.031481  4160 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:03.116214  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:03.111006  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:03.118106  1688 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:03.071487  4155 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.129742  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:03.130772  2366 raft_consensus.cc:2393] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:03.130649  4142 raft_consensus.cc:3055] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:03.131212  4142 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:03.132169  4142 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.132632  3960 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.133293  4142 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:03.133316  3960 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.137912  4125 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.138492  4125 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.139005  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.139649  1689 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:03.141722  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.114180  4107 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:03.150241  1684 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:02:03.152683  4160 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.154446  1684 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:02:03.157581  1684 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:03.162490  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.163424  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.163954  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.156193  3960 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:03.173040  1579 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:03.169575  1437 catalog_manager.cc:5697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 6, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.128779  4148 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:03.175549  1504 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:03.177757  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:03.180989  1684 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:03.178455  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 62667.1us
W20260709 13:02:03.178913  2328 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.019s	sys 0.050s
I20260709 13:02:03.107873  3996 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:03.184967  2328 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.020s	sys 0.050s
W20260709 13:02:03.185832  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 578743us
I20260709 13:02:03.166652  3921 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.198741  1437 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.192929  4126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.029s	sys 0.082s
W20260709 13:02:03.207108  4126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.029s	sys 0.082s
W20260709 13:02:03.353657  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 225468us
I20260709 13:02:03.195583  4087 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
I20260709 13:02:03.366146  1504 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:03.370538  1684 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:03.372301  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.382229  3996 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:03.205893  3921 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.391337  3921 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:03.396320  4149 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:03.400781  4157 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:03.361459  3978 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:03.420980  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 488384us
W20260709 13:02:03.426750  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.434247  1437 catalog_manager.cc:5697] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 3 to 4, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.379310  4125 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:03.402284  4126 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:02:03.447728  1505 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.012s	sys 0.038s
W20260709 13:02:03.471374  1505 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.012s	sys 0.038s
I20260709 13:02:03.473601  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:03.456130  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.476413  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47473.8us
I20260709 13:02:03.391889  3921 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.492687  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:03.471800  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 868633us
I20260709 13:02:03.496508  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.499264  1684 raft_consensus.cc:2410] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:03.549057  1437 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.557439  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 64880us
I20260709 13:02:03.560626  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.561852  1684 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:03.563513  1504 connection.cc:256] RPC call timeout handler was delayed by -1.0971759370000314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15910000000000002s for a response
I20260709 13:02:03.442399  4157 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:02:03.573073  1505 leader_election.cc:336] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.486s (SENT)
W20260709 13:02:03.585311  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 412363us
I20260709 13:02:03.585438  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:03.573896  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.493081  4149 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.569444  1437 catalog_manager.cc:5697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.578658  1534 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:03.492200  4126 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:03.469060  3978 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.500869  3980 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:02:03.582281  4181 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:03.579450  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:03.587257  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.560072  4107 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.589690  1437 catalog_manager.cc:5697] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 3 to 4, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.597662  4149 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:03.612195  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.611908  1437 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:03.599581  4137 consensus_meta.cc:287] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.968s	user 0.015s	sys 0.000s
I20260709 13:02:03.495751  4145 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:02:03.571556  4141 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:03.608291  1504 connection.cc:256] RPC call timeout handler was delayed by -1.0665759370000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
I20260709 13:02:03.592505  4155 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:03.586318  1579 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:03.622151  2368 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:03.582060  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.606590  4121 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:02:03.611937  4177 log.cc:927] Time spent T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:02:03.632365  1437 catalog_manager.cc:5697] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:03.659989  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 301) took 1082 ms. Trace:
I20260709 13:02:03.659860  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:03.602061  4148 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:03.638450   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:03.613035  3980 consensus_queue.cc:1243] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer e8eefefed88a4903b423e9f487c4805a log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:03.630652  1504 leader_election.cc:400] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
I20260709 13:02:03.666795  1504 leader_election.cc:403] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:03.660547  1690 rpcz_store.cc:276] 0709 13:02:02.577933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.589897 (+ 11964us) service_pool.cc:224] Handling call
0709 13:02:02.590136 (+   239us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.590443 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.590468 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.590903 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.097240 (+506337us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:03.097285 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.097358 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.659746 (+562388us) raft_consensus.cc:1685] finished
0709 13:02:03.659769 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.659908 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8186,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4582,"thread_start_us":464473,"threads_started":1,"wal-append.queue_time_us":811100}
I20260709 13:02:03.668064  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.661060  1684 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.554270  3921 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.684715  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 296) took 1287 ms. Trace:
I20260709 13:02:03.685175  1537 rpcz_store.cc:276] 0709 13:02:02.396966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.401659 (+  4693us) service_pool.cc:224] Handling call
0709 13:02:03.683935 (+1282276us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b5800001298. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:02:03.684190 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.684376 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.684400 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.684452 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:03.684483 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.684535 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.684654 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288384}
I20260709 13:02:03.666353  4189 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.705030  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.705963  1690 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:03.682993  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.708153  1685 raft_consensus.cc:2410] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:03.711201  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:03.718894  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.719910  1685 raft_consensus.cc:2410] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:03.721014  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.722360  1685 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:03.631088  4137 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.724421  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.627033  4107 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.725216  1685 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:03.692544  3980 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:03.623858  4181 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.696249  4149 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:03.725852  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.745785  1690 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:03.735298  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.709446  4075 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:03.752207  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 165982us
I20260709 13:02:03.752985  1579 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:03.762279  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.725775  4121 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:03.763953  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.765161  1682 raft_consensus.cc:2410] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:03.732744  4074 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:03.769235  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1443) took 1523 ms. Trace:
I20260709 13:02:03.767078  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.769595  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.769615  1682 rpcz_store.cc:276] 0709 13:02:02.245365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.261093 (+ 15728us) service_pool.cc:224] Handling call
0709 13:02:03.763762 (+1502669us) spinlock_profiling.cc:243] Waited 7.97 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:03.769177 (+  5415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18330368}
I20260709 13:02:03.771188  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.763305  4075 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.772446  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.773082  4181 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:03.773816  4186 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:02:03.773922  4075 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:03.775256  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 252) took 1586 ms. Trace:
I20260709 13:02:03.775800  4107 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:03.776144  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:03.777103  1686 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 3: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:03.777534  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1440) took 1536 ms (client timeout 1625 ms). Trace:
W20260709 13:02:03.777911  1686 rpcz_store.cc:269] 0709 13:02:02.241231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.241696 (+   465us) service_pool.cc:224] Handling call
0709 13:02:03.775929 (+1534233us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:03.777477 (+  1548us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4310784}
I20260709 13:02:03.780125  4106 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:02:03.780639  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 224376us
I20260709 13:02:03.781002  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.781590  1687 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:03.761965  4149 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:03.782040  1687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1442) took 1539 ms (client timeout 1895 ms). Trace:
W20260709 13:02:03.782405  1687 rpcz_store.cc:269] 0709 13:02:02.242310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.260875 (+ 18565us) service_pool.cc:224] Handling call
0709 13:02:03.780871 (+1519996us) spinlock_profiling.cc:243] Waited 7.24 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:03.781989 (+  1118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16645504}
W20260709 13:02:03.784183  4180 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:02:03.787353  3978 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:03.733806  4157 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:03.788213  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.793855  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1700) took 1171 ms. Trace:
W20260709 13:02:03.764163  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:03.771458  4176 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:02:03.775633  1609 rpcz_store.cc:276] 0709 13:02:02.189226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.209629 (+ 20403us) service_pool.cc:224] Handling call
0709 13:02:02.210107 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.214928 (+  4821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.214976 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:03.133690 (+918714us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b2c0000e5c8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:02:03.134101 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.598026 (+463925us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:03.598070 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.598144 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:03.774950 (+176806us) raft_consensus.cc:1685] finished
0709 13:02:03.774968 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.775196 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33213696,"thread_start_us":463499,"threads_started":1,"wal-append.queue_time_us":493316}
I20260709 13:02:03.802076  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:03.800323  1685 rpcz_store.cc:276] 0709 13:02:02.622724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.792703 (+1169979us) service_pool.cc:224] Handling call
0709 13:02:03.793154 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.793395 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.793436 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.793498 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:03.793548 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.793623 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.793774 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.803452  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1452) took 1199 ms. Trace:
I20260709 13:02:03.802258  1684 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:03.805919  2328 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:03.804105  1688 rpcz_store.cc:276] 0709 13:02:02.604280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.145435 (+541155us) service_pool.cc:224] Handling call
0709 13:02:03.173210 (+ 27775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.173510 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:03.650330 (+476820us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.802065 (+151735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.802321 (+   256us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.802583 (+   262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.802849 (+   266us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.803347 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":561231,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":578006,"threads_started":2}
I20260709 13:02:03.802793  1579 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:03.812992  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1705) took 1057 ms. Trace:
I20260709 13:02:03.814698  1682 rpcz_store.cc:276] 0709 13:02:02.755980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.811970 (+1055990us) service_pool.cc:224] Handling call
0709 13:02:03.812377 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.812591 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.812630 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.812686 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.812730 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.812798 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.812925 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.784024  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1702) took 1153 ms. Trace:
I20260709 13:02:03.816217  1687 rpcz_store.cc:276] 0709 13:02:02.631064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.783206 (+1152142us) service_pool.cc:224] Handling call
0709 13:02:03.783550 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.783716 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.783748 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.783787 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.783817 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.783872 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.783972 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.813975  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1701) took 1189 ms. Trace:
I20260709 13:02:03.817502  1686 rpcz_store.cc:276] 0709 13:02:02.624390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.778772 (+1154382us) service_pool.cc:224] Handling call
0709 13:02:03.779098 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.813576 (+ 34478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.813613 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.813667 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.813715 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.813791 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.813913 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.747713  3980 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:03.822096  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1698) took 1208 ms. Trace:
I20260709 13:02:03.768308  4121 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.825111  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:03.824468  1690 rpcz_store.cc:276] 0709 13:02:02.614043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.788158 (+1174115us) service_pool.cc:224] Handling call
0709 13:02:03.821440 (+ 33282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.821662 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:03.821698 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.821754 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.821804 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.821880 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.822020 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:03.831519  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:03.833539  1685 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:03.835568  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.836381  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:03.836668  1608 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:03.836441  1610 raft_consensus.cc:2410] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:03.788568  4074 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:03.837713  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 207302us
I20260709 13:02:03.779033  4137 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:03.825769  1535 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:02:03.837721  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:03.820848  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:03.841358  1607 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:03.844023  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1451) took 1246 ms. Trace:
I20260709 13:02:03.844838  1683 rpcz_store.cc:276] 0709 13:02:02.597763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.119319 (+521556us) service_pool.cc:224] Handling call
0709 13:02:03.176758 (+ 57439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.206624 (+ 29866us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:03.633515 (+426891us) log.cc:844] Serialized 14 byte log entry
0709 13:02:03.841851 (+208336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:03.843428 (+  1577us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:03.843558 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:03.843734 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:03.843932 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10690,"prepare.queue_time_us":552329,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":4777,"raft.queue_time_us":11188,"thread_start_us":364303,"threads_started":2}
I20260709 13:02:03.848302  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.849262  1611 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:03.851253  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:03.857237  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:03.857924  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 88531.2us
I20260709 13:02:03.808902  4199 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:03.715485  4189 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.823451  4075 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.824427  4190 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:03.837227  3978 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:03.838536  4121 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:03.870306  1687 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:03.841801  4141 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:03.878680  1687 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:02:03.810422  4157 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.879287  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:03.732678  4126 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.845379  4074 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:03.864264  4202 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:03.839515  4149 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:02:03.858765  4107 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:03.857273  4200 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:03.868448  4199 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.901221  1504 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:03.911139  1687 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:03.911518  1687 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:03.899670  3978 raft_consensus.cc:697] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:03.919706  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:03.908250  4184 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:03.916256  1687 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.872063  4195 consensus_queue.cc:1059] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:02:03.878942  4075 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.908293  4199 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:03.881572  4190 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:03.910143  4200 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:03.934098  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 361918us
I20260709 13:02:03.950659  4195 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:03.950392  4200 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:03.951352  4195 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:03.966574  1580 leader_election.cc:336] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.110s (SENT)
I20260709 13:02:03.967410  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:03.968904  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.945698  3921 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:03.930022  4107 consensus_queue.cc:1059] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:02:03.995182  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:03.996263  1687 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:04.000025  1654 connection.cc:256] RPC call timeout handler was delayed by -1.8061272499999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:02:04.000782  1654 connection.cc:256] RPC call timeout handler was delayed by -1.8007272499999658s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
W20260709 13:02:04.000801  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.001175  1654 connection.cc:256] RPC call timeout handler was delayed by -1.7980272499999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:02:04.001549  1654 connection.cc:256] RPC call timeout handler was delayed by -1.7791272499999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 13:02:04.001894  1654 connection.cc:256] RPC call timeout handler was delayed by -1.7080272499999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 13:02:04.001763  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 122596us
I20260709 13:02:03.914250  3980 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:04.037622  1613 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:02:04.034755  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:04.043951  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:04.061375  1613 pending_rounds.cc:85] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 5
I20260709 13:02:03.992959  4189 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:04.061693  1607 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:04.062186  1613 pending_rounds.cc:107] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:02:04.062718  1613 raft_consensus.cc:2889] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.062876  4189 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:04.012596  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:04.063510  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:04.064154  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:04.064294  1611 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:04.009261  4204 log.cc:927] Time spent T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:02:04.046736  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:04.037352  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.065670  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:04.066601  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:04.067351  1615 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.070605  1613 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:04.064383  1607 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.005829  3978 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:04.049106  4201 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:02:04.047514  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:04.075546  1682 raft_consensus.cc:606] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:04.075984  1682 raft_consensus.cc:614] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:04.077622  1682 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:04.009244  4194 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:03.980475  4195 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:04.082806  1682 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:04.079243  1613 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:03.981410  4141 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:04.091140  1682 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:04.094391  1682 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:04.095218  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1703) took 1339 ms. Trace:
I20260709 13:02:04.178495  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1721) took 1010 ms. Trace:
I20260709 13:02:04.097501  1681 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:04.091193  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 190046us
W20260709 13:02:04.009789  4198 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:02:04.099246  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.009892  4196 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:02:04.115751  4215 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:04.038374  4190 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:04.112630  1616 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:04.128300  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 253) took 1938 ms. Trace:
I20260709 13:02:04.009478  4207 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.182s
I20260709 13:02:04.129426  4195 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:04.129817  4214 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:04.130882  1690 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:04.112321  4149 raft_consensus.cc:3055] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:04.197264  1687 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:02:04.109797  4107 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:04.179247  1682 rpcz_store.cc:276] 0709 13:02:03.167837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.093597 (+925760us) service_pool.cc:224] Handling call
0709 13:02:04.093957 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.178138 (+ 84181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.178412 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.109558  4208 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:04.179733  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1723) took 1005 ms. Trace:
I20260709 13:02:04.180706  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:04.178282  1684 rpcz_store.cc:276] 0709 13:02:02.755388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.807030 (+1051642us) service_pool.cc:224] Handling call
0709 13:02:03.807462 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.807735 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:03.847750 (+ 40015us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.094864 (+247114us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.094912 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:04.094958 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.095021 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.095157 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":63664,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":124,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":23944,"thread_start_us":246630,"threads_started":1}
I20260709 13:02:04.200786  1681 rpcz_store.cc:276] 0709 13:02:03.174419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.096851 (+922432us) service_pool.cc:224] Handling call
0709 13:02:04.097157 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.179384 (+ 82227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.179671 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:04.192247  1612 rpcz_store.cc:276] 0709 13:02:02.189467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:02.210329 (+ 20862us) service_pool.cc:224] Handling call
0709 13:02:02.210656 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:02.211003 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:02.211027 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:02.227765 (+ 16738us) log.cc:844] Serialized 26 byte log entry
0709 13:02:03.787729 (+1559964us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b18000242e0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:02:03.830709 (+ 42980us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:03.883459 (+ 52750us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.064780 (+181321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.064861 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:04.120967 (+ 56106us) raft_consensus.cc:1685] finished
0709 13:02:04.127940 (+  6973us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.128208 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149756,"prepare.run_wall_time_us":60,"raft.queue_time_us":122992,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":17963,"spinlock_wait_cycles":50719872,"thread_start_us":275621,"threads_started":3,"wal-append.queue_time_us":1680079}
W20260709 13:02:04.203892  4212 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:02:04.110888  1615 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:04.197682  4149 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:04.200788  4157 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:04.198549  4214 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:04.203414  4203 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:04.197825  1687 pending_rounds.cc:85] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 3
I20260709 13:02:04.228972  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1704) took 1473 ms. Trace:
W20260709 13:02:04.229696  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.230463  1689 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:04.233042  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 230579us
I20260709 13:02:04.486296  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1455) took 1075 ms. Trace:
W20260709 13:02:04.271571  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 420408us
I20260709 13:02:04.232820  1684 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:04.487107  1689 rpcz_store.cc:276] 0709 13:02:03.410417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.199818 (+789401us) service_pool.cc:224] Handling call
0709 13:02:04.230178 (+ 30360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.485778 (+255600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.486072 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:04.328754  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 65090.6us
W20260709 13:02:04.334317  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.190254  4215 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:04.492544  1687 pending_rounds.cc:107] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:02:04.493000  1687 raft_consensus.cc:2889] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.493068  4215 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:04.493923  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1714) took 1327 ms. Trace:
I20260709 13:02:04.520690  1687 rpcz_store.cc:276] 0709 13:02:03.166009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.908800 (+742791us) service_pool.cc:224] Handling call
0709 13:02:03.911024 (+  2224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.493634 (+582610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.493864 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:04.349905  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 95866.5us
W20260709 13:02:04.350569  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 169954us
I20260709 13:02:04.522882  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:04.497665  1607 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:04.500269  4190 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:04.501256  4182 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:02:04.504333  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1707) took 1591 ms. Trace:
I20260709 13:02:04.495239  1688 rpcz_store.cc:276] 0709 13:02:02.755693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.810474 (+1054781us) service_pool.cc:224] Handling call
0709 13:02:03.811261 (+   787us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.811468 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:03.870856 (+ 59388us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.205489 (+334633us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b18002e0a80. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a823a
0709 13:02:04.228480 (+ 22991us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.228563 (+    83us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:04.228627 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.228726 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.228889 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36140,"prepare.queue_time_us":67069,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":1744,"raft.queue_time_us":27274,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"spinlock_wait_cycles":9005440,"thread_start_us":38636,"threads_started":1,"wal-append.queue_time_us":76866}
W20260709 13:02:04.462653  4074 consensus_meta.cc:287] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.012s
I20260709 13:02:04.531097  1685 rpcz_store.cc:276] 0709 13:02:02.912883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.835041 (+922158us) service_pool.cc:224] Handling call
0709 13:02:03.838852 (+  3811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:03.845460 (+  6608us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:04.014309 (+168849us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.503776 (+489467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.503854 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:04.503926 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.504022 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.504244 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25920,"prepare.queue_time_us":59679,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":1167,"raft.queue_time_us":1070,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":8884,"thread_start_us":624794,"threads_started":2,"wal-append.queue_time_us":489442}
I20260709 13:02:04.534224  4074 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:04.534895  1654 leader_election.cc:336] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.673s (SENT)
W20260709 13:02:04.442432  4106 consensus_meta.cc:287] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.662s	user 0.008s	sys 0.012s
W20260709 13:02:04.442862  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.490665  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.512521  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:04.197304  4184 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:04.364933  4207 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.153s
I20260709 13:02:04.516548  1579 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:04.518405  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:04.565744  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 49331.8us
I20260709 13:02:04.286876  3816 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.253073  4075 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:04.541682  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 528780us
I20260709 13:02:04.548645  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:04.569322  1685 raft_consensus.cc:606] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
W20260709 13:02:04.561053  1654 connection.cc:256] RPC call timeout handler was delayed by -1.6027272499999867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260709 13:02:04.515058  4175 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 13:02:04.570333  1654 connection.cc:256] RPC call timeout handler was delayed by -1.5982272499999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:02:04.570194  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:04.501583  4125 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:02:04.530045  4107 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:02:04.577133  1654 connection.cc:256] RPC call timeout handler was delayed by -1.597327249999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 13:02:04.582216  1654 connection.cc:256] RPC call timeout handler was delayed by -1.5460272499999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 13:02:04.582636  1654 connection.cc:256] RPC call timeout handler was delayed by -1.544227249999949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 13:02:04.582986  1654 connection.cc:256] RPC call timeout handler was delayed by -1.5199272499999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 13:02:04.583302  1654 connection.cc:256] RPC call timeout handler was delayed by -1.4938272499999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:02:04.583643  1654 connection.cc:256] RPC call timeout handler was delayed by -1.4461272499999609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 13:02:04.583869  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:04.583943  1654 connection.cc:256] RPC call timeout handler was delayed by -1.3966272499999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 13:02:04.584116  4149 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:04.584766  1654 connection.cc:256] RPC call timeout handler was delayed by -1.3723272499999553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2239s for a response
I20260709 13:02:04.585075  4074 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:04.585178  1654 connection.cc:256] RPC call timeout handler was delayed by -1.3183272499999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2299s for a response
I20260709 13:02:04.585667  4149 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.587548  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:04.588423  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.005s	sys 0.011s
I20260709 13:02:04.564977  4106 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5.
W20260709 13:02:04.588901  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.005s	sys 0.011s
I20260709 13:02:04.527022  4126 consensus_queue.cc:1059] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:02:04.592818  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 626144us
I20260709 13:02:04.604806  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:04.579687  4175 consensus_queue.cc:1243] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:02:04.590009  4199 consensus_meta.cc:287] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.005s
I20260709 13:02:04.494884  4203 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:04.582558  4215 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:04.609566  4160 raft_consensus.cc:2764] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:04.612584  4126 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:02:04.625475  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.614367  4199 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:04.671835  4107 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:04.692806  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91dad730840e45b68065507815614a40"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:04.578306  3816 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:04.696926  1683 raft_consensus.cc:606] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
W20260709 13:02:04.684428  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 79879.5us
I20260709 13:02:04.698117  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:04.671465  4219 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:04.699250  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 89210.4us
I20260709 13:02:04.699889  1683 raft_consensus.cc:614] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:04.701601  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 311) took 1003 ms. Trace:
I20260709 13:02:04.703723  1681 rpcz_store.cc:276] 0709 13:02:03.698541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.227699 (+529158us) service_pool.cc:224] Handling call
0709 13:02:04.228003 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.228261 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:04.321768 (+ 93507us) log.cc:844] Serialized 14 byte log entry
0709 13:02:04.701045 (+379277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.701125 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:04.701192 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.701277 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.701427 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13160,"prepare.queue_time_us":99976,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"thread_start_us":365539,"threads_started":1}
W20260709 13:02:04.726861  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 204094us
I20260709 13:02:04.687228  3978 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.683081  4194 raft_consensus.cc:3055] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:04.705658  4207 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.706125  4160 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:04.706923  4106 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.726603  4219 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:04.768958  1580 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.182s (SENT)
I20260709 13:02:04.705528  4200 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:02:04.745201  4162 raft_consensus.cc:2764] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:02:04.772411  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 203168us
I20260709 13:02:04.770802  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:04.742123  4194 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:04.777505  1681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:04.778133  1681 raft_consensus.cc:606] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:04.778463  1681 raft_consensus.cc:614] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:04.776106  1504 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:04.736121  4148 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:02:04.752760  4160 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:04.746134  4074 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:02:04.787765  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:04.790021  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 260399us
I20260709 13:02:04.791879  4199 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:04.793329  4236 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:02:04.794366  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.796731  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 303) took 1244 ms. Trace:
I20260709 13:02:04.797145  1682 rpcz_store.cc:276] 0709 13:02:03.552145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.200022 (+647877us) service_pool.cc:224] Handling call
0709 13:02:04.200377 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:04.742655 (+542278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.742706 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:04.742774 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:04.742834 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:04.796505 (+ 53671us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400078854. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:04.796552 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:04.796669 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239665408}
I20260709 13:02:04.798345  3921 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:04.799216  4237 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:04.799916  4243 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:04.801254  3816 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:04.801762  4148 consensus_queue.cc:1243] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer e8eefefed88a4903b423e9f487c4805a log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:04.801877  4239 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:04.802440  4148 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:04.801406  4229 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:02:04.730307  4184 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:04.800026  4235 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:04.755682  4207 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:04.809985  4231 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:04.804808  4195 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:02:04.752300  3978 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:04.815569  4121 consensus_meta.cc:287] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.917s	user 0.014s	sys 0.009s
I20260709 13:02:04.782449  4125 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:02:04.817742  4178 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.787567  4160 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:04.830631  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:04.805986  3873 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:02:04.949038  4245 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:04.859450  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 71795.5us
I20260709 13:02:04.817775  4208 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:04.965291  4203 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:04.964640  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 266655us
I20260709 13:02:04.832551  4121 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:04.807418  4148 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.969668  1504 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:04.951066  4241 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.148s	user 0.001s	sys 0.002s
I20260709 13:02:05.019876  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:04.971066  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:04.972690  4190 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:04.965832  4245 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:05.018360  1681 pending_rounds.cc:85] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 3
I20260709 13:02:04.945067  4235 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:02:05.030174  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 60557us
I20260709 13:02:05.031369  1504 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:05.031813  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.033310  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:05.037129  3989 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:04.970352  4202 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.062s	user 0.015s	sys 0.011s
I20260709 13:02:05.041118  3816 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:05.042141  4202 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.027093  1681 pending_rounds.cc:107] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:02:04.848677  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:05.043228  1681 raft_consensus.cc:2889] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:04.848286  4243 consensus_queue.cc:1243] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer e8eefefed88a4903b423e9f487c4805a log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:02:05.040769  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:05.016924  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 186382us
I20260709 13:02:05.046948  4173 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.047732  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.052250  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:05.053612  2368 raft_consensus.cc:2410] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:05.054023  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.055028  1687 raft_consensus.cc:2410] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:04.823935  4219 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.062654  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:05.062861  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.064972  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.065580  1684 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:05.067938  1690 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:05.004247  4208 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:05.071538  1686 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:04.837735  4074 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.219s
I20260709 13:02:05.074524  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.076215  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:05.022445  4148 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.076644  1537 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:02:05.077030  1684 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:05.081637  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.082314  1683 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:02:05.085228  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:04.846825  4178 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:05.109098  4149 consensus_meta.cc:287] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.005s
I20260709 13:02:05.133982  4121 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:05.134850  4234 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.434s	user 0.002s	sys 0.013s
I20260709 13:02:05.081027  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:05.086393  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 280524us
I20260709 13:02:05.055846  4203 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.135969  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 254) took 1332 ms. Trace:
I20260709 13:02:05.146207  1609 rpcz_store.cc:276] 0709 13:02:03.803684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:03.803813 (+   129us) service_pool.cc:224] Handling call
0709 13:02:03.804164 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:04.561828 (+757664us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b18001a2600. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba18455 00007fd02eb00060 00007fd02eb00bfb 00007fd02eb0b64b
0709 13:02:04.562023 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:04.562066 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:04.568412 (+  6346us) log.cc:844] Serialized 26 byte log entry
0709 13:02:04.775229 (+206817us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:04.775265 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.025022 (+249757us) spinlock_profiling.cc:243] Waited 96.1 ms on lock 0x7b54000113d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:05.025095 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:05.135745 (+110650us) raft_consensus.cc:1685] finished
0709 13:02:05.135764 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:05.135905 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":148073,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7216,"spinlock_wait_cycles":227900544,"thread_start_us":369982,"threads_started":2,"wal-append.queue_time_us":315345}
I20260709 13:02:05.090065  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:05.137753  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52600.5us
I20260709 13:02:05.143524  1684 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:02:05.132196  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:05.073230  4243 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.150267  1579 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:05.152493  4243 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:05.160296  3873 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:05.124366  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:05.162601  4162 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:05.162842  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.163550  1535 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:05.132097  3978 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:05.160601  4243 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.148135  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.068307  4141 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:05.232664  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.069281  4230 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.143s
I20260709 13:02:05.146054  4199 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:05.229914  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 65292.3us
I20260709 13:02:05.168872  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:05.226604  3980 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.269834  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:05.154584  4258 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:05.158703  4207 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:05.272311  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 124265us
I20260709 13:02:05.226774  4208 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.157914  4149 consensus_queue.cc:1059] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.120s
I20260709 13:02:05.253702  4141 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:05.153400  4245 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:05.338501  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 305283us
I20260709 13:02:05.458598  1504 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.362641  4255 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:05.459658  4255 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:05.460013  4255 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:05.460578  4106 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.000s
I20260709 13:02:05.461083  4106 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.461755  4106 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:05.302081  4252 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:02:05.280591  2364 raft_consensus.cc:2393] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:05.156258  1684 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:02:05.157804  4190 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:05.280647  3980 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:05.448884  1540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.009s
W20260709 13:02:05.474524  1540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.000s	sys 0.010s
I20260709 13:02:05.277681  4256 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:05.441603  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 351629us
W20260709 13:02:05.301046  4251 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:02:05.468145  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.436911  4208 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.462287  4106 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:05.281390  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.450496  4141 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.278142  4258 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:05.282284  4259 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:05.464886  4254 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.355s	user 0.000s	sys 0.001s
I20260709 13:02:05.473737  4190 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.495309  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:05.497256  1607 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:05.477306  4245 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.505698  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.506465  1540 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:02:05.509289  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:05.281688  4257 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.431s
I20260709 13:02:05.476053  4042 consensus_queue.cc:1059] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:02:05.527133  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 245842us
I20260709 13:02:05.495577  4259 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.501859  4190 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.546130  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:05.546451  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:05.495312  4258 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:05.547166  1607 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:05.547889  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.547060  1616 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.567939  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:05.572932  1612 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:02:05.534807  4259 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.577978  2329 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:05.556573  4260 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.563993  4203 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:05.561432  4178 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:05.630990  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:02:05.632578  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 174060us
W20260709 13:02:05.635867  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 54146.6us
I20260709 13:02:05.607761  4074 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:05.624265  4203 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:05.651343  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.641498  3980 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:05.642180  4260 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:05.645025  4178 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:05.617228  4042 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:05.659294  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.644544  4257 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:05.674060  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.674778  1534 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:05.673355  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 164174us
I20260709 13:02:05.654490  4203 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.682798  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:05.683736  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:05.684589  1616 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:05.684589  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.686928  1535 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:05.689590  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 141777us
I20260709 13:02:05.691037  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.664397  4178 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.672998  4042 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.655215  4074 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:05.686396  4148 consensus_meta.cc:287] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 13:02:05.694422  3980 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:05.720834  4215 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.105s	user 0.013s	sys 0.000s
I20260709 13:02:05.709136  4106 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:05.720479  4042 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.706363  1539 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:05.709758  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:05.747139  1534 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:05.723256  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:05.733009  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.749908  1535 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:05.737540  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:05.735312  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.731779  4148 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:05.739627  4270 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:02:05.739964  4074 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:05.740218  4268 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:02:05.741161  4264 log.cc:927] Time spent T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:02:05.691466  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.691866  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:05.768503  3980 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:05.769207  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 77437.4us
I20260709 13:02:05.769619  3980 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:05.783284  4269 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:02:05.708801  4274 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:05.761615  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.700119  4276 consensus_queue.cc:1059] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:02:05.780176  2371 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:05.770459  1654 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:05.770428  4279 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:05.838735  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 68382.2us
I20260709 13:02:05.839763  1654 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:05.771826  4215 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:05.773097  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:05.846359  1580 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.429s (SENT) [suppressed 39 similar messages]
W20260709 13:02:05.771271  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 79905.6us
I20260709 13:02:05.794061  4207 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:05.797178  4240 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.981s	user 0.003s	sys 0.013s
I20260709 13:02:05.763851  4273 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:05.804191  4242 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:05.809175  4170 raft_consensus.cc:3055] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:02:05.815627  4243 consensus_meta.cc:287] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.546s	user 0.004s	sys 0.005s
I20260709 13:02:05.817518  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:05.868168  1686 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:05.869493  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.870997  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.819654  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:02:05.872514  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 52986.8us
I20260709 13:02:05.821879  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:05.823063  4247 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.008s	user 0.008s	sys 0.016s
I20260709 13:02:05.879968  4243 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.719705  4178 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:05.782421  4267 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:02:05.780742  4148 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:05.775200  4173 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.727s	user 0.012s	sys 0.000s
I20260709 13:02:05.892597  4173 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:05.784392  4160 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.761s	user 0.002s	sys 0.010s
I20260709 13:02:05.833477  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:05.893433  4160 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.895537  4160 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:05.865666  4170 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:05.896359  4279 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.896979  4279 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.896791  4170 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:05.866503  4273 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.897922  4170 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.899700  4273 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:05.850970  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.902791  1682 raft_consensus.cc:606] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:05.903218  1682 raft_consensus.cc:614] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:05.903667  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60148 (request call id 20) took 1057 ms. Trace:
I20260709 13:02:05.904505  2368 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:05.863162  4242 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:05.905603  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:05.906213  1685 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:05.906445  4242 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 1, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.907485  4242 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.908913  1613 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:05.909286  4194 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:05.911201  4194 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:05.911584  4173 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:05.913546  3996 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:05.914184  3996 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:05.915100  3996 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:05.876770  1688 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:05.823647  4202 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:05.837033  4255 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.855062  4207 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:05.831848  4190 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:05.886570  4278 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
I20260709 13:02:05.886431  4224 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:05.844210  4274 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:05.924294  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.929708  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.903939  1682 rpcz_store.cc:276] 0709 13:02:04.846584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.848488 (+  1904us) service_pool.cc:224] Handling call
0709 13:02:05.902615 (+1054127us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae4c40 00007fd033ad0bb9 00007fd033ad047c 00007fd02d0567d4
0709 13:02:05.903584 (+   969us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14848768}
I20260709 13:02:05.935695  1534 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:05.936947  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.944437  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.944793  1688 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
W20260709 13:02:05.937781  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:05.943100  1609 raft_consensus.cc:3055] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:05.945847  1609 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:05.946277  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:05.946983  1682 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:05.948457  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:05.951964  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 101090us
I20260709 13:02:05.953624  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.955386  1505 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.956719  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.958005  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.959439  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:05.964176   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:05.964361  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:05.934883  4202 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:05.965436  1533 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:05.966408   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:05.969067  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.940553  4224 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.971537  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.968709  1613 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:05.972458  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.977221  1538 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:05.979143  1535 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:05.979421  1538 raft_consensus.cc:1217] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[8.9-8.9]   Dedup: 8.9->[]
I20260709 13:02:05.980161  1538 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:02:05.936743  4256 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:05.982569  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.987845  1538 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:02:05.989053  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:05.984483  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.951675  4208 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:05.993031  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.935331  4141 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:05.964589  4273 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.000671  1540 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:05.965696  4195 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.886601  4259 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.002849  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:05.967993  4245 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:05.969954  4220 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:06.024302  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.034018  1535 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:02:06.035130  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.048202  1534 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:05.973270  4148 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:05.940819  4042 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.054189  1532 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:06.065287  1534 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:02:06.069490  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 229871us
I20260709 13:02:06.070564  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:06.072207  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:06.073786  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:06.076390  4224 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:06.078401  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:06.078979  1535 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:06.080914  1534 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:06.084587  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.101891  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:06.106056  1580 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.508s (SENT)
I20260709 13:02:06.108673  1534 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:06.111555  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.112170  1535 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.112788  1684 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:06.003552  4207 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.037125  4203 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.117146  1685 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:06.083132  4279 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.085940  4160 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:06.015857  4258 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.084669  4219 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:06.085884  4074 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.142410  1580 leader_election.cc:336] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.545s (SENT)
W20260709 13:02:06.124192  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45855us
I20260709 13:02:06.055414  4202 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.125801  4207 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.126297  4285 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:02:06.127664  4286 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:02:06.114544  4107 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.134572  4141 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:06.135725  4263 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.472s	user 0.003s	sys 0.000s
I20260709 13:02:06.136159  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.136891  4259 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:06.137665  4258 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:06.111019  4125 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.148804  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:06.196076  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:02:06.189254  1580 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.560s (SENT)
I20260709 13:02:06.099514  4199 consensus_queue.cc:1059] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:02:06.199486  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:06.149138  4243 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:06.201607  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 52931.7us
I20260709 13:02:06.206140  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:06.208287  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:06.209537  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:06.205147  1580 leader_election.cc:336] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.584s (SENT)
I20260709 13:02:06.212494  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:06.192464  4273 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.193336  4292 raft_consensus.cc:2764] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:02:06.181017  4074 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:06.229972  4261 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.953s	user 0.002s	sys 0.000s
I20260709 13:02:06.232297  4279 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.233075  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:06.199668  4255 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:06.237584  1538 raft_consensus.cc:2410] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:06.241182  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1738) took 1159 ms. Trace:
I20260709 13:02:06.252645  1687 rpcz_store.cc:276] 0709 13:02:05.081729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.505439 (+423710us) service_pool.cc:224] Handling call
0709 13:02:05.505734 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.661785 (+156051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.661807 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.672822 (+ 11015us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.842685 (+169863us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:05.842745 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.842849 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.240880 (+398031us) raft_consensus.cc:1685] finished
0709 13:02:06.240907 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.241104 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4385,"raft.queue_time_us":52312,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11613,"thread_start_us":237225,"threads_started":2,"wal-append.queue_time_us":248599}
I20260709 13:02:06.255004  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:06.241633  4182 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.233852  4042 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:06.204793  4125 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.210304  4141 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.208616  4160 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.271633  4125 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:06.214372  4199 consensus_queue.cc:1243] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer 9d926c10b90f452ba52d80dab6a50351 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:06.121717  4256 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.277933  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1740) took 1189 ms. Trace:
I20260709 13:02:06.278388  1688 rpcz_store.cc:276] 0709 13:02:05.088126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.946870 (+858744us) service_pool.cc:224] Handling call
0709 13:02:05.947180 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.954427 (+  7247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.954460 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.966791 (+ 12331us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.189254 (+222463us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:06.189315 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.189424 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.277722 (+ 88298us) raft_consensus.cc:1685] finished
0709 13:02:06.277742 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.277873 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":316,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10558,"thread_start_us":175981,"threads_started":1,"wal-append.queue_time_us":228914}
I20260709 13:02:06.246359  4217 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.246610  4190 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:06.282408  4289 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:02:06.247462  4235 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:06.283555  4203 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:06.284584  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.283581  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1739) took 1195 ms. Trace:
I20260709 13:02:06.249450  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:06.255913  1687 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:06.249369  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44206us
W20260709 13:02:06.256891  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.241721  1535 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:06.267503  3921 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.287223  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:06.288956  1580 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.627s (SENT)
W20260709 13:02:06.289772  1580 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.639s (SENT)
I20260709 13:02:06.290234  1688 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:02:06.290518  1580 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.684s (SENT)
I20260709 13:02:06.285460  1689 rpcz_store.cc:276] 0709 13:02:05.087799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.776109 (+688310us) service_pool.cc:224] Handling call
0709 13:02:05.776547 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.777010 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.777037 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.777550 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.951019 (+173469us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:05.951059 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.951128 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.283384 (+332256us) raft_consensus.cc:1685] finished
0709 13:02:06.283402 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.283525 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1232,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":148,"thread_start_us":173080,"threads_started":1,"wal-append.queue_time_us":299585}
I20260709 13:02:06.293752  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.294438  1535 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.297772  4074 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:06.299435  4274 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:06.300151  3921 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.250836  4279 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:06.314085  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.302871  1579 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:06.303253  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.307118  1535 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:06.299800  1536 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:06.315862  1534 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.264667  4182 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:06.319706  1688 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:06.320384  1579 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:06.283916  4235 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.316385  4217 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.324612  4235 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:06.324496  4217 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.325881  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.326102  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.326728  4199 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:06.327020  1536 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.327142  4199 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.327585  4199 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:06.328150  4194 consensus_queue.cc:1059] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:06.328507  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:06.329032  4184 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:06.329627  4184 raft_consensus.cc:697] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:06.330516  4184 consensus_queue.cc:237] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.317096  4279 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.333837  4074 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:06.335088  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.335703  1533 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:06.340469  4288 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:02:06.341984  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 317) took 1372 ms. Trace:
I20260709 13:02:06.342343  1681 rpcz_store.cc:276] 0709 13:02:04.969986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:04.970102 (+   116us) service_pool.cc:224] Handling call
0709 13:02:04.970698 (+   596us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:05.044009 (+ 73311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.044060 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:05.045444 (+  1384us) log.cc:844] Serialized 590 byte log entry
0709 13:02:05.152267 (+106823us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:05.153059 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.153161 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.229271 (+1076110us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:06.341665 (+112394us) raft_consensus.cc:1685] finished
0709 13:02:06.341685 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.341925 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":113,"spinlock_wait_cycles":15951744,"thread_start_us":106225,"threads_started":1,"wal-append.queue_time_us":229706}
I20260709 13:02:06.345711  1539 raft_consensus.cc:2410] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:06.346282  4182 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:06.349344  4271 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.629s	user 0.004s	sys 0.000s
I20260709 13:02:06.352416  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1734) took 1275 ms. Trace:
I20260709 13:02:06.352775  1690 rpcz_store.cc:276] 0709 13:02:05.077116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.157404 (+ 80288us) service_pool.cc:224] Handling call
0709 13:02:05.162703 (+  5299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.163075 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.163102 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.163622 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 13:02:05.590156 (+426534us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:05.590219 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:05.590324 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.348519 (+758195us) spinlock_profiling.cc:243] Waited 59.7 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:06.352124 (+  3605us) raft_consensus.cc:1685] finished
0709 13:02:06.352143 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.352343 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":342,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"spinlock_wait_cycles":137363200,"thread_start_us":153166,"threads_started":1,"wal-append.queue_time_us":497136}
I20260709 13:02:06.354367  4230 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:06.355700  4230 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:06.356993  4230 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.325958  1684 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:06.360760  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 151331us
W20260709 13:02:06.361029  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.361665  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:06.362085  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:06.367663  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:06.370106  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.374118  1681 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:06.377862  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:06.318748  4162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.004s	sys 0.006s
I20260709 13:02:06.358083  4230 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.396637  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:06.395990  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:06.397792  1684 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:06.400112  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:06.403420  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.353354  4208 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:06.405092  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.407841  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:06.409101  1684 raft_consensus.cc:1240] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:06.410265  1534 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:06.410854  1684 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.414844  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:06.416621  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.411793  4292 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:06.418399  4292 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:06.418781  4292 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.390444  4106 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.395884  4160 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:06.424337  4160 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:06.424914  4160 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:06.423584  4199 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:06.426275  4297 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 13:02:06.426385  4293 log.cc:927] Time spent T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.288s	user 0.000s	sys 0.002s
I20260709 13:02:06.427381  4199 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:06.427443  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1744) took 1325 ms. Trace:
I20260709 13:02:06.424988  4304 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:06.428248  4304 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:06.428791  4304 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.427999  1686 rpcz_store.cc:276] 0709 13:02:05.101712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.958828 (+857116us) service_pool.cc:224] Handling call
0709 13:02:05.959078 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.965907 (+  6829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.965934 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.966362 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.124724 (+158362us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:06.124762 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.143854 (+ 19092us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.427246 (+283392us) raft_consensus.cc:1685] finished
0709 13:02:06.427268 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.427386 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10059,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12250,"thread_start_us":127629,"threads_started":1,"wal-append.queue_time_us":212629}
I20260709 13:02:06.429493  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.430486  1686 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:06.406316  4141 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:06.431653  4141 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.431910  1686 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:06.398805  4224 consensus_queue.cc:1059] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:02:06.432101  4141 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.397795  4162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.005s	sys 0.007s
I20260709 13:02:06.432773  4224 raft_consensus.cc:3055] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:06.433204  4224 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:06.434077  4224 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.436689  1533 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:06.440557  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1742) took 1339 ms. Trace:
I20260709 13:02:06.441102  4162 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:06.441814  4162 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:06.441032  1682 rpcz_store.cc:276] 0709 13:02:05.101147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.949064 (+847917us) service_pool.cc:224] Handling call
0709 13:02:05.949344 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:05.949849 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:05.949877 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:05.951349 (+  1472us) log.cc:844] Serialized 26 byte log entry
0709 13:02:06.124622 (+173273us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:06.124663 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.143018 (+ 18355us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:06.438567 (+295549us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:06.440147 (+  1580us) raft_consensus.cc:1685] finished
0709 13:02:06.440170 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.440462 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16102,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":13760,"spinlock_wait_cycles":2375040,"thread_start_us":132083,"threads_started":1,"wal-append.queue_time_us":321465}
I20260709 13:02:06.442607  4279 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.443104  4162 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.443856  1683 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:06.445561  4279 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:06.345911  4217 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:06.449523  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.450475  1533 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:06.453658  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.458123  1539 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:06.435376  4224 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.466763  1539 raft_consensus.cc:1240] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:06.468700  1536 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:06.418911  4307 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:06.519964  1532 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:06.520411  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:06.529803  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 115039us
I20260709 13:02:06.531056  1532 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:06.531416  1654 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:06.516330  4307 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:06.543654  4279 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:06.534816  1533 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:06.558911  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.551144  4307 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.557703  4279 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:06.565008  4279 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:06.569476  1609 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.570804  1609 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:06.576390  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.577347  1540 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:06.580132  4256 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:06.580734  4256 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:06.581835  4178 consensus_meta.cc:287] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.004s
I20260709 13:02:06.582374  4178 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.584276  4307 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.584983  4182 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.586979  4307 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:06.587288  4182 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:06.582711  4279 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.589607  4279 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:06.590555  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.599696  1609 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:06.608747  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.609789  1534 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:06.611490  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.584899  4202 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.555249  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.538160  1535 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:06.551826  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:06.626806  1654 connection.cc:256] RPC call timeout handler was delayed by -1.1875721480000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15560000000000002s for a response
W20260709 13:02:06.628732  1654 connection.cc:256] RPC call timeout handler was delayed by -1.1200721480000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:02:06.628805  1532 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:06.629091  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0822721480000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1673s for a response
W20260709 13:02:06.630744  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0606721479999806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 13:02:06.631229  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0093721480000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
I20260709 13:02:06.632128  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:06.634382  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:06.627513  1534 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:06.642198  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:06.645689  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.646709  1534 raft_consensus.cc:2368] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7.
I20260709 13:02:06.646776  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 319) took 1522 ms. Trace:
I20260709 13:02:06.652594  4315 raft_consensus.cc:2764] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:06.653584  4315 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:06.654093  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.654876  1538 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:02:06.655678  4175 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:06.647780  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.647316  1537 rpcz_store.cc:276] 0709 13:02:05.124841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.125043 (+   202us) service_pool.cc:224] Handling call
0709 13:02:05.784389 (+659346us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800001298. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:02:06.336547 (+552158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.336782 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:06.336821 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:06.336884 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:06.336930 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:06.337032 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:06.646578 (+309546us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400400e50. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:06.646705 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1273922048}
I20260709 13:02:06.655725  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:06.676118  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.682927  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.692619  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.693632  1537 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:06.626523  4307 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.695699  1689 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:06.636173  4279 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.696316  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:06.703089  1684 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:06.696009  4307 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.645030  4182 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:06.701253  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:06.723256  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.724576  1539 raft_consensus.cc:2393] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:06.655893  4315 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:06.734355  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.723210  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.735296  1537 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:06.736281  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.736871  1537 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:06.727159  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:06.743980  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:06.749365  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 48256.9us
W20260709 13:02:06.750311  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:06.755355  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:06.737766  3980 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.753611  4317 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:02:06.773540  1532 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:06.771896  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.774740  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.748813  4208 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:06.663272  4292 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.790791  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:06.792383  1539 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:06.758111  4106 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:02:06.748947  4279 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:06.778760  4237 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.779908  4178 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:06.810137  1684 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:06.820418  1537 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:06.781168  3980 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.775506  1532 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:02:06.797127  4160 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.838984  3980 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:06.815855  4237 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.825234  4141 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:06.840111  1532 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:06.852254  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:06.855543  1532 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:02:06.859129  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.864877  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 209593us
W20260709 13:02:06.867973  4311 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:02:06.956010  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.976421  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:06.980638  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 107118us
I20260709 13:02:06.874903  4307 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:06.978950  4106 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:06.979101  4162 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:06.985904  1532 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:02:07.012378  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 370251us
I20260709 13:02:07.013823  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:07.021432  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:07.024022  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:07.024673  1654 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:06.989180  4173 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:02:07.007803  4279 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:07.009775  4292 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:02:07.028545  3980 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.030481  4209 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.030746  4307 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:07.042528  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:07.011229  4106 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.020838  4162 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.057178  4292 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.073006  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.074427  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.075510  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.083233  1687 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:07.083320  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:07.096593  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.098369  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:07.078292  4230 consensus_meta.cc:287] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.006s
W20260709 13:02:07.104285  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.013s	sys 0.012s
W20260709 13:02:07.104737  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.013s	sys 0.012s
W20260709 13:02:07.105291  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 747263us
I20260709 13:02:07.060135  4237 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:07.110263  4219 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:07.114172  4184 consensus_queue.cc:1059] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:07.115732  4125 raft_consensus.cc:3055] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:07.116214  4125 raft_consensus.cc:740] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:07.117233  4125 consensus_queue.cc:260] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.056852  4074 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.119297  4074 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.121932  4074 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:07.124763  4312 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:07.126003  4300 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:07.126446  4300 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:07.127420  4300 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.139995  4292 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.140949  4292 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:07.149029  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.065440  4141 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:07.144047  1538 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
W20260709 13:02:07.143646  4202 consensus_meta.cc:287] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.002s
I20260709 13:02:07.083456  4160 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:07.170776  3980 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:07.207616  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.207971  1539 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:07.220681  1539 pending_rounds.cc:85] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 2
I20260709 13:02:07.221110  1539 pending_rounds.cc:107] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:07.150141  4322 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.220366  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.221474  1539 raft_consensus.cc:2889] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.223685  1537 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5. Re-sending same reply.
W20260709 13:02:07.222498  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 139249us
I20260709 13:02:07.119319  4307 raft_consensus.cc:697] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:07.227353  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 90412.5us
I20260709 13:02:07.230753  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.231925  1537 raft_consensus.cc:2410] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:07.234892  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.236092  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.236944  1537 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:07.234825  4329 log.cc:927] Time spent T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
W20260709 13:02:07.241812  4224 consensus_meta.cc:287] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.004s
I20260709 13:02:07.172376  3980 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.252152  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.253060  1534 raft_consensus.cc:2410] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:07.249949  1537 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:07.257521  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.258148  1537 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.240355  4292 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:07.221460  4214 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.275014  4214 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.283474  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.284360  1532 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:07.285687  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 56205.6us
I20260709 13:02:07.289217  1537 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:07.291219  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.292080  1537 raft_consensus.cc:2368] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:07.293053  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.293751  1537 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:02:07.296988  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.298032  1532 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:07.312698  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:07.315557  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.323693  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.324993  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.314872  1532 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.325789  1537 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:07.326905  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.329906  1537 raft_consensus.cc:2410] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:07.334596  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:07.335289  1681 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.335487  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:07.322441  4333 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:02:07.335525  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.338339  1537 raft_consensus.cc:2410] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:02:07.314159  4106 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:07.344559  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:07.344645  1689 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.351851  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.357570  1537 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 3.
I20260709 13:02:07.358518  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.359208  1537 raft_consensus.cc:2376] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6. Re-sending same reply.
I20260709 13:02:07.360741  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.360874  1682 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:07.362008  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:07.362576  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.362556  1537 raft_consensus.cc:2376] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6. Re-sending same reply.
I20260709 13:02:07.363552  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.364290  1537 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:07.365056  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.365526  1537 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.367390  1681 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:07.296128  4307 consensus_queue.cc:237] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.372251  1537 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:07.373349  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.373837  1537 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:02:07.338109  4340 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:02:07.379509  3921 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:07.380715  1537 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:02:07.382118  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1663) took 1113 ms. Trace:
I20260709 13:02:07.387534  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:07.345625  4304 consensus_meta.cc:287] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.916s	user 0.009s	sys 0.005s
I20260709 13:02:07.387130  1539 rpcz_store.cc:276] 0709 13:02:06.268758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.827542 (+558784us) service_pool.cc:224] Handling call
0709 13:02:06.837509 (+  9967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.223868 (+386359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.381842 (+157974us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b540030b454. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:07.382039 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851097984}
W20260709 13:02:07.382908  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48403.3us
I20260709 13:02:07.388418  1537 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5. Re-sending same reply.
I20260709 13:02:07.389387  1532 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:07.390116  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:07.391234  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.391829  1532 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:07.344493  4335 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:02:07.393402  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.402865  1537 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:07.417415  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.419553  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.420436  1537 raft_consensus.cc:2410] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:02:07.426060  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.430290  1532 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
W20260709 13:02:07.436648  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.442318  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 334) took 1141 ms. Trace:
I20260709 13:02:07.443300  1537 rpcz_store.cc:276] 0709 13:02:06.300825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.441450 (+1140625us) service_pool.cc:224] Handling call
0709 13:02:07.441797 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.441978 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.442004 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.442047 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:07.442076 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.442129 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.442248 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62848}
I20260709 13:02:07.442318  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1665) took 1130 ms. Trace:
I20260709 13:02:07.440697  4352 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:07.396296  4304 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:07.457017  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 100442us
I20260709 13:02:07.449033  1532 rpcz_store.cc:276] 0709 13:02:06.312501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.441374 (+1128873us) service_pool.cc:224] Handling call
0709 13:02:07.441797 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.441978 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.442005 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.442046 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:07.442077 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.442129 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.442249 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59136}
I20260709 13:02:07.393226  4354 consensus_queue.cc:1059] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
W20260709 13:02:07.504235  4340 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:02:07.559368  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.501936  4202 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.560554  4202 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.562793  4202 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:07.529788  1539 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:02:07.563767  1539 pending_rounds.cc:85] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 1
I20260709 13:02:07.564225  1539 pending_rounds.cc:107] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:07.564473  1539 raft_consensus.cc:2889] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:07.563737  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.527927  4352 raft_consensus.cc:697] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:07.516870  4321 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:07.546614  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.566407  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1669) took 1154 ms. Trace:
I20260709 13:02:07.566735  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1667) took 1247 ms. Trace:
I20260709 13:02:07.570695  1539 rpcz_store.cc:276] 0709 13:02:06.318926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.441374 (+1122448us) service_pool.cc:224] Handling call
0709 13:02:07.505126 (+ 63752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.566444 (+ 61318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.566672 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:07.566826  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 175214us
I20260709 13:02:07.573882  1537 rpcz_store.cc:276] 0709 13:02:06.411727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.501239 (+1089512us) service_pool.cc:224] Handling call
0709 13:02:07.501884 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.502984 (+  1100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.503020 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.503074 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:07.503110 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.503188 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.566342 (+ 63154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":738,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":18756}
I20260709 13:02:07.576529  4361 raft_consensus.cc:3055] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:07.568658  4304 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:07.577035  4361 raft_consensus.cc:740] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:07.573483  4202 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:07.588512  4352 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:07.593436  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.574848  4321 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.606014  4321 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:07.607240  4361 consensus_queue.cc:260] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.613025  4280 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:07.613696  4280 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.618113  1541 raft_consensus.cc:2410] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:02:07.618285  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45654.1us
I20260709 13:02:07.598927  4202 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.620983  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:07.628708  4365 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:07.629614  4365 raft_consensus.cc:697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:07.631099  4365 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.638530  4202 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:07.662204  3980 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:07.678855  4328 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.509s	user 0.000s	sys 0.006s
I20260709 13:02:07.679126  4280 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:07.680945  4327 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.624s	user 0.000s	sys 0.004s
I20260709 13:02:07.683447  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:07.693908  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.695465  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.696190  1533 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:07.669553  3980 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:07.689359  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54079.4us
I20260709 13:02:07.702090  3980 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:07.687783  4202 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.706422  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.706995  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1637) took 1738 ms. Trace:
I20260709 13:02:07.708673  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:07.709098  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.710119  1533 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 4.
I20260709 13:02:07.708710  1541 rpcz_store.cc:276] 0709 13:02:05.967730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.968217 (+   487us) service_pool.cc:224] Handling call
0709 13:02:07.705610 (+1737393us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001fbdd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:07.705781 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3784933120}
I20260709 13:02:07.714510  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1711) took 1169 ms. Trace:
I20260709 13:02:07.714933  1538 rpcz_store.cc:276] 0709 13:02:06.545414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.655490 (+110076us) service_pool.cc:224] Handling call
0709 13:02:07.714329 (+1058839us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400067554. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:07.714447 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108587776}
I20260709 13:02:07.718911  4162 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:07.720336  4202 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.723014  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:07.727442  4256 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:07.731932  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.733278  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:07.733976  1613 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:07.732679  1538 raft_consensus.cc:2376] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5. Re-sending same reply.
I20260709 13:02:07.735234  1616 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:07.736021  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.736663  1538 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:07.737635  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.738322  1538 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:07.733598  4359 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:07.742537  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.742967  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.742617  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.745850  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:07.745684  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.745298  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.744829  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.753472  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:07.754742  1615 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:07.757825  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:07.758589  1613 raft_consensus.cc:2393] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:07.753754  1538 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:07.752653  4321 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.761137  1614 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:07.759997  4321 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.734122  4357 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.766251  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.767088  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:07.761929  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.745306  4307 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.761238  4280 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:07.753008  3980 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:07.781086  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:07.778301  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:07.779734  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:07.758867  4162 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:07.778074  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.776909  4321 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:07.758641  4359 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.783208  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:07.770359  4357 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.780660  4202 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:07.787784  4162 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.790284  4203 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:07.793766  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.796777  1614 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.786278  4304 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:07.804159  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.804946  1532 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:07.806433  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.807058  1532 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.810084  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.819952  1614 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:07.827304  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47662.7us
I20260709 13:02:07.789458  3980 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.780987  4307 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:07.828990  1654 leader_election.cc:400] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7.
I20260709 13:02:07.836786  1532 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:07.843649  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.845852  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.848475  1532 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:07.848533  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:07.849268  1616 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:07.849522  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:07.850119  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.850605  1532 raft_consensus.cc:2410] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:02:07.850708  1616 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.801726  4304 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:07.838419  1654 leader_election.cc:403] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:02:07.856889  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.859205  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:07.859630  1613 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:07.867712  1532 raft_consensus.cc:2410] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:07.868952  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.871876  1532 raft_consensus.cc:2368] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:07.875156  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.876010  1532 raft_consensus.cc:2410] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:07.863586  4304 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.889387  4162 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:07.874758  4373 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7.
I20260709 13:02:07.918094  4300 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:07.918322  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.919373  1613 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:07.891598  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 264) took 2411 ms. Trace:
I20260709 13:02:07.924218  1609 rpcz_store.cc:276] 0709 13:02:05.493617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.500331 (+  6714us) service_pool.cc:224] Handling call
0709 13:02:05.500724 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:06.569129 (+1068405us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b540034d3a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea8606f 00007fd02eafef60 00007fd02eb007de 00007fd02eb0ab49 00007fd02eb0b416 00007fd02eb07d8f 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62
0709 13:02:06.600337 (+ 31208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.891305 (+1290968us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b540040a1d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:07.891500 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029437568}
I20260709 13:02:07.891851  3980 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:07.929877  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.930951  4202 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.931545  4202 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:07.933888  4202 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:07.893558  4307 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:07.897090  4359 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:07.898953  4357 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:07.936246  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.906773  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:07.907477  4338 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:07.909734  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:07.889683  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 60814.1us
I20260709 13:02:07.939013  1532 raft_consensus.cc:2376] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6. Re-sending same reply.
I20260709 13:02:07.940944  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:07.942497  1541 raft_consensus.cc:2410] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:02:07.942479  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 1.46881e+06us
W20260709 13:02:07.943853  1580 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.778s (SENT)
I20260709 13:02:07.944149  1541 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:07.944770  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1670) took 1479 ms. Trace:
W20260709 13:02:07.945538  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.941913  1616 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:07.955358  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:07.945109  1541 rpcz_store.cc:276] 0709 13:02:06.465880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.943512 (+1477632us) service_pool.cc:224] Handling call
0709 13:02:07.943828 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.944533 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.944718 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.956128  1616 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:07.947822  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:07.949005  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.960197  1580 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.812s (SENT)
I20260709 13:02:07.948333  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 335) took 1503 ms. Trace:
I20260709 13:02:07.962839  1532 rpcz_store.cc:276] 0709 13:02:06.444773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.947293 (+1502520us) service_pool.cc:224] Handling call
0709 13:02:07.947649 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:07.947890 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:07.947930 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:07.947979 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:07.948072 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:07.948141 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:07.948265 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:07.967206  3980 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:07.967834  3980 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:07.968501  1580 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.816s (SENT)
I20260709 13:02:07.970005  3980 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:07.970559  3980 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:07.971030  3980 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:07.973946  1580 connection.cc:256] RPC call timeout handler was delayed by -1.4970546689999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
I20260709 13:02:07.954447  4307 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:07.940091  4338 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:07.977629  1580 leader_election.cc:336] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.940s (SENT)
W20260709 13:02:07.979099  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:07.979704  1580 leader_election.cc:336] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.960s (SENT)
W20260709 13:02:07.980683  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.981453  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:07.983319  1610 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:07.982358  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:07.985507  1613 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
W20260709 13:02:07.989230  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:07.984668  1686 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:08.000278  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.001628  1532 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:08.002279  1681 raft_consensus.cc:2410] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:08.002574  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1714) took 1456 ms. Trace:
I20260709 13:02:08.003073  1532 rpcz_store.cc:276] 0709 13:02:06.546244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.000971 (+1454727us) service_pool.cc:224] Handling call
0709 13:02:08.001367 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.002251 (+   884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.002501 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.003568  1681 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:07.989277  4338 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.004817  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.005479  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.005599  1688 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:08.005959  4357 consensus_queue.cc:1059] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:08.006386  4326 log.cc:927] Time spent T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.959s	user 0.000s	sys 0.004s
I20260709 13:02:08.007448  4357 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:08.008888  4357 raft_consensus.cc:3055] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.009218  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:08.013629  1579 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:08.006301  1689 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:08.001394  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.016217  1686 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:08.016000  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:08.009243  4357 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:07.983800  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:08.019070  4321 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:07.965574  3989 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:02:08.022571  1614 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:08.005715  4338 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:07.997776  4307 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:08.023744  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:08.059727  1689 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:08.026654  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1712) took 1481 ms (client timeout 1699 ms). Trace:
W20260709 13:02:08.065953  1580 connection.cc:256] RPC call timeout handler was delayed by -1.245954668999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 13:02:08.024436  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:08.052448  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 69017.2us
I20260709 13:02:06.975982   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:08.054025  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:08.068011  1536 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:08.030194  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:08.068823  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:08.069626  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:08.070197  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:08.070386  1536 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:08.073266  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:08.066674  1534 rpcz_store.cc:269] 0709 13:02:06.545694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.659243 (+113549us) service_pool.cc:224] Handling call
0709 13:02:08.026378 (+1367135us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b5400440cd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:08.026572 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168371584}
I20260709 13:02:08.027182  4162 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.077046  1539 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:08.072005  4321 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:08.084796  4321 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.089944  1539 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:02:08.090503  1539 pending_rounds.cc:85] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 2
I20260709 13:02:08.029796  3980 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:08.068536  4307 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:08.090801  1539 pending_rounds.cc:107] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 13:02:08.091094  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.091253  1539 raft_consensus.cc:2889] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.092175  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1673) took 1495 ms. Trace:
I20260709 13:02:08.023648  4357 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:08.067266  1580 connection.cc:256] RPC call timeout handler was delayed by -1.0461343119999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:02:08.092612  1539 rpcz_store.cc:276] 0709 13:02:06.596972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.082153 (+1485181us) service_pool.cc:224] Handling call
0709 13:02:08.089481 (+  7328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.091861 (+  2380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.092112 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.093315  4357 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.094502  1539 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:08.094884  4351 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:08.095177  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1675) took 1344 ms. Trace:
I20260709 13:02:08.096417  4300 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:08.096551  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.095790  1539 rpcz_store.cc:276] 0709 13:02:06.751051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.093762 (+1342711us) service_pool.cc:224] Handling call
0709 13:02:08.094179 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.094909 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.095121 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.097791  1539 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:07.983083  1616 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:08.102223  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1677) took 1299 ms. Trace:
I20260709 13:02:08.062716  4202 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:08.065889  4256 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.105509  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.109459  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:08.101955  4359 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.111565  4359 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.113723  4359 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:08.101985  4203 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:08.095654  4351 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.114971  4162 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:08.127717  1690 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:08.141930  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1749) took 2066 ms. Trace:
I20260709 13:02:08.070962  4214 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:08.079977  4373 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:08.079569  4280 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:08.082337  4315 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:08.142367  1690 rpcz_store.cc:276] 0709 13:02:06.075596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.355144 (+279548us) service_pool.cc:224] Handling call
0709 13:02:08.127280 (+1772136us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:02:08.127515 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.141614 (+ 14099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.141866 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9659136}
I20260709 13:02:08.142608  4125 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.102955  4307 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:08.148550  1686 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:08.189879  1614 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:02:08.206357  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.219717  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.220829  1689 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:08.146219  4373 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:08.109133  4300 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.128489  4256 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.219170  4281 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.128612  4202 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.168278  4315 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:08.151315  4214 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.103256  1539 rpcz_store.cc:276] 0709 13:02:06.803116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.097325 (+1294209us) service_pool.cc:224] Handling call
0709 13:02:08.097632 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.101894 (+  4262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.102146 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.283669  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.299594  1539 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:08.295149  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 194618us
I20260709 13:02:08.299381  1689 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:02:08.296005  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.303009  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1680) took 1448 ms. Trace:
I20260709 13:02:08.303517  1539 rpcz_store.cc:276] 0709 13:02:06.855150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.299061 (+1443911us) service_pool.cc:224] Handling call
0709 13:02:08.299399 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.302754 (+  3355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.302949 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.307152  4351 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:08.307435  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.309320  4300 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:08.294698  1654 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:08.310182  4256 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:08.310679  4256 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:08.311182  4256 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.311520  4332 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:08.234412  4373 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:08.312453  4281 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.312778  2329 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:02:08.352273  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.311190  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:08.305296  1539 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:08.355769  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1682) took 1418 ms. Trace:
I20260709 13:02:08.356374  1539 rpcz_store.cc:276] 0709 13:02:06.937853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.304567 (+1366714us) service_pool.cc:224] Handling call
0709 13:02:08.304889 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.355310 (+ 50421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.355684 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.358510  1539 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:08.359340  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1729) took 1314 ms. Trace:
I20260709 13:02:08.316251  4203 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:08.362371  4203 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:08.363287  4203 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:08.318928  1541 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:08.327167  2368 raft_consensus.cc:1217] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Deduplicated request from leader. Original: 5.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:02:08.365959  2368 raft_consensus.cc:1240] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:02:08.366988  1540 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:08.367654  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1725) took 1328 ms. Trace:
W20260709 13:02:08.328991  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1656) took 2135 ms (client timeout 1960 ms). Trace:
W20260709 13:02:08.371330  1535 rpcz_store.cc:269] 0709 13:02:06.192424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.325606 (+133182us) service_pool.cc:224] Handling call
0709 13:02:08.318398 (+1992792us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400067054. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:08.318616 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420849536}
I20260709 13:02:08.373517  1535 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:08.374321  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1733) took 1141 ms. Trace:
I20260709 13:02:08.374770  1535 rpcz_store.cc:276] 0709 13:02:07.232490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.372602 (+1140112us) service_pool.cc:224] Handling call
0709 13:02:08.373024 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.373968 (+   944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.374243 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.330273  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:08.380234  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.419425  4203 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.359788  1539 rpcz_store.cc:276] 0709 13:02:07.045106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.357533 (+1312427us) service_pool.cc:224] Handling call
0709 13:02:08.357985 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.358993 (+  1008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.359261 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.367985  1540 rpcz_store.cc:276] 0709 13:02:07.039403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.318018 (+1278615us) service_pool.cc:224] Handling call
0709 13:02:08.366617 (+ 48599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.367383 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.367594 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.436592  1539 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:08.437582  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1702) took 1078 ms. Trace:
I20260709 13:02:08.438184  1539 rpcz_store.cc:276] 0709 13:02:07.359519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.435798 (+1076279us) service_pool.cc:224] Handling call
0709 13:02:08.436202 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.437218 (+  1016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.437504 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.442919  1539 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:08.323186  4354 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.447552  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.329888  4349 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:08.453747  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:08.459403  1686 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:08.455758  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:08.461169  2371 raft_consensus.cc:2410] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:02:08.432561  4184 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:08.456332  4354 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.432852  4357 consensus_queue.cc:1059] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:02:08.465065  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:08.439473  4363 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:08.470140  4363 raft_consensus.cc:697] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:08.471240  4363 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.474783  4354 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:08.476847  4357 raft_consensus.cc:3055] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:08.477401  4357 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:08.478407  4357 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.482862  4184 raft_consensus.cc:3055] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:08.483404  4184 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:08.484822  4184 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.486356  4184 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:08.370307  4351 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 13:02:08.490707  4315 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.496618  2368 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:08.479902  4357 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:08.439359  4190 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:02:08.443084  3960 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:02:08.515049  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:08.495438  4219 consensus_queue.cc:1059] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:02:08.534134  4202 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:08.469199  4349 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:08.535091  4202 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:08.536893  4214 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:08.537262  4349 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:08.520771  4359 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:02:08.548768  4281 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:08.560171  4304 consensus_meta.cc:287] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.002s
I20260709 13:02:08.560915  4304 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.703436  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1678) took 1873 ms. Trace:
I20260709 13:02:08.682468  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:08.683279  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:08.583945  4373 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.695853  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:08.897238  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1707) took 1445 ms. Trace:
I20260709 13:02:08.897861  1533 rpcz_store.cc:276] 0709 13:02:07.451860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.725269 (+273409us) service_pool.cc:224] Handling call
0709 13:02:08.695390 (+970121us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b5800001298. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:08.897073 (+201683us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14771584}
I20260709 13:02:08.898986  4373 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:08.575971  4307 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:08.904435  3980 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:08.905615  3980 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:08.621320  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.620244  1535 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:08.701114  1683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1476) took 2552 ms (client timeout 2870 ms). Trace:
I20260709 13:02:08.646809  1613 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:08.680843  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:08.621320  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1720) took 2067 ms. Trace:
I20260709 13:02:08.622737  1540 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:08.683773  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:08.620985  1504 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:08.680857  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:08.914800  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:08.581063  4338 consensus_meta.cc:287] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.005s
I20260709 13:02:08.929491  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1690) took 1683 ms. Trace:
I20260709 13:02:08.894042  1541 rpcz_store.cc:276] 0709 13:02:06.830505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.127982 (+1297477us) service_pool.cc:224] Handling call
0709 13:02:08.318605 (+190623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.364953 (+ 46348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.702885 (+337932us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400067050. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:08.703250 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356307712}
I20260709 13:02:08.910364  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:08.681562  2367 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:02:08.921237  1683 rpcz_store.cc:269] 0709 13:02:06.148133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:06.251529 (+103396us) service_pool.cc:224] Handling call
0709 13:02:08.700562 (+2449033us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400118fd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:08.700852 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356647808}
I20260709 13:02:08.934999  1535 rpcz_store.cc:276] 0709 13:02:07.246652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.375805 (+1129153us) service_pool.cc:224] Handling call
0709 13:02:08.619463 (+243658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.924818 (+305355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.929429 (+  4611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.928378  1540 pending_rounds.cc:85] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 3
I20260709 13:02:08.681299  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:08.939989  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.714990  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:08.913286  4281 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:08.966112  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:08.963394  1540 pending_rounds.cc:107] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:08.973176  1533 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:08.979740  1540 raft_consensus.cc:2889] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:08.927935  1534 rpcz_store.cc:276] 0709 13:02:06.553559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.076276 (+1522717us) service_pool.cc:224] Handling call
0709 13:02:08.085647 (+  9371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.085882 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.085919 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.086453 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.344455 (+258002us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:08.344497 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.344566 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.620422 (+275856us) raft_consensus.cc:1685] finished
0709 13:02:08.620528 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:08.620992 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":256093,"threads_started":1,"wal-append.queue_time_us":440834}
W20260709 13:02:08.986740  1614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.023s	sys 0.031s
I20260709 13:02:08.563856  4304 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:08.984633  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1720) took 1525 ms (client timeout 1843 ms). Trace:
W20260709 13:02:08.989125  1537 rpcz_store.cc:269] 0709 13:02:07.455798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.675327 (+1219529us) service_pool.cc:224] Handling call
0709 13:02:08.980966 (+305639us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:08.987454  1614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.023s	sys 0.032s
W20260709 13:02:08.995929  4209 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.021s	sys 0.045s
W20260709 13:02:08.998027  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.020435  1687 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:09.024307  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 338) took 1299 ms. Trace:
W20260709 13:02:08.986738  4203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.029s	sys 0.036s
I20260709 13:02:09.024890  1541 rpcz_store.cc:276] 0709 13:02:07.721639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.978608 (+1256969us) service_pool.cc:224] Handling call
0709 13:02:09.020428 (+ 41820us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.020878 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.020908 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.020991 (+    83us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:09.021051 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.021104 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.021265 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.535764  4202 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.029454  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1705) took 1604 ms. Trace:
I20260709 13:02:08.987170  4281 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.045635  4307 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:09.033192  1540 rpcz_store.cc:276] 0709 13:02:07.424647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.436226 (+1011579us) service_pool.cc:224] Handling call
0709 13:02:08.621263 (+185037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.026085 (+404822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.029388 (+  3303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:08.982570  4214 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:09.046555  4203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.033s	sys 0.037s
I20260709 13:02:09.072922  1616 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:09.043875  4281 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.093024  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 341) took 1164 ms. Trace:
I20260709 13:02:09.021474  4280 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:09.094293  4214 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.096103  4162 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:09.098556  4202 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:09.098946  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.100081  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:09.108698  1689 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.001s	sys 0.016s
I20260709 13:02:09.139434  1684 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:09.084756  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.009s
I20260709 13:02:09.110357  1541 rpcz_store.cc:276] 0709 13:02:07.928845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.087109 (+1158264us) service_pool.cc:224] Handling call
0709 13:02:09.092012 (+  4903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.092527 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.092560 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.092629 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:09.092667 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.092736 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.092908 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:09.159070  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.008s	sys 0.018s
W20260709 13:02:09.146258  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.009s	sys 0.009s
I20260709 13:02:09.045718  4400 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:09.167958  1689 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.002s	sys 0.016s
I20260709 13:02:09.165977  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 337) took 1460 ms. Trace:
I20260709 13:02:09.168668  1535 rpcz_store.cc:276] 0709 13:02:07.705418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.975798 (+1270380us) service_pool.cc:224] Handling call
0709 13:02:09.089841 (+114043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.162171 (+ 72330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.162214 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.165639 (+  3425us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:09.165687 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.165747 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.165876 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:09.151597  1682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.001s	sys 0.017s
W20260709 13:02:09.083561  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 463068us
W20260709 13:02:09.174340  1682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.001s	sys 0.018s
I20260709 13:02:09.164274  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1775) took 1081 ms. Trace:
W20260709 13:02:09.172127  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.009s	sys 0.010s
I20260709 13:02:09.175184  1684 rpcz_store.cc:276] 0709 13:02:08.083212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.663918 (+580706us) service_pool.cc:224] Handling call
0709 13:02:08.907786 (+243868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.160218 (+252432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.164190 (+  3972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.179795  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 339) took 1457 ms. Trace:
I20260709 13:02:09.180758  4256 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:09.180477  1537 rpcz_store.cc:276] 0709 13:02:07.721978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.013755 (+1291777us) service_pool.cc:224] Handling call
0709 13:02:09.149850 (+136095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.179258 (+ 29408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.179314 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.179395 (+    81us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:09.179441 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.179533 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.179713 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.184547  4202 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:09.185663  4202 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.188395  4256 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.188948  4256 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.189353  4256 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.190196  1616 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:02:09.192920  4202 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:09.195709  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.196175  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1772) took 1091 ms. Trace:
I20260709 13:02:09.182317  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 340) took 1288 ms. Trace:
W20260709 13:02:09.172585  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.005s	sys 0.016s
I20260709 13:02:09.146451  4281 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.202250  1540 rpcz_store.cc:276] 0709 13:02:07.894123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.087261 (+1193138us) service_pool.cc:224] Handling call
0709 13:02:09.141549 (+ 54288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.181898 (+ 40349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.181925 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.181973 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:09.182031 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.182111 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.182250 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.205476  1681 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:09.173224  1539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.066s	sys 0.060s
W20260709 13:02:09.210254  1539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.066s	sys 0.062s
W20260709 13:02:09.208839  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.005s	sys 0.017s
I20260709 13:02:09.212380  1504 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:09.217391  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 342) took 1187 ms. Trace:
I20260709 13:02:09.214025  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1781) took 1122 ms. Trace:
I20260709 13:02:09.219667  1688 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:09.217803  1533 rpcz_store.cc:276] 0709 13:02:08.029585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.087230 (+1057645us) service_pool.cc:224] Handling call
0709 13:02:09.160754 (+ 73524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.217043 (+ 56289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.217075 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.217123 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:09.217159 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.217225 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.217337 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.218223  1681 rpcz_store.cc:276] 0709 13:02:08.088313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.051431 (+963118us) service_pool.cc:224] Handling call
0709 13:02:09.197230 (+145799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.208432 (+ 11202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.210967 (+  2535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:09.179471  4162 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:09.203227  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 834303us
I20260709 13:02:09.234200  4400 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.235625  4214 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:09.241312  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.214915  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 781161us
W20260709 13:02:09.220175  4313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.016s	sys 0.024s
I20260709 13:02:09.254832  4162 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:09.243598  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1779) took 1023 ms. Trace:
I20260709 13:02:09.258831  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1768) took 1227 ms. Trace:
I20260709 13:02:09.259404  4312 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:09.259889  4312 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:09.259302  1682 rpcz_store.cc:276] 0709 13:02:08.022804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.058516 (+ 35712us) service_pool.cc:224] Handling call
0709 13:02:08.058855 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.059100 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:08.195520 (+136420us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.906700 (+711180us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b180018c8e0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:09.212805 (+306105us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.224234 (+ 11429us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:09.229839 (+  5605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.244956 (+ 15117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.250572 (+  5616us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":382334,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":5247,"raft.queue_time_us":59260,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":199,"spinlock_wait_cycles":24522624,"thread_start_us":1102230,"threads_started":3,"wal-append.queue_time_us":335756}
I20260709 13:02:09.261374  4312 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.262010  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:09.198547  1686 rpcz_store.cc:276] 0709 13:02:08.068062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.463170 (+395108us) service_pool.cc:224] Handling call
0709 13:02:08.464835 (+  1665us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.465923 (+  1088us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:02:08.492637 (+ 26714us) log.cc:844] Serialized 14 byte log entry
0709 13:02:08.997345 (+504708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.025464 (+ 28119us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:09.073231 (+ 47767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.089825 (+ 16594us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.159130 (+ 69305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26010,"prepare.queue_time_us":27265,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":69,"raft.queue_time_us":74009,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":57783,"thread_start_us":479418,"threads_started":1}
I20260709 13:02:09.263468  4312 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.264375  4202 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.264931  4202 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.264962  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1786) took 1175 ms. Trace:
I20260709 13:02:09.265580  4202 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.265635  1686 rpcz_store.cc:276] 0709 13:02:08.089558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.263755 (+1174197us) service_pool.cc:224] Handling call
0709 13:02:09.264241 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.264574 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.264598 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.264659 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.264694 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.264766 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.264884 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:09.268148  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 957046us
I20260709 13:02:09.269104  1534 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:02:09.262976  4184 consensus_meta.cc:287] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.762s	user 0.014s	sys 0.004s
I20260709 13:02:09.247829  3980 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:09.271508  4281 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.262987  1682 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
I20260709 13:02:09.279064  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:09.257365  1685 rpcz_store.cc:276] 0709 13:02:08.087731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.710151 (+622420us) service_pool.cc:224] Handling call
0709 13:02:08.710788 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.907922 (+197134us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:08.940438 (+ 32516us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.111037 (+170599us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.111098 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.111148 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.111219 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.111344 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20366,"prepare.queue_time_us":13531,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":74,"raft.queue_time_us":180950,"raft.run_cpu_time_us":911,"raft.run_wall_time_us":41932,"thread_start_us":148731,"threads_started":2}
I20260709 13:02:09.308513  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1753) took 1566 ms. Trace:
I20260709 13:02:09.309454  4281 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.309105  1610 rpcz_store.cc:276] 0709 13:02:07.741404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.741533 (+   129us) service_pool.cc:224] Handling call
0709 13:02:09.307978 (+1566445us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540014afd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:09.308255 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514849024}
I20260709 13:02:09.311401  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:09.304024  1682 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:09.312642  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1769) took 1466 ms (client timeout 1839 ms). Trace:
W20260709 13:02:09.313073  1612 rpcz_store.cc:269] 0709 13:02:07.845899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.858827 (+ 12928us) service_pool.cc:224] Handling call
0709 13:02:09.306547 (+1447720us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b5800003398. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3e9c 00007fd02b9e3a5b 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:09.312567 (+  6020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4144384}
I20260709 13:02:09.295502  4214 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:02:09.315614  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:09.288714  4280 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:09.332994  4125 consensus_meta.cc:287] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.167s	user 0.013s	sys 0.006s
I20260709 13:02:09.334410  4280 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:09.316358  4184 consensus_queue.cc:1059] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:09.332242  1681 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:09.341023  4214 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:09.341596  4214 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:09.342960  4214 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.344556  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.346418  4214 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.347069  4400 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:09.298146  4387 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:09.348943  4387 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.351091  1607 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:09.335361  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:09.352272  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 61152.1us
I20260709 13:02:09.352329  4400 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.353243  4400 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.356294  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:09.356016  4178 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:09.356719  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:09.357640  4332 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.358124  4332 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.358356  4280 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:09.358600  4332 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.359133  4280 raft_consensus.cc:697] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:09.361729  4281 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.362556  4281 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.357630  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:09.365506  4093 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.365955  4093 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.366302  4093 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:09.367117  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.365033  1685 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:09.372874  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.375437  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.375239  4093 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.377789  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.379292  4406 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.380110  4406 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.383504  4280 consensus_queue.cc:237] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.402669  4190 raft_consensus.cc:3055] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:09.403363  4190 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:09.405186  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.405120  4190 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.406934  4190 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.410980  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1780) took 1307 ms. Trace:
I20260709 13:02:09.398285  4313 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.411522  1690 rpcz_store.cc:276] 0709 13:02:08.087994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.928168 (+840174us) service_pool.cc:224] Handling call
0709 13:02:08.940949 (+ 12781us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.941641 (+   692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.941669 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.942518 (+   849us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.047699 (+105181us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.047779 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.047922 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.395561 (+347639us) raft_consensus.cc:1685] finished
0709 13:02:09.395586 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.395724 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":104383,"threads_started":1,"wal-append.queue_time_us":314389}
I20260709 13:02:09.420187  4184 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:09.420877  4398 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:02:09.386493  4387 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:09.424897  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:09.427716  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:09.428138  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1717) took 2880 ms. Trace:
I20260709 13:02:09.429179  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:09.430402  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:09.432468  4392 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:09.395676  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1717) took 1940 ms. Trace:
I20260709 13:02:09.433004  4392 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:09.433483  4392 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.433053  1539 rpcz_store.cc:276] 0709 13:02:07.454806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.444779 (+989973us) service_pool.cc:224] Handling call
0709 13:02:08.445246 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.292654 (+847408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.297337 (+  4683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.307420 (+ 10083us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.335994 (+ 28574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.387047 (+ 51053us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.395612 (+  8565us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":92112,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"thread_start_us":765016,"threads_started":1}
I20260709 13:02:09.437989  4281 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.438596  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1774) took 1360 ms. Trace:
I20260709 13:02:09.439081  1688 rpcz_store.cc:276] 0709 13:02:08.078509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.482449 (+403940us) service_pool.cc:224] Handling call
0709 13:02:08.482870 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.227599 (+744729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.438245 (+210646us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400049554. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:09.438493 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645184768}
I20260709 13:02:09.445353  4332 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.428612  1536 rpcz_store.cc:276] 0709 13:02:06.547098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.071258 (+1524160us) service_pool.cc:224] Handling call
0709 13:02:08.082371 (+ 11113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.104628 (+ 22257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.104669 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.143715 (+ 39046us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.444833 (+301118us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:08.444893 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.445127 (+   234us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:08.621771 (+176644us) raft_consensus.cc:1685] finished
0709 13:02:08.621833 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.427589 (+805756us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b54001fa9d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:09.427889 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21935,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":3270,"spinlock_wait_cycles":22931328,"thread_start_us":223420,"threads_started":1,"wal-append.queue_time_us":368518}
I20260709 13:02:09.451056  4093 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:09.451210  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1751) took 1710 ms (client timeout 1972 ms). Trace:
I20260709 13:02:09.451500  4162 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:09.432497  4408 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:09.456599  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 233148us
I20260709 13:02:09.456840  4408 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.457293  4408 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.458988  4363 consensus_queue.cc:1059] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:09.460120  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:09.460881  1612 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.461304  4093 raft_consensus.cc:3055] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:09.461787  4093 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:09.462939  4093 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.464473  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 289) took 1365 ms. Trace:
I20260709 13:02:09.459146  4400 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.465775  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.466246  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.466580  4162 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:09.467569  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.468327  2368 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
W20260709 13:02:09.469595  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.470559  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.472754  4162 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.465131  1614 rpcz_store.cc:276] 0709 13:02:08.098815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.191079 (+ 92264us) service_pool.cc:224] Handling call
0709 13:02:08.191483 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:08.329898 (+138415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:08.329938 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:08.330493 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:02:08.995991 (+665498us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:08.996097 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:08.996233 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.464137 (+467904us) raft_consensus.cc:1685] finished
0709 13:02:09.464160 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.464379 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137818,"raft.queue_time_us":152590,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":84624,"thread_start_us":662230,"threads_started":1,"wal-append.queue_time_us":1087024}
I20260709 13:02:09.475927  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1787) took 1386 ms. Trace:
W20260709 13:02:09.451876  1607 rpcz_store.cc:269] 0709 13:02:07.740792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.740920 (+   128us) service_pool.cc:224] Handling call
0709 13:02:09.450900 (+1709980us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54003f8754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:09.451110 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3638195072}
W20260709 13:02:09.475553  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48327.1us
I20260709 13:02:09.480919  1612 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:09.479902  1686 rpcz_store.cc:276] 0709 13:02:08.089805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.266893 (+1177088us) service_pool.cc:224] Handling call
0709 13:02:09.267261 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.267623 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:09.294319 (+ 26696us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.475585 (+181266us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.475640 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.475694 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.475764 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.475875 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10618,"prepare.queue_time_us":25394,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":46926,"raft.queue_time_us":84,"thread_start_us":160776,"threads_started":1}
I20260709 13:02:09.487987  4359 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:09.488129  4178 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:09.499867  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.506654  4359 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:09.510429  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:09.510193  4359 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.512653  4219 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.513337  4219 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.514943  4332 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.513274  4393 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:09.520576  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:09.522297  4391 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:02:09.520635  4093 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:09.527519  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.550199  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.559296  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:09.563778  1616 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.564728  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:09.502931  4256 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.580844  4373 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:09.586679  4373 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.584348  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1771) took 1520 ms. Trace:
I20260709 13:02:09.563395  4391 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:09.592743  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:02:09.594964  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 279484us
W20260709 13:02:09.598326  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 165474us
I20260709 13:02:09.557400  4392 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:09.604344  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 92366.2us
I20260709 13:02:09.604175  4214 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:09.588761  1689 rpcz_store.cc:276] 0709 13:02:08.064581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.456363 (+391782us) service_pool.cc:224] Handling call
0709 13:02:08.456773 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:08.457020 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:09.237071 (+780051us) log.cc:844] Serialized 14 byte log entry
0709 13:02:09.502292 (+265221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.518863 (+ 16571us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.562276 (+ 43413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.584103 (+ 21827us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.584277 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32242,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":3359,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":916989,"threads_started":2,"wal-append.queue_time_us":331475}
I20260709 13:02:09.580574  4202 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.631958  1654 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:09.621289  4214 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:09.626075  4369 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:09.645819  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 60467.4us
I20260709 13:02:09.646343  4203 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.646821  4203 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:09.647253  4203 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.647907  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1755) took 2317 ms. Trace:
I20260709 13:02:09.648448  1687 rpcz_store.cc:276] 0709 13:02:07.330920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:07.331086 (+   166us) service_pool.cc:224] Handling call
0709 13:02:08.875998 (+1544912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.030929 (+154931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.647656 (+616727us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400118fd0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:09.647819 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3174087936}
I20260709 13:02:09.626155  4400 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:09.661681  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.662995  1536 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:09.642411  4219 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.655547  4214 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.672452  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:09.677148  1536 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.674078  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:09.677752  1689 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:02:09.671679  1541 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:09.696174  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:09.697100  1688 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:09.671581  4403 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.673234  4373 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:09.710457  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:09.673573  4313 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:09.711354  4313 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:09.712929  4415 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:02:09.715054  4414 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:02:09.716238  4190 raft_consensus.cc:2764] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:09.716552  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.717970  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1785) took 1628 ms. Trace:
I20260709 13:02:09.718794  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:09.674345  4256 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.667022  4369 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:09.726158  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.729437  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 92192.2us
I20260709 13:02:09.718343  1684 rpcz_store.cc:276] 0709 13:02:08.089319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.226440 (+1137121us) service_pool.cc:224] Handling call
0709 13:02:09.282326 (+ 55886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.316135 (+ 33809us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.331994 (+ 15859us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.352310 (+ 20316us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.396460 (+ 44150us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:09.396582 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.396689 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.717769 (+321080us) raft_consensus.cc:1685] finished
0709 13:02:09.717790 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.717918 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9248,"raft.queue_time_us":19134,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":222,"thread_start_us":41319,"threads_started":1,"wal-append.queue_time_us":238984}
I20260709 13:02:09.694106  4400 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.752255  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:09.756217  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 88472.5us
I20260709 13:02:09.765551  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:09.771180  1580 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:09.780370  4321 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
W20260709 13:02:09.784876  4417 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:02:09.789968  4361 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:09.793581  1685 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:09.794140  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 345) took 1422 ms. Trace:
I20260709 13:02:09.794574  1538 rpcz_store.cc:276] 0709 13:02:08.306649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.196708 (+890059us) service_pool.cc:224] Handling call
0709 13:02:09.197209 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:09.245897 (+ 48688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.245943 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:09.246005 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:09.246061 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.729101 (+483040us) spinlock_profiling.cc:243] Waited 40 ms on lock 0x7b54000cb2d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:09.729148 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.729279 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91894528}
W20260709 13:02:09.797631  4407 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.526s	user 0.003s	sys 0.001s
I20260709 13:02:09.805583  4125 raft_consensus.cc:3055] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:09.806105  4125 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:09.807060  4125 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.791484  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1783) took 1702 ms. Trace:
I20260709 13:02:09.809947  4406 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:09.810734  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 53906.4us
I20260709 13:02:09.810902  4390 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:09.811707  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:09.811811  4390 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:09.812700  4190 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:09.813162  4190 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.813406  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:09.813169  4390 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.809551  4416 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:09.814795  4391 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:09.815287  4391 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:09.815698  4391 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.813633  4190 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:09.818001  4412 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:02:09.815289  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 74406.8us
I20260709 13:02:09.819407  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 293) took 1172 ms. Trace:
I20260709 13:02:09.819834  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:09.819855  1613 rpcz_store.cc:276] 0709 13:02:08.647125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.997863 (+350738us) service_pool.cc:224] Handling call
0709 13:02:09.109308 (+111445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.176946 (+ 67638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.176987 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.220738 (+ 43751us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.575418 (+354680us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:09.575479 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.575584 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.819184 (+243600us) raft_consensus.cc:1685] finished
0709 13:02:09.819205 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.819345 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20851,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":13849,"thread_start_us":293757,"threads_started":1,"wal-append.queue_time_us":401071}
W20260709 13:02:09.817034  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 52644.4us
W20260709 13:02:09.828137  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.831391  1688 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:09.772231  4256 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.840389  1616 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:09.822106  4373 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:09.844954  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.808187  1683 rpcz_store.cc:276] 0709 13:02:08.088813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.073779 (+984966us) service_pool.cc:224] Handling call
0709 13:02:09.183191 (+109412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:09.283812 (+100621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:09.283848 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:09.284674 (+   826us) log.cc:844] Serialized 26 byte log entry
0709 13:02:09.422826 (+138152us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b48001a01d8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd033a31aa1 00007fd033a28b37 00007fd033a289ca 00007fd033b2026f 00007fd033b1ff37 00007fd033b3455c 00007fd033b34508 00007fd033b34488 00007fd033b34443 00007fd033b336ec 00007fd032a5da96
0709 13:02:09.582456 (+159630us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:09.582503 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:09.582577 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:09.791146 (+208569us) raft_consensus.cc:1685] finished
0709 13:02:09.791169 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:09.791405 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18133,"raft.queue_time_us":30625,"raft.run_cpu_time_us":3071,"raft.run_wall_time_us":135863,"spinlock_wait_cycles":9780224,"thread_start_us":287379,"threads_started":1,"wal-append.queue_time_us":340484}
I20260709 13:02:09.763242  4403 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.847553  3960 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:02:09.856573  3980 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.856941  4369 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.889179  4190 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.858855  4315 consensus_queue.cc:1059] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:09.861610  4202 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.858006  4125 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:09.868449  4411 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
W20260709 13:02:09.870633  4421 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:02:09.846205  4406 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:09.872879  1536 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:09.841598  4392 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:09.886978  1607 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:09.888235  3980 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:09.890058  4332 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:09.877914  4219 raft_consensus.cc:2764] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:02:09.892796  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:09.902076  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.877627  4373 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:09.865898  4400 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:09.947883  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.877444  4256 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.920080  4162 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:02:09.953747  4406 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.956362  3980 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:09.921828  4373 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:09.963243  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46591.7us
W20260709 13:02:09.964807  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.920251  4392 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:09.896353  4408 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:09.976732  4424 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
I20260709 13:02:09.978314  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:09.981035  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:09.984109  4315 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:09.984709  4315 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:09.985816  4315 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:09.987460  4315 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:09.988478  4331 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:09.989372  4190 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.990382  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:09.990820  3980 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:09.993122  4256 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.994732  4391 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:10.000267  1505 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.625s (SENT)
I20260709 13:02:10.000927  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.005739  1689 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
W20260709 13:02:10.006450  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 126360us
I20260709 13:02:10.010123  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:10.003883  1505 leader_election.cc:336] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.676s (SENT)
I20260709 13:02:10.015990  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:10.018139  4406 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:09.973300  4392 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.023402  4392 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:10.024253  4093 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:10.037525  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 56584.3us
W20260709 13:02:10.043982  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:09.964180  4178 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:02:10.014129  4321 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:10.009509  4416 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.072296  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.089133  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.048010  4256 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:10.074489  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.067027  4400 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.014705  4203 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.115649  1688 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:10.036326  4313 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.070200  4321 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:10.091699  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.126338  4190 raft_consensus.cc:2764] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:02:10.126590  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 79952.3us
I20260709 13:02:10.127472  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.128338  4190 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.128852  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.129806  4190 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:10.130247  4190 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.130298  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.130610  4190 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.124410  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.136897  1684 raft_consensus.cc:2410] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:10.091964  4093 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:10.144624  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.146590  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:10.148377  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.148201  4400 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:10.169732  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.133490  4321 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:10.179886  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 176113us
I20260709 13:02:10.181531  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.184156  1682 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:10.114041  3960 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:02:10.185503  1690 raft_consensus.cc:2410] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:10.189502  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.193310  1684 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:10.193856  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.200623  1688 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:02:10.199040  4428 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:02:10.208388  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.191915  4391 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:10.190264  4125 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.213086  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.214725  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.215238  1684 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:10.195349  4403 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:10.229243  4448 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:10.230440  4391 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
W20260709 13:02:10.231261  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 101006us
I20260709 13:02:10.221530  4408 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:10.294682  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.232017  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.267616  1580 leader_election.cc:400] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:10.298779  1682 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:10.299921  1690 raft_consensus.cc:2393] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:10.264536  4214 consensus_meta.cc:287] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.004s
I20260709 13:02:10.299918  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:10.258649  4432 log.cc:927] Time spent T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.316s	user 0.000s	sys 0.002s
W20260709 13:02:10.279364  4439 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:02:10.258109  4433 log.cc:927] Time spent T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:02:10.312158  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44799.6us
I20260709 13:02:10.291715  4406 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.246641  4400 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:10.256327  4416 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:10.317607  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.240283  4125 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:10.313333  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 90409.3us
I20260709 13:02:10.240964  4093 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.261106  4313 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:10.245003  4203 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:10.315002  1505 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.130s (SENT)
I20260709 13:02:10.314098  1684 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:02:10.269304  4321 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.327822  3980 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.327968  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.317919  4416 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:10.334368  4422 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.604s	user 0.000s	sys 0.012s
I20260709 13:02:10.354598  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:10.316519  4361 consensus_meta.cc:287] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.002s
I20260709 13:02:10.339179  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:10.239954  4190 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.357419  1688 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.357702  1613 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:10.358618  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.319259  4125 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:10.314432  4214 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.364262  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:10.335364  4373 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.366008  1682 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:10.367151  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.373420  4321 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:10.375177  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47371.4us
I20260709 13:02:10.376834  1684 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
W20260709 13:02:10.382810  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 373031us
I20260709 13:02:10.366757  3980 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.388691  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.392088  1682 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:10.368608  4391 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:02:10.394080  1688 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:10.407351  3980 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:10.408682  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.382853  4338 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:10.425701  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 111546us
I20260709 13:02:10.383471  4440 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:02:10.419812  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.432379  4190 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:10.432422  1436 catalog_manager.cc:5697] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 4 to 6, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.438282  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.439062  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.439796  1539 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:10.443032  4443 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:10.445065  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.446333  4444 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:10.446120  1436 catalog_manager.cc:5697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 6 to 7, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:10.447955  1505 leader_election.cc:336] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.155s (SENT)
I20260709 13:02:10.446136  4214 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:10.448539  4425 raft_consensus.cc:3055] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:10.448699  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.449015  4425 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:10.450395  4425 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.428007  4416 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.469733  1687 raft_consensus.cc:2393] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:10.460971  4425 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.477267  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.483460  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:10.428998  4125 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:10.486167  1437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 185) took 19675 ms (client timeout 15000 ms). Trace:
I20260709 13:02:10.487499  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.488401  1538 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:10.424209  4338 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.492563  4442 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:02:10.477800  4416 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:10.509732  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 96285us
W20260709 13:02:10.512560  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 314352us
W20260709 13:02:10.513567  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.504448  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.519555  1539 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:10.512013  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.524405  1436 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 3 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.527285  1536 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:02:10.517585  1532 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:10.528013  1536 pending_rounds.cc:85] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 2
I20260709 13:02:10.528477  1536 pending_rounds.cc:107] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:10.528719  1536 raft_consensus.cc:2889] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:10.522709  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.541574  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.544551  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:10.500886  2362 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:10.550304  1533 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.551674  1541 raft_consensus.cc:2393] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:10.539865  1654 connection.cc:256] RPC call timeout handler was delayed by -2.4870684100000062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
I20260709 13:02:10.553776  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:10.554045  1654 connection.cc:256] RPC call timeout handler was delayed by -2.3916684100000225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:02:10.546377  1436 catalog_manager.cc:5697] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 3 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.534375  4214 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.560335  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.560534  4214 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:10.560868  4455 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:02:10.561604  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:10.562354  1536 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.562708  4214 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:10.563725  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:10.564209  4373 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:10.568153  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.569156  1686 raft_consensus.cc:2410] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:10.569248  1653 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:10.573089  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.569077  1505 leader_election.cc:336] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.787s (SENT)
I20260709 13:02:10.560359  1613 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:10.575717  2368 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
W20260709 13:02:10.581306  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51228.8us
I20260709 13:02:10.555506  1538 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
W20260709 13:02:10.486681  1437 rpcz_store.cc:269] 0709 13:01:50.834788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:50.854657 (+ 19869us) service_pool.cc:224] Handling call
0709 13:02:10.485904 (+19631247us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:04.216441 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:04.254659 (+ 38218us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:04.254700 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:02:04.254723 (+    23us) tablet.cc:662] Decoding operations
0709 13:02:04.255795 (+  1072us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:04.255859 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:04.255886 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:02:04.257007 (+  1121us) tablet.cc:701] Row locks acquired
0709 13:02:04.257023 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:02:04.257197 (+   174us) write_op.cc:270] Start()
0709 13:02:04.305478 (+ 48281us) write_op.cc:276] Timestamp: P: 1783602124257141 usec, L: 0
0709 13:02:04.305523 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:02:04.461937 (+156414us) log.cc:844] Serialized 4413 byte log entry
0709 13:02:05.643109 (+1181172us) op_driver.cc:464] REPLICATION: finished
0709 13:02:05.992545 (+349436us) write_op.cc:301] APPLY: starting
0709 13:02:06.002819 (+ 10274us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.033568 (+ 30749us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.052522 (+ 18954us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.226136 (+173614us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.226370 (+   234us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:02:06.226412 (+    42us) write_op.cc:312] APPLY: finished
0709 13:02:06.226730 (+   318us) log.cc:844] Serialized 82 byte log entry
0709 13:02:06.226893 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.227025 (+   132us) write_op.cc:454] Released schema lock
0709 13:02:06.227075 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.227432 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.227549 (+   117us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":63454,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":318552,"apply.run_cpu_time_us":5245,"apply.run_wall_time_us":250866,"num_ops":11,"prepare.queue_time_us":359581,"prepare.run_cpu_time_us":58533,"prepare.run_wall_time_us":508256,"raft.queue_time_us":523523,"raft.run_cpu_time_us":41129,"raft.run_wall_time_us":188405,"replication_time_us":1313858,"thread_start_us":833523,"threads_started":4,"wal-append.queue_time_us":326486,"wal-append.run_cpu_time_us":17461,"wal-append.run_wall_time_us":2428376}]]}
I20260709 13:02:10.585786   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:10.585148  1436 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 3 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.586118  4390 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.586849  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.546576  4281 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.587929  4281 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.590494  4281 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:10.591176  1609 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:10.592958  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:10.593793  1614 raft_consensus.cc:2368] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6.
I20260709 13:02:10.593891  1609 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:10.595274  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.596104  1607 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 4: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:10.597486  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:10.599809  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:10.600158  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.601384  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.601395  4338 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:10.602572  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.603111  4125 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:10.611682  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:10.611797  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:10.613303  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:10.614073  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58369.8us
W20260709 13:02:10.614547  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 45559.3us
I20260709 13:02:10.617189  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:10.618188  3960 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:10.618065  4190 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:10.619760  4190 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:10.618670  3960 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:10.621850  3960 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.622893  3960 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:10.626809  1536 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:10.618665  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:10.643518  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.650578  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:10.656699  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:10.658459  1614 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:10.660523  1607 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:10.661343  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:10.640726  4406 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.637392  4281 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:10.670292  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.646263  4338 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:10.673753  1613 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:10.645663  2363 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:10.680181  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 61626.6us
I20260709 13:02:10.695797  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.696501  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:10.697335  1540 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.697770  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.687079  1536 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:10.703583  1537 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:10.709326  4453 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:10.679425  4338 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.715077  4445 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:10.716256  4338 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:10.720489  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.720489  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.721345  1532 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:10.722647  4445 consensus_queue.cc:1243] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:10.723317  4445 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:10.723644  4445 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:10.724455  4445 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.729043  4445 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.733359  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.734112  1613 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:10.735739  1614 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:10.736161  2362 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 405) took 2058 ms (client timeout 1599 ms). Trace:
I20260709 13:02:10.736557  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:10.736634  2362 rpcz_store.cc:269] 0709 13:02:08.677303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:08.679973 (+  2670us) service_pool.cc:224] Handling call
0709 13:02:10.735924 (+2055951us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400580f54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:10.736067 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3533465344}
I20260709 13:02:10.737388  1615 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 4.
W20260709 13:02:10.737973  1654 connection.cc:256] RPC call timeout handler was delayed by -2.2692684099999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 13:02:10.738348  1654 connection.cc:256] RPC call timeout handler was delayed by -2.1243684099999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
W20260709 13:02:10.738867  1654 connection.cc:256] RPC call timeout handler was delayed by -2.016368410000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20920000000000002s for a response
W20260709 13:02:10.739182  1654 connection.cc:256] RPC call timeout handler was delayed by -1.9992684100000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 13:02:10.739459  1654 connection.cc:256] RPC call timeout handler was delayed by -1.863203502000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:02:10.740270  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.741849  4453 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.742307  4453 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.742651  4453 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.745350  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:10.745580  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.746002  1538 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:10.748824  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.749413  1538 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:10.750237  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:10.750775  1538 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.751513  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:10.753199  1537 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:10.751894  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.756799  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:10.758081  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:10.758702  1534 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:10.759464  4390 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:10.760094  4390 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:10.762339  4390 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:10.765098  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:10.739984  1654 connection.cc:256] RPC call timeout handler was delayed by -1.6661035019999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 13:02:10.766258  1654 connection.cc:256] RPC call timeout handler was delayed by -1.6410684100000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2509s for a response
W20260709 13:02:10.766602  1654 connection.cc:256] RPC call timeout handler was delayed by -1.6112035020000235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 13:02:10.767014  1654 connection.cc:256] RPC call timeout handler was delayed by -1.4996035020000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
W20260709 13:02:10.767373  1654 connection.cc:256] RPC call timeout handler was delayed by -1.4607443319999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 13:02:10.767748  1654 connection.cc:256] RPC call timeout handler was delayed by -1.432066088000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:02:10.768136  1654 connection.cc:256] RPC call timeout handler was delayed by -1.212466088000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 13:02:10.768498  1654 connection.cc:256] RPC call timeout handler was delayed by -1.204130852999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 13:02:10.768879  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0772308530000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
W20260709 13:02:10.769248  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0421308530000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260709 13:02:10.739370  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.773355  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:10.776360  1533 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:10.776957  1541 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:10.794451  1537 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:10.794288  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.794920  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:10.799367  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.805843  1540 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:10.807479  4295 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:02:10.807840  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 68580.7us
I20260709 13:02:10.803717  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:10.810160  4400 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:10.810300  4315 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.810891  4315 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:10.811328  4315 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.816371  4442 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:10.820295  4315 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.823020  4315 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:10.825047  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:10.793864  4406 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:10.826032  4390 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:10.827560  4390 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.826144  2329 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:10.829351  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:10.851619  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 57473.9us
I20260709 13:02:10.852926  1504 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:10.854789  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 57509.8us
W20260709 13:02:10.854874  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46173.6us
I20260709 13:02:10.856088  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:10.857600  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.856195  4219 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:02:10.864162  4359 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.851016  4406 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:10.865880  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:10.866981  4406 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:10.828682  4295 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:10.872690  4295 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:10.873571  4400 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.874455  4315 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.873519  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:10.875211  4315 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:10.863499  4391 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:10.842566  4361 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:10.876187  4448 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:10.882161  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:10.888170  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:10.878454  4467 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:02:10.895212  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:10.877276  4190 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:10.880192  4361 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.908582  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:10.909834  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.881436  4214 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:10.896149  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:02:10.919479  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 292344us
I20260709 13:02:10.892105  4448 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:10.923229  1538 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:10.926946  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.905458  4400 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:10.906745  4359 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:10.909536  4281 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:10.914158  4190 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:10.921939  4214 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:10.918421  4361 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:10.927625  4373 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:10.965246  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:10.966624  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:10.967566  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:10.988372  1538 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:10.989566  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:10.946067  4448 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.948776  4400 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:10.998292  1690 raft_consensus.cc:2393] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:10.988564  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 107482us
I20260709 13:02:10.999037  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:11.007380  1610 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:10.968309  4214 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:11.002730  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 3.337s (SENT) [suppressed 24 similar messages]
W20260709 13:02:11.029709  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 174013us
W20260709 13:02:11.030561  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 122050us
I20260709 13:02:11.033406  1504 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:11.035076  1504 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:11.036906  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:11.005920  4125 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.006251  4400 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:10.960366  4190 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:10.956666  4359 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.058990  1654 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:11.059394  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:11.060706  1686 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:11.061596  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:11.063084  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:11.063819  1689 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.056231  1580 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:10.955940  4440 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:11.055006  4125 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.070878  4440 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.073136  4125 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.056376  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:11.058815  4406 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:11.042325  4281 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:11.067354  4338 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:11.090870  1684 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:11.097121  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.100257  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:11.001215  4373 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:11.131410  1690 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:11.136509  1681 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:02:11.137085  1681 pending_rounds.cc:85] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 3
I20260709 13:02:11.137423  1681 pending_rounds.cc:107] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:02:11.137674  1681 raft_consensus.cc:2889] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:11.073701  4440 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:11.109181  4406 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.123028  4281 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:11.124714  4219 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:11.080569  4478 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:11.155454  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:11.158260  1689 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:02:11.162884  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 162968us
I20260709 13:02:11.167002  1681 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:11.157840  4406 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:11.159103  4281 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.159422  4440 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:02:11.163115  4416 consensus_meta.cc:287] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.665s	user 0.012s	sys 0.003s
I20260709 13:02:11.157335  4477 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.144251  4373 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:11.223538  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 184743us
W20260709 13:02:11.283886  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 60966.3us
I20260709 13:02:11.267992  4359 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.289130  1580 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:11.248586  4416 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:02:11.252985  4219 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:02:11.263108  4482 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:02:11.292807  4485 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.262723  4125 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:02:11.333527  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.339197  4469 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:02:11.316819  3989 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.355899  4295 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:11.360936  4295 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.358530  3989 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:11.376571  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.377681  3989 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.372707  2362 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
W20260709 13:02:11.358121  4468 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:02:11.348984  4390 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:11.386647  1616 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:11.314603  4480 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.326678  4359 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:11.398375  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 92059.4us
W20260709 13:02:11.391350  4476 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 13:02:11.394610  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 294412us
I20260709 13:02:11.404578  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:02:11.418062  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 144112us
I20260709 13:02:11.423811  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:11.424078  4219 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:11.424887  4474 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:11.425364  4474 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:11.426436  4474 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.427596  4474 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:11.428344  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:11.367878  4448 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:11.435474  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.441143  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.402799  4478 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:11.453459  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:11.454519  1610 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:11.414328  4125 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:11.414427  4480 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.412271  4440 raft_consensus.cc:697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:11.464264  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.380587  4485 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:11.483357  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 77627.2us
I20260709 13:02:11.542204  4190 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.543288  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:11.544685  4190 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.546676  4478 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.546780  4406 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.463239  4479 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:11.561652  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.548346  4361 consensus_meta.cc:287] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.555s	user 0.019s	sys 0.004s
I20260709 13:02:11.549513  4448 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.549706  4480 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.555581  1685 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:11.556875  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:11.568138  1610 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
W20260709 13:02:11.568485  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 128616us
W20260709 13:02:11.569057  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 126539us
I20260709 13:02:11.574676  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:11.576896  4361 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:11.577435  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:11.620455  1688 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:02:11.577646  4359 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:11.578056  4190 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:11.584143  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:11.588799  4486 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:02:11.610791  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1777) took 1057 ms. Trace:
I20260709 13:02:11.611362  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:11.623483  4460 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.626976  1616 rpcz_store.cc:276] 0709 13:02:10.553100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.553554 (+   454us) service_pool.cc:224] Handling call
0709 13:02:11.610573 (+1057019us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b54000b1dd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:11.610714 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541707648}
I20260709 13:02:11.631672  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:11.614543  4214 consensus_meta.cc:287] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.563s	user 0.014s	sys 0.000s
W20260709 13:02:11.599979  4453 consensus_meta.cc:287] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.003s
I20260709 13:02:11.624600  4361 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.625262  4359 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:11.630203  1579 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:11.623616  4281 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.612537  4373 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:11.575601  4125 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:11.616174  2363 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:11.646368  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:11.666999  2368 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:11.669872  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:11.631759  4391 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:11.675290  1538 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:11.676321  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 65103.3us
I20260709 13:02:11.681717  4494 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:11.685465  4406 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.685735  4281 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:11.685789  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:11.735895  1682 raft_consensus.cc:3060] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:11.652245  4460 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:11.689325  4125 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:11.690423  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44170us
W20260709 13:02:11.741904  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.651167  4445 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 13:02:11.671554  4448 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:11.635284  4477 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:11.605824  4488 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:02:11.649085  4315 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:11.670451  2362 raft_consensus.cc:2368] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9.
I20260709 13:02:11.696368  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:11.754712  1685 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:11.732537  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.651906  4214 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:11.747291  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 76238us
I20260709 13:02:11.690994  4361 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:11.752205  1689 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:11.727905  4190 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.745157  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:11.734571  4391 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:11.759809  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.542994  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:11.761662  1540 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:02:11.761992  1688 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:11.760885  1683 raft_consensus.cc:606] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:11.762462  1683 raft_consensus.cc:614] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:11.658471  4453 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:11.671603  4400 consensus_meta.cc:287] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 13:02:11.781924  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:11.784924  1505 leader_election.cc:336] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.518s (SENT)
I20260709 13:02:11.785928  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:11.761139  4190 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:11.786615  1608 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:11.777086  4361 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:11.788691  4361 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:11.731174  4479 consensus_queue.cc:1059] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:02:11.759490  4448 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:11.813657  1538 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
W20260709 13:02:11.862301  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57579.2us
I20260709 13:02:11.863236  2329 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:11.882687  4429 raft_consensus.cc:2804] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:11.883335  4429 raft_consensus.cc:697] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:11.737278  4440 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:11.887252  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 105454us
I20260709 13:02:11.884222  4429 consensus_queue.cc:237] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:11.891112  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 106256us
W20260709 13:02:11.921545  1505 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.554s (SENT)
I20260709 13:02:11.754225  4491 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:02:11.784479  4315 raft_consensus.cc:697] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:11.886639  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 98505.7us
W20260709 13:02:11.930476  1505 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.632s (SENT)
I20260709 13:02:11.925786  1685 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:11.931016  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:11.933405  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 262101us
I20260709 13:02:11.932201  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:11.936208  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:11.937054  1616 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:11.943920  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.936812  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:11.965878  1654 leader_election.cc:400] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6.
I20260709 13:02:11.966343  1654 leader_election.cc:403] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:02:11.863768  4485 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:11.940816  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 260026us
I20260709 13:02:11.980953  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:11.977229  2328 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:11.893196  4495 raft_consensus.cc:3055] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:11.810935  4416 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 13:02:11.913336  4493 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.995927  1683 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:11.992599  4479 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:11.997112  4488 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6.
I20260709 13:02:11.797340  4400 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:11.992643  4324 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:12.001943  4324 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.002069  1539 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:12.002420  4324 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.005537  4400 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:11.971688  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.801430  4498 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:02:11.927146  4501 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:12.008009  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.011641  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.015496  1616 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:12.019793  1682 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:11.974736  4477 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:12.027127  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:11.991325  4281 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:11.995613  4495 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:11.983918  4391 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:12.037590  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 114505us
W20260709 13:02:12.038527  1505 leader_election.cc:336] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.640s (SENT)
I20260709 13:02:11.974426  4373 consensus_queue.cc:1059] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:02:12.039860  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.983294  4497 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
W20260709 13:02:12.046273  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:11.997438  4390 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:02:12.046921  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.055091  1616 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:12.059470  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:12.063989  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.067710  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.040385  4477 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:12.075642  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:12.079118  4190 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:12.056636  4315 consensus_queue.cc:237] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:12.090993  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.108901  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.072779  4400 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:12.146188  1504 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:12.149322  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:12.043504  4448 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.152077  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:12.107328  4453 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:12.151329  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 112834us
I20260709 13:02:12.151775  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:12.152872  1681 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.153522  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:12.152244  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 186568us
I20260709 13:02:12.165089  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:12.165709  1689 raft_consensus.cc:606] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
W20260709 13:02:12.167090  1505 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.664s (SENT)
I20260709 13:02:12.167477  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.165320  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:12.146840  4214 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:12.153191  4281 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:12.174830  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.176385  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.175137  4400 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:12.182215  4324 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:12.231101  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:12.182915  4390 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:12.189352  4453 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.100145  4495 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:12.165867  4477 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:12.193059  4474 consensus_meta.cc:287] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.765s	user 0.008s	sys 0.006s
I20260709 13:02:12.193377  1681 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:12.203377  4484 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:12.203037  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:12.209793  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.211529  4359 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.271293  1615 raft_consensus.cc:2368] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7.
I20260709 13:02:12.231241  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:12.237144  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 60812.9us
I20260709 13:02:12.245241  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:12.253720  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 86638.2us
W20260709 13:02:12.274549  1505 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.789s (SENT)
I20260709 13:02:12.275141  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.279332  1689 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:12.282375  4178 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:12.282949  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51836.8us
I20260709 13:02:12.283705  4178 raft_consensus.cc:3055] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:12.284088  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:12.284576  4508 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:12.285183  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:12.218977  4281 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.286944  4510 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:12.287370  4281 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.287528  4510 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:12.288179  4510 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.284147  4178 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:12.292837  4178 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:12.293804  4359 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.295295  1608 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:12.296820  4178 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.297858  4495 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.298308  4479 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:12.300000  1505 leader_election.cc:336] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.792s (SENT)
I20260709 13:02:12.300616  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.239758  4214 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:12.304996  1687 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:12.306186  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70e893ad27ae41db934ba22b14642022"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:12.307118  1682 raft_consensus.cc:606] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:12.307587  1682 raft_consensus.cc:614] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:12.335003  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.240954  4093 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:02:12.337399  1614 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:12.336771  1535 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:12.347200  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:12.347785  1536 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:12.348582  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:12.342768  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.315876  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:12.344802  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:12.351469  1616 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:12.351643  1534 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:12.300767  4488 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:12.330470  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:12.317615  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:12.270332  4484 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:12.357656  1541 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:12.310117  4493 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:12.246549  4453 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.358896  1537 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:12.310199  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:12.364753  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:12.374248  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 74337.1us
W20260709 13:02:12.317951  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.339568  4491 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:12.375415  1505 leader_election.cc:336] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.958s (SENT)
I20260709 13:02:12.370357  1532 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:12.349555  4497 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:12.388129  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.354221  4359 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:12.382464  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.394963  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.396185  1611 raft_consensus.cc:1217] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Deduplicated request from leader. Original: 3.2->[5.3-5.3]   Dedup: 5.3->[]
I20260709 13:02:12.399945  1609 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:12.403806  1611 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:12.407001  1608 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:12.418434  1536 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:12.371315  4488 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:12.382478  4493 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:12.435956  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.370033  3960 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:02:12.338294  4281 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.433705  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:12.440778  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:12.446187  1688 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:12.456192  1611 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:12.469221  1686 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:12.484335  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.490425  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:12.494825  1614 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:12.495570  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 120196us
W20260709 13:02:12.497469  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.502475  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.485803  4453 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:12.469089  4178 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.506024  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:12.489447  4324 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:12.520151  4485 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:12.520605  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:12.508769  4478 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:12.521831  4178 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:12.522543  4478 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:12.519400  4497 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.529062  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:12.530393  1686 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:12.532073  2363 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:12.533567  4497 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.526118  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.535456  4281 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:12.540155  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91dad730840e45b68065507815614a40"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:12.540920  1687 raft_consensus.cc:606] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:12.552842  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:12.540375  4501 consensus_meta.cc:287] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.003s
I20260709 13:02:12.556313  4509 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:12.537829  4178 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:12.470783  4488 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.536789  4453 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:12.580638  1616 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:02:12.590309  1611 raft_consensus.cc:1217] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Deduplicated request from leader. Original: 4.3->[6.4-6.4]   Dedup: 6.4->[]
I20260709 13:02:12.540470  4505 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:12.461019  4493 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.537513  4510 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.593080  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.675258  1611 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:12.604453  4478 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:12.620517  4373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.012s	sys 0.028s
I20260709 13:02:12.674468  4497 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:12.677461  4373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.015s	sys 0.044s
I20260709 13:02:12.677806  4453 raft_consensus.cc:697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:12.676878  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.678750  1611 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:12.678854  4453 consensus_queue.cc:237] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.678957  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.679865  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:12.659600  1505 leader_election.cc:336] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.974s (SENT)
I20260709 13:02:12.682536  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.682801  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.686821  1614 raft_consensus.cc:2393] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:12.695456  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.567313  4501 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:12.698756  1505 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.029s (SENT)
I20260709 13:02:12.704476  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.706661  4125 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:12.710799  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.725380  1612 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:12.711936  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:12.712273  2362 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 411) took 1281 ms (client timeout 1599 ms). Trace:
I20260709 13:02:12.713153  4510 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:12.719177  1505 leader_election.cc:336] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.105s (SENT)
I20260709 13:02:12.723263  4484 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:12.727064  1611 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:12.700314  4478 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:12.734040  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:12.736768  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.738998  1612 raft_consensus.cc:1217] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Deduplicated request from leader. Original: 3.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:02:12.739113  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.739753  1612 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:12.741462  1615 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:12.741962  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.731243  4505 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:12.737105  4501 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.743719  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.748878  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.741159  4509 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:02:12.756498  1610 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:02:12.756376  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.733580  4125 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:12.732614  2362 rpcz_store.cc:269] 0709 13:02:11.423299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:11.423477 (+   178us) service_pool.cc:224] Handling call
0709 13:02:12.697779 (+1274302us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400580f54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:12.704754 (+  6975us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464206208}
I20260709 13:02:12.743571  4477 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:12.747268  4501 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:12.777020  4460 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:12.777298  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.744246  4484 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:12.785751  4125 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:12.786562  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.786818  4391 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:12.789963  4515 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.368s	user 0.002s	sys 0.001s
I20260709 13:02:12.758005  4505 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:12.798529  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:12.801079  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.804692  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 102027us
W20260709 13:02:12.818472  1505 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.559s (SENT)
I20260709 13:02:12.818945  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.812244  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.821681  4491 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:12.823427  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:12.824308  1505 leader_election.cc:336] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.571s (SENT)
I20260709 13:02:12.824692  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:12.824800  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.825690  4493 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:12.828888  4497 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:12.829658  4497 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:12.830408  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.830180  4497 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:12.831027  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.832154  4510 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:12.827850  1505 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.614s (SENT)
I20260709 13:02:12.833154  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:12.833230  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:12.834615  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:12.836916  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.826094  4493 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:12.840684  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.849251  4498 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:12.851634  4501 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:12.869006  1653 leader_election.cc:400] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9.
I20260709 13:02:12.869357  1653 leader_election.cc:403] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:12.855892  4505 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:12.856398  1611 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
W20260709 13:02:12.860459  1505 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.640s (SENT)
I20260709 13:02:12.871094  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:12.875166  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.877010  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.878350  4373 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:12.878830  4373 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:12.879221  4373 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:12.880594  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47530.7us
I20260709 13:02:12.881728  1615 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:12.887868  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:12.889075  4529 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:02:12.889346  4400 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:12.869902  4493 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:12.868822  4498 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:12.932896  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:12.889107  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:12.893270  4501 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:12.895072  4510 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:12.895447  1505 leader_election.cc:336] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.276s (SENT)
I20260709 13:02:12.897110  4479 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9.
I20260709 13:02:12.898669  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:12.993398  1682 raft_consensus.cc:2410] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:12.899745  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:12.996995  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.907704  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:12.910588  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:12.933584  1608 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:02:12.978685  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:12.952617  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:12.991911  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:13.001292  1684 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.007447  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:13.008406  1682 raft_consensus.cc:606] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:12.929776  4315 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.998407  1539 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
W20260709 13:02:13.027866  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:12.932421  4497 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:13.044076  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.062369  4491 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:13.072594  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.139818  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 244405us
W20260709 13:02:13.141141  1505 leader_election.cc:336] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.692s (SENT)
I20260709 13:02:12.931890  4390 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:02:13.199051  2363 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:13.199281  4400 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:13.199842  4400 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.203372  4400 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:13.237594  1614 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:13.123515  4125 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:13.244359  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.560209  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.560976  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.194309  4495 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.461337  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:13.465569  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 324487us
I20260709 13:02:13.563753  1540 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:13.563967  1505 leader_election.cc:336] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.695s (SENT)
W20260709 13:02:13.565112  1505 leader_election.cc:336] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.734s (SENT)
I20260709 13:02:13.565464  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:13.469949  1689 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:02:13.566156  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.477269  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.493165  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:13.313752  4529 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.328353  1535 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:13.380964  4515 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:02:13.514739  4391 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.000s
I20260709 13:02:13.423978  4390 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:02:13.307410  4488 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:13.536526  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:13.551469  1687 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.022s	sys 0.074s
W20260709 13:02:13.605789  1687 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.022s	sys 0.074s
W20260709 13:02:13.605947  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.552529  1683 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:13.552285  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:13.557339  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:13.607395  1615 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:13.070768  4315 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:13.566926  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.568892  2368 raft_consensus.cc:2393] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:13.571085  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:13.580487  1684 consensus_meta.cc:287] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.006s
I20260709 13:02:13.610175  1684 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
W20260709 13:02:13.566025  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 52439.1us
I20260709 13:02:13.600620  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.579990  4495 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:13.597342  4093 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.609791  4400 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:13.574996  4125 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:13.576728  4529 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:13.611677  1540 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:13.612255  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:13.791147  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 178979us
W20260709 13:02:13.612270  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47194.8us
W20260709 13:02:13.793538  1505 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.761s (SENT)
I20260709 13:02:13.793928  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:13.616866  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.795986  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:13.617769  4315 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:13.624578  1615 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:13.624588  1614 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
W20260709 13:02:13.637116  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.662861  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.683900  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.684621  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:13.682571  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.810424  1613 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:13.707394  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.643064  4391 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.909080  4416 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:13.909407  4391 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:13.909937  4416 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:13.663280  4093 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.851276  4425 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:13.619715  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.912420  4502 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:02:13.913329  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:13.775506  4529 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.913810  1612 raft_consensus.cc:2410] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:13.666708   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:13.914192  4448 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:13.914885  4448 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.882768  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.916442  1611 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:13.874624  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.661844  4495 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:13.763067  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.004s	sys 0.037s
I20260709 13:02:13.674790  4440 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:13.917662  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:13.825289  4501 consensus_meta.cc:287] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.005s
I20260709 13:02:13.904072  2329 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:02:13.918365  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.005s	sys 0.042s
I20260709 13:02:13.698282  1686 raft_consensus.cc:1275] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:13.920737  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 1.02108e+06us
I20260709 13:02:13.920275  4502 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:13.921216  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 395) took 1015 ms. Trace:
I20260709 13:02:13.921761  4502 raft_consensus.cc:697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:13.761215  4449 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.023s	sys 0.018s
I20260709 13:02:13.922775  4315 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:13.923530  4449 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.024s	sys 0.024s
I20260709 13:02:13.922856  4502 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.917541  4448 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:13.925038  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:13.762969  4488 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.925781  4315 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:13.876969  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.881809  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.918478  4416 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:13.927313  4093 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:13.825567  4400 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:13.928694  4440 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.929253  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.709997  4509 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:13.930099  1607 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:13.930190  4509 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:13.931068  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:13.752358  4125 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:13.932726  1615 raft_consensus.cc:2368] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7.
I20260709 13:02:13.928875  4400 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:13.871019  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 77514.2us
I20260709 13:02:13.922266  1686 rpcz_store.cc:276] 0709 13:02:12.905896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.691416 (+785520us) service_pool.cc:224] Handling call
0709 13:02:13.692001 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:13.920807 (+228806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:13.921030 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:13.919866  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.724391  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.932178  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.724287  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.725190  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:13.728785  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:13.915863  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:13.868942  4484 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:02:13.927461  1610 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:13.952828  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:13.734031  1437 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 4 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.918576  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.955756  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:13.955886  1682 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:13.928323  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.955974  1613 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:13.957702  1609 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
W20260709 13:02:13.720623  4545 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.076s	user 0.000s	sys 0.003s
I20260709 13:02:13.911873  4391 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:13.919723  4501 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:13.962350  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:13.962605  1684 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:13.976830  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:13.977299  4542 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:13.952301  4416 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:13.977911  4542 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:13.978775  4542 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:13.978699  4416 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.981292  4416 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:13.982120  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:13.983613  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:13.968695  4448 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:13.984818  4448 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.875393  4474 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:13.986097  4474 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:13.965299  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:13.987308  4373 consensus_meta.cc:287] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.108s	user 0.011s	sys 0.002s
I20260709 13:02:13.990214  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:13.990671  4479 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:13.991369  4479 raft_consensus.cc:697] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:13.991859  4474 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:13.991662  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:13.992838  4493 consensus_meta.cc:287] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.998s	user 0.013s	sys 0.000s
I20260709 13:02:13.993505  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:13.994208  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.994982  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:13.959904  1437 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.995467  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.996237  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:13.974915  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.990092  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:13.992715  1535 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:14.002969  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.992354  4479 consensus_queue.cc:237] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:13.993330  4493 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.018296  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:13.912681  4425 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:13.944070   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:13.998097  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 52717.3us
I20260709 13:02:13.975630  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.971118  4495 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.001988  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.025485  1613 raft_consensus.cc:2410] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:14.002156  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.997187  1608 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:14.026381  1611 raft_consensus.cc:2376] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8. Re-sending same reply.
W20260709 13:02:13.966955  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 51150.7us
I20260709 13:02:14.006078  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:14.011176  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.996769  1437 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.019047  1685 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:14.016728  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:14.017400  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:13.987484  4448 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:14.022957  4440 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:14.023650  4315 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:14.030431  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.034185  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:14.035341  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.108609  1612 raft_consensus.cc:2376] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8. Re-sending same reply.
I20260709 13:02:14.037370  1579 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:14.108482  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 177) took 18515 ms (client timeout 15000 ms). Trace:
W20260709 13:02:14.109724  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 72433.4us
W20260709 13:02:14.046380  1690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.032s	sys 0.036s
I20260709 13:02:14.047287  1437 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:13.974165  4510 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:14.099094  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.002849  4416 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:14.120105  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.120720  1689 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:14.099875  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:14.108510  1609 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:14.121698  1615 raft_consensus.cc:2376] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7. Re-sending same reply.
I20260709 13:02:14.122820  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.100839  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.123901  1614 raft_consensus.cc:2393] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:14.102438  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63717.5us
W20260709 13:02:14.103245  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 59636.2us
I20260709 13:02:14.124290  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.103195  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:14.125574  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:14.126356  1610 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:13.969102  4390 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.129s
W20260709 13:02:14.110859  1690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.032s	sys 0.036s
I20260709 13:02:14.112246  1437 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 3 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.115164  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.131139  1437 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.132767  1611 raft_consensus.cc:2410] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:02:14.116202  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.116981  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:14.118551  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:14.133134  1437 catalog_manager.cc:5697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:14.119450  1687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.010s
I20260709 13:02:14.029685  1686 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
W20260709 13:02:14.134550  1687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.000s	sys 0.010s
I20260709 13:02:14.135831  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.137394  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.142426  1437 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.143383  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:14.028470  4425 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.144325  1437 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.147150  1612 raft_consensus.cc:2410] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:14.148576  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.149745  1611 raft_consensus.cc:2410] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:14.153405  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:14.030908  4501 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.155380  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:14.156176  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.987787  4373 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.156847  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.163241  1613 raft_consensus.cc:2410] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:14.157248  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.158743  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1829) took 1262 ms. Trace:
I20260709 13:02:14.165729  1607 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:14.165753  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.166821  1611 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:14.193111  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.164312  1687 rpcz_store.cc:276] 0709 13:02:12.896564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.896741 (+   177us) service_pool.cc:224] Handling call
0709 13:02:12.897121 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:12.897353 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:13.606226 (+708873us) log.cc:844] Serialized 14 byte log entry
0709 13:02:14.158007 (+551781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:14.158099 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:14.158168 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.158496 (+   328us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.158667 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6171,"prepare.queue_time_us":919916,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":5563,"thread_start_us":1236946,"threads_started":2}
I20260709 13:02:13.713433  4498 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.119848  4510 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:14.235760  1611 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:02:14.236354  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.240552  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.128926  4448 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.102200  4474 consensus_queue.cc:1059] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:02:14.244709  1614 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:14.248171  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:14.110085  1436 rpcz_store.cc:269] 0709 13:01:55.593346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:55.611012 (+ 17666us) service_pool.cc:224] Handling call
0709 13:02:14.108396 (+18497384us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:10.761117 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:10.762257 (+  1140us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:10.762363 (+   106us) write_op.cc:435] Acquired schema lock
0709 13:02:10.762381 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:10.817484 (+ 55103us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:10.817612 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:10.817639 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:02:10.818563 (+   924us) tablet.cc:701] Row locks acquired
0709 13:02:10.818616 (+    53us) write_op.cc:260] PREPARE: finished
0709 13:02:10.818811 (+   195us) write_op.cc:270] Start()
0709 13:02:10.818974 (+   163us) write_op.cc:276] Timestamp: P: 1783602130818740 usec, L: 0
0709 13:02:10.818998 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:10.872738 (+ 53740us) log.cc:844] Serialized 2093 byte log entry
0709 13:02:11.360473 (+487735us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb03e28 00007fd03253e581 00007fd03253dd58 00007fd0325429f1 00007fd0325429a9 00007fd032542939 00007fd032542901 00007fd032541b2d 000000000038f354 000000000038f199
0709 13:02:11.672475 (+312002us) op_driver.cc:464] REPLICATION: finished
0709 13:02:11.993327 (+320852us) write_op.cc:301] APPLY: starting
0709 13:02:12.013541 (+ 20214us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:12.047727 (+ 34186us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:12.057822 (+ 10095us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:12.134582 (+ 76760us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:12.134938 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:02:12.135007 (+    69us) write_op.cc:312] APPLY: finished
0709 13:02:12.135414 (+   407us) log.cc:844] Serialized 46 byte log entry
0709 13:02:12.135644 (+   230us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:12.135784 (+   140us) write_op.cc:454] Released schema lock
0709 13:02:12.135868 (+    84us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:12.136354 (+   486us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:12.136377 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1643234,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":182359,"apply.run_cpu_time_us":4327,"apply.run_wall_time_us":201030,"num_ops":5,"prepare.queue_time_us":91619,"prepare.run_cpu_time_us":29096,"prepare.run_wall_time_us":651894,"raft.queue_time_us":290267,"raft.run_cpu_time_us":10895,"raft.run_wall_time_us":166330,"replication_time_us":828931,"spinlock_wait_cycles":87295872,"thread_start_us":412656,"threads_started":4,"wal-append.queue_time_us":281488,"wal-append.run_cpu_time_us":16786,"wal-append.run_wall_time_us":1982150}]]}
I20260709 13:02:14.153927  4495 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:14.229426  4485 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.007s	sys 0.009s
I20260709 13:02:14.258311  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.269961  1615 raft_consensus.cc:2410] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:14.164207  1437 catalog_manager.cc:5697] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 2 to 4, term changed from 3 to 6, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.252473  1608 raft_consensus.cc:2376] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6. Re-sending same reply.
W20260709 13:02:14.241617  4453 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.020s	sys 0.014s
I20260709 13:02:14.243557  4315 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.253600  4501 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:14.281920  4315 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.282626  4501 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:14.284137  1655 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.119s	sys 0.163s
W20260709 13:02:14.284564  1655 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.119s	sys 0.163s
I20260709 13:02:14.286481  4495 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:14.286578  4488 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:14.287588  4495 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.243089  4547 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:14.291757  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.295171  1612 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:14.145870  4416 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.294631  1437 catalog_manager.cc:5697] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 2 to 5, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:14.255963  4510 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.308705  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:13.983959  4509 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:14.290716  4453 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.020s	sys 0.014s
W20260709 13:02:14.337980  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.254171  4448 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.294981  4391 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.322692  4373 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:14.324476  4501 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:14.297190  4498 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:14.357075  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.357577  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.345335  1610 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
W20260709 13:02:14.346717  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.015s	sys 0.032s
W20260709 13:02:14.348201  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 341016us
W20260709 13:02:14.351397  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.023s	sys 0.038s
W20260709 13:02:14.359532  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.015s	sys 0.032s
W20260709 13:02:14.359702  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.024s	sys 0.038s
I20260709 13:02:14.307493  1437 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:14.391811  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:14.343595  4448 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.347492  4391 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.399060  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:14.357643  4400 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:14.375151  4501 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.405706  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:14.405915  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.378495  4315 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:14.412027  1607 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:14.404235  4546 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:14.404222  4391 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:14.428155  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 274837us
I20260709 13:02:14.403986  4390 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 13:02:14.357582  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.431586  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.432471  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.420609  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 295623us
I20260709 13:02:14.439448  4484 consensus_queue.cc:1048] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:14.416149  4501 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:14.611634  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.444239  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 319660us
I20260709 13:02:14.554617  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:14.444963  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.596894  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.562450  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 353) took 1648 ms. Trace:
W20260709 13:02:14.636194  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.471241  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 111055us
W20260709 13:02:14.542699  4558 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
W20260709 13:02:14.543962  4550 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:02:14.533205  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 119695us
I20260709 13:02:14.623428  2329 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:02:14.576838  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 154517us
I20260709 13:02:14.423619  4315 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.552255  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1831) took 1655 ms. Trace:
W20260709 13:02:14.657809  1505 leader_election.cc:336] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.556s (SENT)
I20260709 13:02:14.573201  4125 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:14.427181  4493 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:14.636243  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.657457  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:14.672150  4488 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:14.672660  4488 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:14.551532  4529 consensus_meta.cc:287] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.638s	user 0.006s	sys 0.006s
I20260709 13:02:14.638170  1616 rpcz_store.cc:276] 0709 13:02:12.913808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.913932 (+   124us) service_pool.cc:224] Handling call
0709 13:02:12.976981 (+ 63049us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:12.995162 (+ 18181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:12.995192 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:13.553039 (+557847us) log.cc:844] Serialized 26 byte log entry
0709 13:02:13.700756 (+147717us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b48000f15d8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd033a31aa1 00007fd033a28b37 00007fd033a289ca 00007fd033b2026f 00007fd033b1ff37 00007fd033b3455c 00007fd033b34508 00007fd033b34488 00007fd033b34443 00007fd033b336ec 00007fd032a5da96
0709 13:02:14.360110 (+659354us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:14.360153 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.360223 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.561960 (+201737us) raft_consensus.cc:1685] finished
0709 13:02:14.561993 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.562361 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17754,"raft.queue_time_us":21555,"raft.run_cpu_time_us":26745,"raft.run_wall_time_us":694402,"spinlock_wait_cycles":20638592,"thread_start_us":743270,"threads_started":1,"wal-append.queue_time_us":845537}
I20260709 13:02:14.637905  1609 raft_consensus.cc:2376] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6. Re-sending same reply.
I20260709 13:02:14.658905  1690 rpcz_store.cc:276] 0709 13:02:12.897149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:12.900273 (+  3124us) service_pool.cc:224] Handling call
0709 13:02:12.979949 (+ 79676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.130398 (+1150449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.130430 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.130944 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.421194 (+290250us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:14.421234 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.421303 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:14.551796 (+130493us) raft_consensus.cc:1685] finished
0709 13:02:14.551828 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:14.552157 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":255071,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":12642,"thread_start_us":1439826,"threads_started":2,"wal-append.queue_time_us":414181}
W20260709 13:02:14.647202  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.519374  4559 raft_consensus.cc:993] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:14.424302  4546 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:14.659518  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:14.469226  4560 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:14.518424  4485 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:14.693815  4572 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.491664  4562 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:14.695125  1608 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:14.695180  4562 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:14.670987  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:14.697588  4474 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.698304  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:14.699322  4542 consensus_meta.cc:287] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.720s	user 0.008s	sys 0.002s
I20260709 13:02:14.698299  4559 raft_consensus.cc:1081] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:14.700371  4567 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:14.701885  4564 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:14.702142  1613 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:14.696503  4391 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.709779  1682 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:14.677335  4561 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:14.702312  4564 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:14.715891  4561 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:14.709144  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.716517  4561 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.682336  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.713383  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:14.717398  1615 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:14.682610  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:14.660116  4315 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:14.525461  4416 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:14.536355  4554 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:14.688630  1607 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:02:14.679073  4546 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:14.699229  1690 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:14.660861  4125 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:14.725587  4485 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:14.732403  4125 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.733639  4125 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.736716  4429 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:14.736768  4485 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:14.738248  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:14.719645  1614 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.689504  4488 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.707336  4509 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:14.709606  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:14.720362  1612 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:14.707472  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:14.431304  4400 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.692685  1505 leader_election.cc:336] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.783s (SENT)
W20260709 13:02:14.745734  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 53104.7us
W20260709 13:02:14.686178  4502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.018s	sys 0.007s
W20260709 13:02:14.746657  4502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.018s	sys 0.007s
I20260709 13:02:14.693099  4560 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:14.752381  1505 leader_election.cc:336] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.903s (SENT)
W20260709 13:02:14.753309  1505 leader_election.cc:336] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.911s (SENT)
I20260709 13:02:14.726622  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:14.469079  4479 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.218s
I20260709 13:02:14.731230  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.738507  1615 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:14.683111  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.590217  4547 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:14.639381  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:14.754350  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:14.768714  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 129479us
I20260709 13:02:14.725868  4315 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.723980  4449 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:14.698267  4562 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:14.766134  1611 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:14.729067  4391 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:14.781111  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:14.699816  4542 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.755266  1614 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:14.771129  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:14.682641  4529 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:14.773480  1505 leader_election.cc:336] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.870s (SENT)
I20260709 13:02:14.784303  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:14.775642  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.785840  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:14.777220  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:14.786540  1534 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:14.786827  1539 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:14.778155  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:14.787478  1535 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:14.787606  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:14.787734  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:14.789250  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:14.788393  1534 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:14.790678  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:14.791812  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:14.792364  1533 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:14.792774  1539 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.754467  4567 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.799937  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:14.758152  4485 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.819706  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:14.752101  4560 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:14.825212  1685 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:14.826982  1532 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:14.833065  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.780711  4572 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:14.772101  4573 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:14.716766  4564 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.837428  1681 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:14.835404  1683 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:14.839937  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:14.799744  4562 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.849092  1534 raft_consensus.cc:2393] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:14.850829  1533 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:02:14.855302  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.772317  4390 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:02:14.757385  4400 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.801587  4557 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:14.861480  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:14.778465  4559 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:02:14.760537  4509 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:14.867074  1532 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:14.852766  4425 consensus_meta.cc:287] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.676s	user 0.006s	sys 0.007s
I20260709 13:02:14.833611  4566 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:14.876314  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.760922  4554 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:14.883818  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:14.864898  4563 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:02:14.898942  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 125517us
W20260709 13:02:14.900172  1505 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.946s (SENT)
I20260709 13:02:14.900712  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:14.840915  4448 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.793372  4449 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:14.951611  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1834) took 1242 ms. Trace:
I20260709 13:02:14.838248  4485 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.920640  1616 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:14.952149  1681 rpcz_store.cc:276] 0709 13:02:13.709575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.726867 (+ 17292us) service_pool.cc:224] Handling call
0709 13:02:13.727187 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:14.843538 (+1116351us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.951319 (+107781us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001199d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:14.951537 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2553055616}
I20260709 13:02:14.949458  4448 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:14.954006  1539 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:14.883574  4479 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:14.898389  4505 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.917191  4501 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:14.886668  4474 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:14.945385  4498 consensus_meta.cc:287] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.001s
W20260709 13:02:14.964148  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 64036.5us
I20260709 13:02:14.921957  4559 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:14.971985  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:14.859480  4562 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:14.976027  1505 leader_election.cc:336] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 3.013s (SENT)
I20260709 13:02:14.944087  4557 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:14.984937  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:14.883452  4425 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:14.852687  4573 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.018020  1681 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:15.027616  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.028257  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.028698  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.883315  4566 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:14.994712  4440 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.035445   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:15.033740  4577 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:02:15.050264  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.884317  4547 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.008121  4390 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:15.085321  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:15.091159  1681 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:14.976797  4505 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.103417  1535 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:15.089246  1685 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:15.092888  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:14.987125  4474 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:15.087528  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 111563us
W20260709 13:02:15.111011  1505 leader_election.cc:336] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 3.034s (SENT)
I20260709 13:02:15.111507  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:15.123441  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.008823  4448 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:02:15.128635  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.139426  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:14.992190  4559 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.097218  2362 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:15.040401  4391 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 13:02:15.123950  4587 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:15.132778  3960 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:15.160122  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 389067us
I20260709 13:02:15.086920  4440 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:15.205246  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 185215us
W20260709 13:02:15.161980  4510 consensus_meta.cc:287] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.819s	user 0.013s	sys 0.005s
I20260709 13:02:15.208766  1685 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:15.209792  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 372853us
W20260709 13:02:15.210742  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.160686  4582 log.cc:927] Time spent T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.379s	user 0.002s	sys 0.000s
I20260709 13:02:15.158388  4529 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:15.123167  4390 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.153857  4502 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:02:15.168313  4542 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:15.196995  3960 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.196997  4448 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:15.161674  4567 consensus_queue.cc:1059] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.080s
W20260709 13:02:15.269248  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.278837  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 167825us
I20260709 13:02:15.265216  4509 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:15.283574  4595 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:15.295657  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 69732.7us
I20260709 13:02:15.296710  1504 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:15.226955  4479 consensus_queue.cc:1059] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:02:15.260939  4593 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.271373  3960 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:15.339476  2362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 414) took 1369 ms. Trace:
I20260709 13:02:15.217689  4510 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:15.366870  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.358923  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.388944  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.270444  4599 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.272487  4448 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:15.391681  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.391139  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:15.393853  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:15.357604  4542 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:15.396384  4611 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.396713  4586 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:15.397131  4586 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.396934  4611 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.397483  4586 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:15.399190  4611 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:15.387941  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 91362.9us
I20260709 13:02:15.340960  4390 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:15.345400  4425 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:15.401273  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:15.277025  4529 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.128s
I20260709 13:02:15.384689  2362 rpcz_store.cc:276] 0709 13:02:13.970631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:13.974507 (+  3876us) service_pool.cc:224] Handling call
0709 13:02:13.977828 (+  3321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.164544 (+1186716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.339096 (+174552us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54004dd5d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:15.339387 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422999296}
W20260709 13:02:15.356962  4560 consensus_meta.cc:287] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.002s
W20260709 13:02:15.412503  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 127139us
W20260709 13:02:15.354167  4580 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
W20260709 13:02:15.339334  4590 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:02:15.310376  4485 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:15.419322  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:15.420683  4546 consensus_meta.cc:287] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.008s
I20260709 13:02:15.445511  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:15.421306  4591 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:15.421277  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:15.447508  1690 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
W20260709 13:02:15.425422  4561 consensus_meta.cc:287] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.708s	user 0.015s	sys 0.001s
I20260709 13:02:15.331831  4440 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:15.352284  4449 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:15.431793  1687 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:15.433135  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:15.317756  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:15.452395  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:15.452528  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 134873us
W20260709 13:02:15.389585  4125 consensus_meta.cc:287] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.011s
I20260709 13:02:15.343957  4474 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:15.354583  4562 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:15.443634  1681 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:15.395875  4542 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:15.276304  4592 consensus_queue.cc:1059] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.201s
I20260709 13:02:15.452677  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:15.344858  4505 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:15.454497  1616 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:15.454485  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:15.353399  4559 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:15.457160  1688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.018s	sys 0.042s
W20260709 13:02:15.518877  1688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.018s	sys 0.042s
I20260709 13:02:15.457788  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:15.432358  4495 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:15.449949  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:15.318610  4493 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.122s
I20260709 13:02:15.432196  4554 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:15.469250  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:15.480921  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:15.483481  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:15.486966  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:15.509984  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.526746  1609 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:15.318356  4605 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 13:02:15.529970  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:15.453250  4453 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.137s
I20260709 13:02:15.436368  4560 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.388684  4593 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.455746  4546 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.564082  1683 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:16.124600  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 366) took 1346 ms. Trace:
I20260709 13:02:15.459395  4390 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:16.125264  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:15.540622  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.126431  1611 raft_consensus.cc:2410] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:02:15.580257  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 126330us
I20260709 13:02:16.127858  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:16.128576  4493 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.456621  4561 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:16.129101  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:15.527096  4495 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:16.129190  4493 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.606178  4573 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:16.130800  4495 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:16.131356  4561 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:15.600065  4608 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:15.560412  4580 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:02:15.576737  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:16.132154  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:16.109078  4602 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.012s
W20260709 13:02:16.132642  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.460439  4587 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:16.133073  1689 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:16.132498  4493 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:16.134232  4546 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:16.052748  4619 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:16.060889  4510 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:16.045141  4618 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:16.135311  4593 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:15.531795  1505 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.875s (SENT)
W20260709 13:02:16.032227  1504 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.002s	sys 0.007s
I20260709 13:02:16.135332  1690 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:15.604298  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:15.604533  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:16.109830  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:16.137799  1610 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:16.128944  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:16.130270  1609 raft_consensus.cc:2410] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:16.138182  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:16.814812  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.018s	sys 0.046s
W20260709 13:02:16.882539  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.019s	sys 0.051s
I20260709 13:02:16.882684  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1595) took 1398 ms. Trace:
W20260709 13:02:15.972847  4579 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:02:16.885929  4573 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:16.146147  4581 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:16.886540  4573 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.125341  4390 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:16.145431  4613 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.887799  4390 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:16.809906  1685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.225s	user 0.001s	sys 0.019s
W20260709 13:02:16.888871  1685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.304s	user 0.002s	sys 0.020s
W20260709 13:02:16.889470  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.888460  4581 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:16.890334  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1591) took 1407 ms. Trace:
I20260709 13:02:15.786434  4596 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 1.430s
I20260709 13:02:16.890847  1609 rpcz_store.cc:276] 0709 13:02:15.483319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.128872 (+645553us) service_pool.cc:224] Handling call
0709 13:02:16.890269 (+761397us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:15.559734  3960 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:16.901669  3960 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:16.890640  4581 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:16.892140  1610 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1596) took 1407 ms (client timeout 1569 ms). Trace:
W20260709 13:02:16.638059  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.913326  4581 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:16.913396  1610 rpcz_store.cc:269] 0709 13:02:15.484893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.529587 (+ 44694us) service_pool.cc:224] Handling call
0709 13:02:16.892028 (+1362441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.155103  4554 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:16.892531  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1588) took 1415 ms (client timeout 1680 ms). Trace:
W20260709 13:02:16.933352  1613 rpcz_store.cc:269] 0709 13:02:15.476641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.478592 (+  1951us) service_pool.cc:224] Handling call
0709 13:02:16.892443 (+1413851us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:16.888994  4587 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:16.888062  4602 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.007s	sys 0.038s
I20260709 13:02:16.936810  4587 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:16.940164  2330 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.230s	user 0.004s	sys 0.011s
I20260709 13:02:16.893844  4619 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:16.941010  2330 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.231s	user 0.005s	sys 0.011s
I20260709 13:02:16.941231  4619 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:16.943701  4619 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:16.175683  2331 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.003s	sys 0.008s
W20260709 13:02:15.561251  4315 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.762s	user 0.014s	sys 0.000s
W20260709 13:02:16.233191  1581 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.012s	sys 0.013s
W20260709 13:02:16.883467  1580 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.541s (SENT) [suppressed 26 similar messages]
I20260709 13:02:16.887253  4573 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:16.962502  4315 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:15.530311  4440 raft_consensus.cc:3055] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:16.125083  1614 rpcz_store.cc:276] 0709 13:02:14.778151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.783290 (+  5139us) service_pool.cc:224] Handling call
0709 13:02:14.783630 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.784406 (+   776us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.784436 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.785099 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.951646 (+166547us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:14.951759 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.951894 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.657575 (+705681us) raft_consensus.cc:1685] finished
0709 13:02:15.657606 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.124530 (+466924us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3075,"raft.queue_time_us":5441,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":29611,"thread_start_us":103255,"threads_started":1,"wal-append.queue_time_us":323323,"wal-append.run_cpu_time_us":4287,"wal-append.run_wall_time_us":1631327}
I20260709 13:02:16.963786  1684 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:16.962507  1581 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.021s	sys 0.025s
I20260709 13:02:16.964221  4493 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:16.964672  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.965054  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.965577  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.965732  4315 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:16.964751  4493 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:16.910544  4390 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:16.967929  4390 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:16.884325  4498 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:16.968266  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1787) took 2166 ms. Trace:
I20260709 13:02:16.968748  4498 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:16.968631  1532 rpcz_store.cc:276] 0709 13:02:14.801996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.873041 (+ 71045us) service_pool.cc:224] Handling call
0709 13:02:14.911386 (+ 38345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:15.011115 (+ 99729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.011177 (+    62us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:15.029686 (+ 18509us) log.cc:844] Serialized 52 byte log entry
0709 13:02:16.967587 (+1937901us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b1800336100. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1
0709 13:02:16.967757 (+   170us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:16.967809 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.967881 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:16.967932 (+    51us) raft_consensus.cc:1685] finished
0709 13:02:16.967945 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:16.968201 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57289,"raft.queue_time_us":217329,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":47945,"spinlock_wait_cycles":34943872,"thread_start_us":136883,"threads_started":2,"wal-append.queue_time_us":333093,"wal-append.run_cpu_time_us":2332,"wal-append.run_wall_time_us":1157404}
I20260709 13:02:16.963647  4546 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:16.971215  4546 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:16.971748  4498 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:16.883364  1611 rpcz_store.cc:276] 0709 13:02:15.484589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:16.137910 (+653321us) service_pool.cc:224] Handling call
0709 13:02:16.882583 (+744673us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:16.894902  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.973434  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.973549  4636 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:15.877414  4566 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:16.944095  2367 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:16.974117  4636 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:16.975535  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:16.032507  4567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.005s	sys 0.005s
W20260709 13:02:16.986075  4567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.598s	user 0.008s	sys 0.009s
I20260709 13:02:16.986487  4567 consensus_queue.cc:1243] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:02:15.939910  4551 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:02:16.947420  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:16.651309  4529 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:16.694319  4623 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:16.987739  4560 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:16.987951  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 1.45621e+06us
W20260709 13:02:16.988655  1505 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.997s (SENT)
I20260709 13:02:16.988148  4623 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:16.989557  1505 leader_election.cc:336] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.081s (SENT)
I20260709 13:02:16.989979  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:16.949406  1616 raft_consensus.cc:2376] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5. Re-sending same reply.
I20260709 13:02:16.990893  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1592) took 1507 ms. Trace:
I20260709 13:02:15.577737  4448 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:16.991381  4623 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:16.951469  1504 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.501s	user 0.002s	sys 0.025s
W20260709 13:02:16.992666  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 1.57995e+06us
W20260709 13:02:16.955279  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 845576us
W20260709 13:02:16.150583  4586 consensus_meta.cc:287] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.753s	user 0.012s	sys 0.000s
I20260709 13:02:15.576960  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:17.000480  1607 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1587) took 1524 ms (client timeout 1527 ms). Trace:
W20260709 13:02:15.561890  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 92747.2us
I20260709 13:02:17.001191  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:15.803196  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 401) took 1133 ms. Trace:
W20260709 13:02:17.000885  1607 rpcz_store.cc:269] 0709 13:02:15.476225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.476372 (+   147us) service_pool.cc:224] Handling call
0709 13:02:17.000413 (+1524041us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:17.002735  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:16.963596  4440 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:16.965975  4429 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:16.977455  4636 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:15.561448  4373 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 1.415s
I20260709 13:02:16.976274  4546 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:15.709278  4542 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.015978  4542 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.019541  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.021169  4626 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.023833  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1849) took 2439 ms. Trace:
I20260709 13:02:16.976771  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1858) took 2004 ms. Trace:
W20260709 13:02:16.981191  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.024400  1689 rpcz_store.cc:276] 0709 13:02:14.584922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.585060 (+   138us) service_pool.cc:224] Handling call
0709 13:02:14.622849 (+ 37789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.960109 (+2337260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.023519 (+ 63410us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540015ac54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:17.023745 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3472887168}
I20260709 13:02:17.025358  4587 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.026001  4587 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:16.701885  4572 consensus_meta.cc:287] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.846s	user 0.016s	sys 0.000s
I20260709 13:02:17.028201  4608 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.028362  4572 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.028770  4608 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.029178  4572 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:17.029325  1536 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:02:17.029740  4572 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.031656  4587 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:16.984907  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:16.991257  1616 rpcz_store.cc:276] 0709 13:02:15.483657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.587390 (+103733us) service_pool.cc:224] Handling call
0709 13:02:16.990816 (+1403426us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:16.997802  1505 leader_election.cc:336] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 3.337s (SENT)
W20260709 13:02:17.003980  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:16.962651  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1597) took 1477 ms (client timeout 1635 ms). Trace:
I20260709 13:02:16.979959  4619 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.003068  1688 rpcz_store.cc:276] 0709 13:02:14.669570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.686502 (+ 16932us) service_pool.cc:224] Handling call
0709 13:02:14.689665 (+  3163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.719542 (+ 29877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.719573 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.720006 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.739643 (+ 19637us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b1800351c40. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:02:15.519293 (+779650us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:15.519333 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:15.519406 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:15.802768 (+283362us) raft_consensus.cc:1685] finished
0709 13:02:15.802798 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:15.803107 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36749,"raft.queue_time_us":33755,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":3982,"spinlock_wait_cycles":14229376,"thread_start_us":779460,"threads_started":1,"wal-append.queue_time_us":847245,"wal-append.run_cpu_time_us":2458,"wal-append.run_wall_time_us":1216289}
I20260709 13:02:17.005868  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:16.986654  4510 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:17.008363  1682 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:17.009797  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:17.010561  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:17.011138  4449 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:17.012390  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:17.013208  4400 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.013387  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:17.092404  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:17.014070  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:17.025795  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:16.999814  4593 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:17.009593  4599 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.564s	user 0.015s	sys 0.000s
I20260709 13:02:17.099223  4599 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.032008  4572 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.036451  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:17.038471  1612 rpcz_store.cc:269] 0709 13:02:15.485185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.578771 (+ 93586us) service_pool.cc:224] Handling call
0709 13:02:16.962593 (+1383822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:17.044301  1683 rpcz_store.cc:276] 0709 13:02:14.971874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.972002 (+   128us) service_pool.cc:224] Handling call
0709 13:02:14.972422 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.124920 (+1152498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.976529 (+851609us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54002eccd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:16.976708 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1360173312}
I20260709 13:02:16.984462  4573 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.082774  1687 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 5: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:17.001457  4566 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:17.032131  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.034778  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.109897  1540 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.110047  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:17.106514  4572 consensus_queue.cc:1059] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:02:17.036803  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:17.116442  4572 raft_consensus.cc:3055] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:17.116933  4572 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:17.082178  4587 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.082362  4509 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.120726  1540 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
W20260709 13:02:17.100868  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 103116us
I20260709 13:02:17.101270  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:17.123173  1682 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:16.888075  4613 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.103231  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:16.968621  4493 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:16.933466  4554 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.046469  4581 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.091981  4546 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.091753  4449 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:17.095810  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:16.987752  4529 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.157601  4630 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:17.158677  1688 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:17.002118  4586 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.162851  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 423) took 1700 ms. Trace:
I20260709 13:02:17.163848  4586 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.090719  4636 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.108503  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:17.138628  4509 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.165244  1687 raft_consensus.cc:2393] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:17.164948  4636 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.127607  1681 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.167136  4636 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.117890  4572 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.168758  4572 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:17.129429  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1773) took 2348 ms. Trace:
W20260709 13:02:17.139508  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 256063us
I20260709 13:02:17.116950  4608 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.156168  4449 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.170573  1536 rpcz_store.cc:276] 0709 13:02:14.777513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.777645 (+   132us) service_pool.cc:224] Handling call
0709 13:02:14.828311 (+ 50666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.029759 (+2201448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.125875 (+ 96116us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b5400066b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:17.126129 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5061543680}
I20260709 13:02:17.080680  4619 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.163300  1541 rpcz_store.cc:276] 0709 13:02:15.463165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.528848 (+ 65683us) service_pool.cc:224] Handling call
0709 13:02:15.582275 (+ 53427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.582574 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.582610 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.657104 (+ 74494us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.882990 (+1225886us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:16.883033 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.883110 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.162609 (+279499us) raft_consensus.cc:1685] finished
0709 13:02:17.162630 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.162784 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":757467,"threads_started":1,"wal-append.queue_time_us":1418521}
I20260709 13:02:17.181810  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:17.191462  1687 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:17.182578  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:17.186895  1681 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
W20260709 13:02:17.184613  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 1.05575e+06us
W20260709 13:02:17.196465  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 102929us
W20260709 13:02:17.188277  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 148503us
I20260709 13:02:17.197939  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:17.194522  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:17.201524  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57062.3us
I20260709 13:02:17.130968  4593 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:17.197971  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 79794.4us
I20260709 13:02:17.200579  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:17.203737  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.198683  4567 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.130551  4587 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.233456  4567 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.207446  4493 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:17.143703  4581 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.172247  4546 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.229337  4593 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:17.277213  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 68715.2us
W20260709 13:02:17.277103  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 79691.3us
W20260709 13:02:17.281275  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 45268.5us
I20260709 13:02:17.289306  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:17.290825  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.248426  4619 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:17.287205  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 112892us
I20260709 13:02:17.293255  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.236829  4493 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:17.302305  4644 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.304855  4636 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.305486  4650 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.306361  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.307142  4603 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:17.310889  1689 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.311553  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:17.312155  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.315199  1580 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.916s (SENT)
W20260709 13:02:17.318620  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.319655  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.291025  4593 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:17.323489  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:17.362936  1537 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:17.363303  1615 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.364004  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.364394  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:17.344054  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 137020us
I20260709 13:02:17.340899  1538 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:17.364948  1539 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.358572  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:17.347884  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.340905  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.371358  1533 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
W20260709 13:02:17.373150  1654 connection.cc:256] RPC call timeout handler was delayed by -1.1598099889999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:02:17.374019  1654 connection.cc:256] RPC call timeout handler was delayed by -1.1508099889999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:02:17.374733  1654 connection.cc:256] RPC call timeout handler was delayed by -1.1301099890000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:02:17.375181  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0122099889999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
I20260709 13:02:17.300343  4608 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:17.309964  4561 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:17.394167  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.398685  1616 raft_consensus.cc:3055] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:17.399215  1616 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:17.400378  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.402323  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:17.407229  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:17.409649  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:17.372566  1541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
W20260709 13:02:17.417484  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 102340us
I20260709 13:02:17.419062  1615 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:17.411911  1539 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:17.415305  1689 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:17.422040  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.418285  1541 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:17.423210  1539 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.423295  1541 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:17.427656  1613 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:17.413174  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:17.335898  4586 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:17.431918  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.432394  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:17.432600  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 113071us
I20260709 13:02:17.377220  4373 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:17.434119  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.440459  1505 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.443573  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:17.444139  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.434476  1539 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:17.377930  4623 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:17.449635  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.450610  1539 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:17.452019  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.452834  1539 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:02:17.453940  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 164695us
I20260709 13:02:17.406366  4557 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:17.462698  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.462636  1504 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:17.408802  4561 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:17.427150  4390 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:17.433372  1616 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.415607  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:17.465492  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:17.367291  4650 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.437728  4315 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.456341  4593 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.335584  4644 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:17.476238  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.499402  1612 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:17.479977  1539 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:17.544291  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:17.544550  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.499804  1610 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:17.461302  4632 log.cc:927] Time spent T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:02:17.463119  4636 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.502068  4594 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
W20260709 13:02:17.545514  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 82872.7us
I20260709 13:02:17.502609  4639 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.545632  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:17.503153  4574 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:02:17.546988  4639 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.547689  1612 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:17.503476  4510 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:17.416417  4498 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:02:17.549494  4639 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:17.504333  4653 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.545395  1539 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.502696  4581 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.550580  4581 consensus_queue.cc:1059] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:17.546293  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:17.551084  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.461476  4645 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:17.551952  1610 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:17.553496  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.550592  1612 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:02:17.456779  4573 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:17.462786  4566 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:02:17.565734  4572 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.501048  4586 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.471143  4560 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.549645  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1789) took 2717 ms. Trace:
I20260709 13:02:17.566632  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:17.564117  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 185505us
I20260709 13:02:17.499356  4390 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:17.578750  1616 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.456552  4373 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.587352  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:17.581647  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 138492us
I20260709 13:02:17.536937  4559 raft_consensus.cc:3055] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:17.589767  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.582305  1539 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:17.591876  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 187345us
I20260709 13:02:17.489703  1541 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.575646  4613 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.539740  4554 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.471829  4623 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.618445  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.585115  4594 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.637653  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 416) took 2242 ms. Trace:
I20260709 13:02:17.681923  1685 rpcz_store.cc:276] 0709 13:02:15.395709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.405238 (+  9529us) service_pool.cc:224] Handling call
0709 13:02:15.405762 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:15.420481 (+ 14719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:15.420517 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:15.450771 (+ 30254us) log.cc:844] Serialized 26 byte log entry
0709 13:02:16.889867 (+1439096us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:16.889935 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:16.890046 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.637378 (+747332us) raft_consensus.cc:1685] finished
0709 13:02:17.637404 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.637571 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8558,"raft.queue_time_us":8712,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":1305265,"threads_started":1,"wal-append.queue_time_us":1615238}
I20260709 13:02:17.646898  1541 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.616974  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:17.615943  4593 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.589882  4390 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:17.690994  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 74141.2us
I20260709 13:02:17.550359  4653 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.586251  1534 rpcz_store.cc:276] 0709 13:02:14.832245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.882974 (+ 50729us) service_pool.cc:224] Handling call
0709 13:02:14.883368 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:14.986102 (+102734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.986130 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:15.003142 (+ 17012us) log.cc:844] Serialized 52 byte log entry
0709 13:02:17.128549 (+2125407us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b180035f2c0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1
0709 13:02:17.128713 (+   164us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:17.287771 (+159058us) log.cc:844] Serialized 14 byte log entry
0709 13:02:17.549137 (+261366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:17.549240 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.549292 (+    52us) raft_consensus.cc:1685] finished
0709 13:02:17.549403 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.549571 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":235140,"prepare.queue_time_us":192723,"prepare.run_cpu_time_us":1378,"prepare.run_wall_time_us":16754,"raft.queue_time_us":220103,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":8011,"spinlock_wait_cycles":13576064,"thread_start_us":487164,"threads_started":4,"wal-append.queue_time_us":371179,"wal-append.run_cpu_time_us":2324,"wal-append.run_wall_time_us":1002329}
I20260709 13:02:17.507841  4493 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.594044  4572 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:17.594214  4559 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:17.615043  4608 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:17.734334  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 271813us
I20260709 13:02:17.633055  4566 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:17.613626  4449 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.697096  4546 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:17.710992  4560 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:17.756661  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.758315  2364 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:17.696795  4587 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.760671  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.772718  1534 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:17.761224  4449 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.579260  4645 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.735255  4613 raft_consensus.cc:3055] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:17.762719  4125 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:17.764189  4640 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:02:17.764467  4655 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:02:17.765055  4653 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:17.765957  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.768205  1532 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:17.794209  1541 raft_consensus.cc:2368] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 6.
I20260709 13:02:17.769297  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:17.641541  4573 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:02:17.775027  1538 raft_consensus.cc:2410] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:17.796286  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.797066  1538 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:17.798053  4645 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:17.800022  4636 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.782763  4572 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:17.800968  4650 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:17.802665  4584 log.cc:927] Time spent T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 2.811s	user 0.007s	sys 0.019s
I20260709 13:02:17.746019  1616 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:02:17.785589  4613 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:17.788700  4644 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:17.682147  4561 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:17.798148  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.778914  4567 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:17.803251  1616 pending_rounds.cc:85] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 1
I20260709 13:02:17.762769  4623 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:17.803972  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:17.170982  4400 consensus_queue.cc:1175] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e8eefefed88a4903b423e9f487c4805a" responder_term: 4 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:17.774698  4315 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:02:17.804824  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.899741  1534 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.886631  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:17.901957  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:17.902551  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.789438  4640 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:17.904232  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 287425us
I20260709 13:02:17.908406  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:17.910415  1616 pending_rounds.cc:107] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:02:17.914531  1616 raft_consensus.cc:2889] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.915472  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 404) took 3227 ms. Trace:
I20260709 13:02:17.916507  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.915843  1686 rpcz_store.cc:276] 0709 13:02:14.687618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.688749 (+  1131us) service_pool.cc:224] Handling call
0709 13:02:14.689046 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:14.718336 (+ 29290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:14.718372 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:14.718924 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:02:14.737563 (+ 18639us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b48001a01d8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd033a31aa1 00007fd033a28b37 00007fd033a289ca 00007fd033b2026f 00007fd033b1ff37 00007fd033b3455c 00007fd033b34508 00007fd033b34488 00007fd033b34443 00007fd033b336ec 00007fd032a5da96
0709 13:02:14.784411 (+ 46848us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:14.784453 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:14.784517 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:17.801264 (+3016747us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:17.915236 (+113972us) raft_consensus.cc:1685] finished
0709 13:02:17.915262 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:17.915397 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49494,"raft.queue_time_us":31270,"raft.run_cpu_time_us":2123,"raft.run_wall_time_us":13279,"spinlock_wait_cycles":18505216,"thread_start_us":61843,"threads_started":1,"wal-append.queue_time_us":153696}
I20260709 13:02:17.918064  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.893280  1532 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:17.837675  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.918859  1538 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:17.915051  1616 pending_rounds.cc:107] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:02:17.922425  1616 raft_consensus.cc:2889] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:17.792588  4560 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:17.929251  4391 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:02:17.929036  4560 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:17.930649  4495 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:17.931228  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.918092  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:17.936214  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:17.937418  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.821348  4125 consensus_queue.cc:1243] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:17.803221  4557 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:17.924146  4373 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:17.964833  4660 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:02:17.922032  4566 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:17.969974  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:17.986375  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:17.988735  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:17.989509  1540 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:17.994694  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:17.995132  1538 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:17.995544  1580 connection.cc:256] RPC call timeout handler was delayed by -1.0180465159999699s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 13:02:18.001488  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:18.006136  1538 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:17.966768  4125 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:17.861477  4559 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.018993  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.020162  1538 raft_consensus.cc:2368] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8.
I20260709 13:02:18.025122  1541 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:18.022969  4564 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:17.967739  4613 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.038650  4586 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.043310  4559 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.020072  4644 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:18.048908  4644 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:18.035888  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:18.061255  4644 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:18.061334  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:18.065232  1536 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:18.066743  1534 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:18.075754  4390 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.058624  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.067857  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.081617  1536 raft_consensus.cc:2410] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:18.077028  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.086216  1615 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:18.067857  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:18.090732  1534 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.016664  4567 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.102144  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.097425  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.100656  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:18.104574  1616 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
W20260709 13:02:18.112424  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 76167.1us
I20260709 13:02:18.112697  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:18.113651  2329 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:18.114681  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.115455  1536 raft_consensus.cc:2410] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:02:18.112071  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 341971us
I20260709 13:02:18.127003  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:18.113986  4592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.017s
I20260709 13:02:18.130313  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:18.022601  4125 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.132675  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:18.133863  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:18.133656  1610 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.011s
I20260709 13:02:18.008587  4640 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:18.134845  1610 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.011s	sys 0.012s
I20260709 13:02:18.135003  1538 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:18.007678  1540 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:18.143088  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.143961  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.149304  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.149622  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1851) took 3441 ms. Trace:
I20260709 13:02:18.150326  1540 raft_consensus.cc:2410] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:02:18.147811  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:18.150134  1684 rpcz_store.cc:276] 0709 13:02:14.707930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.708206 (+   276us) service_pool.cc:224] Handling call
0709 13:02:14.708488 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.964225 (+2255737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.149369 (+1185144us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54002ebdd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:18.149560 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5186715392}
I20260709 13:02:18.124979  4363 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:18.128731  4373 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:18.159709  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.154449  1654 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:18.134250  4479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.013s	sys 0.033s
I20260709 13:02:18.163719  1538 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:18.138131  1535 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:18.150031  1536 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:18.164613  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:18.132709  4592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.005s	sys 0.017s
I20260709 13:02:18.162525  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.135783  4498 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:18.112321  4567 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.146216  4639 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:18.175326  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.167181  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.147120  4546 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.176237  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.181557  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:18.132285  4623 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:02:18.184718  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:18.158963  4547 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:18.188628  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:18.189263  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:18.185353  1534 raft_consensus.cc:2410] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:18.165407  4640 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.197292  1536 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:18.163599  4479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.014s	sys 0.033s
I20260709 13:02:18.197325  1535 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 6. Ops: []
I20260709 13:02:18.168084  4498 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.166214  4363 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:18.213335  1535 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 7. Ops: []
I20260709 13:02:18.211266  1538 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.215087  1538 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:18.215409  1535 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:18.159731  4573 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:02:18.181185  4546 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:18.224419  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.196060  4315 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.198032  4639 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:18.231807  2371 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:02:18.232873  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:18.213079  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:18.213299  4498 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.195350  4547 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.243695  4363 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:18.249809  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.252352  1608 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:18.166733  4373 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:18.226065  1538 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:02:18.266433  1536 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:18.292332  1540 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:18.222679  4623 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:18.221544  4546 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.302119  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.303840  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.301898  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.309718  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.259884  4495 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.312402  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.313102  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.212730  4644 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 13:02:18.309966  1538 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:02:18.311175  1684 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:18.315110  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.291148  4547 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.293520  4630 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.323807  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:18.328994  1616 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.330766  1538 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:18.332535  1538 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:18.341614  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.344372  1681 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:18.328388  4493 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.062s	sys 0.066s
W20260709 13:02:18.389868  4493 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.062s	sys 0.066s
W20260709 13:02:18.343482  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 89152.8us
W20260709 13:02:18.350589  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.369916  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.392457  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.305051  4623 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:18.396423  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:18.397189  1610 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:18.423527  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.426256  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.426760  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.341801  4390 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:18.439829  1616 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:18.443992  1538 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:02:18.325067  4495 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.445758  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.453289  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.437657  1610 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:18.457629  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 303261us
I20260709 13:02:18.453948  1683 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:18.458643  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:18.341121  4630 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.465271  1654 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:18.465997  1538 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 13:02:18.451882  4685 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:02:18.473322  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:18.475630  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.475713  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:18.459528  4628 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.576s	user 0.000s	sys 0.007s
I20260709 13:02:18.479818  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:18.481849  1683 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:18.482151  1683 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:18.482048  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:18.479069  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.485833  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:18.487238  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:18.483023  1683 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.489334  1683 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.473760  4573 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.473165  4623 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.499109  4623 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.484669  4589 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:18.508292  4567 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:18.491348  4493 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:18.509380  4493 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:18.509892  4493 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.471419  4592 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:18.522249  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:18.484532  4479 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:18.532218  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:18.449271  4639 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.496984  4645 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.479610  4390 consensus_queue.cc:1059] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:02:18.514923  4574 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:18.525857  4589 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:18.522967  4592 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:18.528051  4559 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:18.513983  4315 consensus_queue.cc:1175] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c98c328741aa493d87abafbf08f04944" responder_term: 7 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:18.562983  4592 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.572928  4373 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:18.574128  4690 log.cc:927] Time spent T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:02:18.578456  4546 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.580770  4495 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:18.580967  4683 log.cc:927] Time spent T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:02:18.585048  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1828) took 1117 ms. Trace:
I20260709 13:02:18.585210  4557 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:18.586787  4689 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:02:18.542045  4560 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:18.600410  4560 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:18.600899  4560 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:18.592887  4498 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.595897  1612 rpcz_store.cc:276] 0709 13:02:17.467612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.568854 (+101242us) service_pool.cc:224] Handling call
0709 13:02:17.569229 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:17.666802 (+ 97573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:17.666853 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:17.667508 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.078305 (+410797us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.078350 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.078423 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:18.584837 (+506414us) raft_consensus.cc:1685] finished
0709 13:02:18.584856 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.584988 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":192883,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":493201,"threads_started":2,"wal-append.queue_time_us":540752}
I20260709 13:02:18.545416  4479 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:18.612891  1683 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:18.618180  1612 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:18.618680  1612 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:18.603519  4557 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:18.543521  4645 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:18.641836  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.642959  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.643416  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.675019  1612 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:18.685137  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 151046us
I20260709 13:02:18.685931  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:18.688189  1612 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:18.690718  1654 leader_election.cc:400] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8.
I20260709 13:02:18.691048  1654 leader_election.cc:403] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:18.691885  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:18.693218  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:18.674135  4373 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:18.676573  4677 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:18.711191  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.730015  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:18.730803  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 194535us
W20260709 13:02:18.739964  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46862.7us
I20260709 13:02:18.741176  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:18.746181  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:18.724865  4677 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:18.684993  4589 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.690321  4694 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:02:18.712188  4479 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.811484  1683 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:18.863958  1612 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:18.884824  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.918406  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1833) took 1324 ms. Trace:
I20260709 13:02:18.783390  1541 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:02:18.765087  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.862052  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1830) took 1323 ms. Trace:
I20260709 13:02:18.784130  1688 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:18.907378  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.918805  1612 rpcz_store.cc:276] 0709 13:02:17.594407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.608671 (+1014264us) service_pool.cc:224] Handling call
0709 13:02:18.618058 (+  9387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.918100 (+300042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.918342 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:18.849879  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.921738  1616 rpcz_store.cc:276] 0709 13:02:17.538637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.447389 (+908752us) service_pool.cc:224] Handling call
0709 13:02:18.447702 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.447904 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:18.646544 (+198640us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.861635 (+215091us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.861702 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.861747 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.861816 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.861969 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":239508,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":526,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":14333,"thread_start_us":404810,"threads_started":2}
W20260709 13:02:18.901608  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:18.756747  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:18.922147  1541 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 8. Ops: [4.3-6.4]
W20260709 13:02:18.925813  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 169146us
I20260709 13:02:18.804244  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1831) took 1263 ms. Trace:
I20260709 13:02:18.927002  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:18.929829  1541 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:02:18.931325  1541 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:02:18.751817  4448 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.719668  4547 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.837314  4642 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.957507  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:18.957962  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1865) took 3523 ms. Trace:
W20260709 13:02:18.788000  4640 consensus_meta.cc:287] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.000s
I20260709 13:02:18.783064  4707 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:18.780694  4645 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:18.789354  4509 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:18.926813  1610 rpcz_store.cc:276] 0709 13:02:17.541394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.456452 (+915058us) service_pool.cc:224] Handling call
0709 13:02:18.457013 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:18.457343 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:18.692052 (+234709us) log.cc:844] Serialized 14 byte log entry
0709 13:02:18.803607 (+111555us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:18.803707 (+   100us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:18.803788 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.803898 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:18.804134 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":254169,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":156,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":11440,"thread_start_us":290010,"threads_started":2,"wal-append.queue_time_us":220779}
I20260709 13:02:18.957316  4701 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.975714  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:18.912555  4662 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:18.787006  4315 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:18.747925  4591 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.007s	sys 0.006s
W20260709 13:02:18.868791  4699 log.cc:927] Time spent T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:02:18.830439  4639 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8.
I20260709 13:02:18.757827  4546 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:18.922435  4559 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:18.967442  1690 rpcz_store.cc:276] 0709 13:02:15.434245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:15.461623 (+ 27378us) service_pool.cc:224] Handling call
0709 13:02:15.461950 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:16.887063 (+1425113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.957704 (+2070641us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540015bb54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:18.957898 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548202752}
I20260709 13:02:18.977973  4662 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:18.752434  2366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:18.772773  4720 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:18.945447  4653 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:18.863629  4630 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:18.999019  4662 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:18.745280  4574 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:18.932428  4644 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:18.907172  4498 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:18.835630  4493 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:18.972152  4391 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:02:18.978825  4702 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:18.996464  4707 raft_consensus.cc:697] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:18.972206  4642 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:18.971930  4710 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:02:18.989554  4715 log.cc:927] Time spent T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:02:18.781263  4573 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:18.991740  4591 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.007s	sys 0.008s
I20260709 13:02:18.980409  4701 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:18.979156  4716 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:02:19.003391  4653 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:19.019061  4573 raft_consensus.cc:697] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:19.019520  4653 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.008862  4720 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:19.009701  4592 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.063382  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1815) took 1141 ms. Trace:
I20260709 13:02:19.104858  4574 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.104688  1540 rpcz_store.cc:276] 0709 13:02:17.921507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.316006 (+394499us) service_pool.cc:224] Handling call
0709 13:02:18.396224 (+ 80218us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.396603 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.396630 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.397049 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.816389 (+419340us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.816451 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.816544 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.062216 (+245672us) raft_consensus.cc:1685] finished
0709 13:02:19.062315 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.062953 (+   638us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":930,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":30707,"thread_start_us":360361,"threads_started":1,"wal-append.queue_time_us":468441}
I20260709 13:02:18.967965  1541 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:18.976816  1610 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:18.981180  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:19.113088  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1759) took 1077 ms. Trace:
I20260709 13:02:19.113797  1541 rpcz_store.cc:276] 0709 13:02:18.035358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.966964 (+931606us) service_pool.cc:224] Handling call
0709 13:02:18.967730 (+   766us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.112077 (+144347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.112752 (+   675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.114909  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.972815  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:18.975191  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.997102  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:19.120922  1688 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:19.122903  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:18.976318  1686 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:19.081234  2371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:19.124794  1616 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:19.085602  4391 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:02:19.092826  4493 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:19.093214  4557 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.016458  4559 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.028402  4642 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:19.020181  4677 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.027585  4701 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:19.012578  4702 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.030858  4707 consensus_queue.cc:237] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.026772  4720 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:19.143725  4560 consensus_meta.cc:287] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.542s	user 0.012s	sys 0.005s
I20260709 13:02:19.145117  4560 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.020144  4573 consensus_queue.cc:237] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.101284  4547 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:19.150043  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1835) took 1482 ms. Trace:
I20260709 13:02:19.150729  4702 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.152647  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 440) took 1039 ms. Trace:
W20260709 13:02:19.103900  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.106913  4592 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:19.122720  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:19.128572  1687 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 4. Current term is 5. Ops: []
W20260709 13:02:19.128999  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.129789  1540 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:19.129732  4640 raft_consensus.cc:3055] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:19.130264  4557 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:19.159873  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.153568  1541 rpcz_store.cc:276] 0709 13:02:18.113685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.115210 (+1001525us) service_pool.cc:224] Handling call
0709 13:02:19.151666 (+ 36456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.152144 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.152178 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.152257 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.152297 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.152361 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.152518 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.169577  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1762) took 1133 ms. Trace:
I20260709 13:02:19.170111  1540 rpcz_store.cc:276] 0709 13:02:18.078210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.116544 (+1038334us) service_pool.cc:224] Handling call
0709 13:02:19.129280 (+ 12736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.169279 (+ 39999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.169519 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.150799  1612 rpcz_store.cc:276] 0709 13:02:17.667975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.127748 (+1459773us) service_pool.cc:224] Handling call
0709 13:02:19.148733 (+ 20985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.149296 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.149352 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.149512 (+   160us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:19.149623 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.149706 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.149881 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.146359  1537 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:19.181174  1688 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
W20260709 13:02:19.191901  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.198642  1682 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:19.209935  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.165665  4640 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:19.210858  1690 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:19.316792  1579 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:19.288728  2364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46612 (request call id 209) took 2276 ms. Trace:
I20260709 13:02:19.229523  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1822) took 1107 ms. Trace:
I20260709 13:02:19.237577  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:19.331018  4125 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:19.331537  1688 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:19.291392  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:19.252117  1610 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:19.324328  2364 rpcz_store.cc:276] 0709 13:02:17.011655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.012109 (+   454us) service_pool.cc:224] Handling call
0709 13:02:17.012481 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:17.773380 (+760899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.287958 (+1514578us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54001a5c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:19.288388 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715002496}
I20260709 13:02:19.290019  4315 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.287098  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:19.258936  1689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35722 (request call id 421) took 2240 ms (client timeout 1587 ms). Trace:
I20260709 13:02:19.347220  2365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 423) took 1128 ms. Trace:
I20260709 13:02:19.348731  2365 rpcz_store.cc:276] 0709 13:02:18.218552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.290733 (+1072181us) service_pool.cc:224] Handling call
0709 13:02:19.347131 (+ 56398us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.341177  4529 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:19.348129  1689 rpcz_store.cc:269] 0709 13:02:17.018541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.025490 (+  6949us) service_pool.cc:224] Handling call
0709 13:02:19.258388 (+2232898us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400118ad4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:19.258629 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499281664}
I20260709 13:02:19.359504  4560 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.359833  4448 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:19.360718  4448 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.361196  4448 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:19.340617  4440 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.359861  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:19.378662  4662 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.380759  1612 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:19.325934  1541 rpcz_store.cc:276] 0709 13:02:18.122470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.202234 (+1079764us) service_pool.cc:224] Handling call
0709 13:02:19.208898 (+  6664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.209394 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:19.209943 (+   549us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.228624 (+ 18681us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.229038 (+   414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.229100 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:19.229164 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.229268 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.229445 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108251,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":350,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":392,"thread_start_us":16965,"threads_started":1}
W20260709 13:02:19.389528  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.389081  1684 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:19.386610  1683 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:19.388078  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1839) took 1609 ms. Trace:
I20260709 13:02:19.397657  1612 rpcz_store.cc:276] 0709 13:02:17.772752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.242843 (+1470091us) service_pool.cc:224] Handling call
0709 13:02:19.365928 (+123085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.381351 (+ 15423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.381645 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.409554  4662 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:19.411644  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.411058  4640 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:19.400189  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 46042.3us
I20260709 13:02:19.412956  4640 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.403071  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1836) took 1728 ms. Trace:
I20260709 13:02:19.414769  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:19.413779  1616 rpcz_store.cc:276] 0709 13:02:17.672137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.125848 (+1453711us) service_pool.cc:224] Handling call
0709 13:02:19.126658 (+   810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.130636 (+  3978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.130671 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.131582 (+   911us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.318476 (+186894us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.318532 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.325209 (+  6677us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.398956 (+ 73747us) raft_consensus.cc:1685] finished
0709 13:02:19.398980 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.400400 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2939,"raft.queue_time_us":7614,"raft.run_cpu_time_us":379,"raft.run_wall_time_us":380,"thread_start_us":91850,"threads_started":1,"wal-append.queue_time_us":244747}
I20260709 13:02:19.416335  4567 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:19.416718  4567 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.417064  4567 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:19.414511  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.418068  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.418402  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.418844  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.419144  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.419574  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.427187  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:19.429852  4724 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
I20260709 13:02:19.428184  4440 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.432637  4557 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:19.434152  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.433789  4557 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.439095  4557 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.439215  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:19.440164  1609 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:19.447386  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.452122  4619 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.452993  4619 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.455688  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:19.457769  4678 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.458061  4629 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:19.459216  1608 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1817) took 4722 ms (client timeout 1972 ms). Trace:
W20260709 13:02:19.459712  1608 rpcz_store.cc:269] 0709 13:02:14.737043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:14.737943 (+   900us) service_pool.cc:224] Handling call
0709 13:02:19.458737 (+4720794us) spinlock_profiling.cc:243] Waited 3.49 s on lock 0x7b540035fa54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:19.458953 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8036179328}
I20260709 13:02:19.459347  4629 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.462546  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 379) took 1523 ms. Trace:
I20260709 13:02:19.435499  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 378) took 1484 ms. Trace:
I20260709 13:02:19.464449  1616 rpcz_store.cc:276] 0709 13:02:17.938943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.416715 (+1477772us) service_pool.cc:224] Handling call
0709 13:02:19.422907 (+  6192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.423283 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.423320 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.423391 (+    71us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:19.423420 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.423465 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.423565 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.465371  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1847) took 1601 ms. Trace:
I20260709 13:02:19.458797  4678 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.468520  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 380) took 1528 ms. Trace:
I20260709 13:02:19.463002  1608 rpcz_store.cc:276] 0709 13:02:17.939212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.461153 (+1521941us) service_pool.cc:224] Handling call
0709 13:02:19.461703 (+   550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.462142 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.462172 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.462241 (+    69us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:19.462275 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.462335 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.462459 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.473070  4567 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:19.475263  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.478472  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.477558  1611 rpcz_store.cc:276] 0709 13:02:17.939453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.466452 (+1526999us) service_pool.cc:224] Handling call
0709 13:02:19.466969 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.467471 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.467496 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.467569 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.467646 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.467713 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.467871 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.480960  4629 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:19.475978  1613 rpcz_store.cc:276] 0709 13:02:17.823137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.238815 (+1415678us) service_pool.cc:224] Handling call
0709 13:02:19.239312 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.239935 (+   623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.239966 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.241261 (+  1295us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.367359 (+126098us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.399133 (+ 31774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.399228 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.424227 (+ 24999us) raft_consensus.cc:1685] finished
0709 13:02:19.424245 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.424369 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":193,"thread_start_us":47303,"threads_started":1,"wal-append.queue_time_us":159356}
I20260709 13:02:19.502720  4581 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:19.502884  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50014.1us
I20260709 13:02:19.503784  4581 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.505251  4574 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:19.507788  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1821) took 1376 ms. Trace:
I20260709 13:02:19.509367  1540 rpcz_store.cc:276] 0709 13:02:18.121685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.189881 (+1068196us) service_pool.cc:224] Handling call
0709 13:02:19.309409 (+119528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.340767 (+ 31358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.340808 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.341552 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.494937 (+153385us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.494993 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.495118 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.497458 (+  2340us) raft_consensus.cc:1685] finished
0709 13:02:19.497480 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.497667 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2587,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":1527,"thread_start_us":80257,"threads_started":1,"wal-append.queue_time_us":114188}
I20260709 13:02:19.515103  4581 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:19.516150  1613 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:19.518165  1540 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:19.519248  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1766) took 1382 ms. Trace:
I20260709 13:02:19.519711  1540 rpcz_store.cc:276] 0709 13:02:18.138326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.516683 (+1378357us) service_pool.cc:224] Handling call
0709 13:02:19.517472 (+   789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.518870 (+  1398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.519169 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.522521  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 441) took 1300 ms. Trace:
I20260709 13:02:19.489212  4448 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.507057  4702 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:19.506083  4574 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.523322  1540 rpcz_store.cc:276] 0709 13:02:18.222546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.520921 (+1298375us) service_pool.cc:224] Handling call
0709 13:02:19.521564 (+   643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.522008 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.522049 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.522136 (+    87us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.522177 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.522253 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.522422 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.612661  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 442) took 1099 ms. Trace:
I20260709 13:02:19.613122  1540 rpcz_store.cc:276] 0709 13:02:18.513527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.611385 (+1097858us) service_pool.cc:224] Handling call
0709 13:02:19.611975 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.612325 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.612348 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.612387 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.612416 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.612471 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.612607 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.545388  4714 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 13:02:19.559316  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.530376  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 381) took 1275 ms. Trace:
W20260709 13:02:19.607331  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.605805  1613 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:19.620824  1616 rpcz_store.cc:276] 0709 13:02:18.255396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.478829 (+1223433us) service_pool.cc:224] Handling call
0709 13:02:19.501309 (+ 22480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.529499 (+ 28190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.529559 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.529686 (+   127us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:19.529762 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.530065 (+   303us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.530279 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.562953  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:19.615908  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 443) took 1090 ms. Trace:
I20260709 13:02:19.626827  1540 rpcz_store.cc:276] 0709 13:02:18.525276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.614135 (+1088859us) service_pool.cc:224] Handling call
0709 13:02:19.614546 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.614751 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.614774 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.614813 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.615505 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.615640 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.615801 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.571161  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1820) took 1278 ms. Trace:
W20260709 13:02:19.560768  4668 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 13:02:19.634230  1580 leader_election.cc:336] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.541s (SENT)
I20260709 13:02:19.634761  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:19.636088  4567 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.638622  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1823) took 1515 ms. Trace:
I20260709 13:02:19.636617  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:19.559885  4649 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:19.636914  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:19.650542  4557 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.651497  1538 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:02:19.628001  1535 rpcz_store.cc:276] 0709 13:02:18.120959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.141713 (+1020754us) service_pool.cc:224] Handling call
0709 13:02:19.142410 (+   697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.142961 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:19.191940 (+ 48979us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.397232 (+205292us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.397469 (+   237us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.397509 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:19.397583 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.397672 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.398894 (+  1222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36458,"prepare.run_cpu_time_us":163,"prepare.run_wall_time_us":6823,"raft.queue_time_us":42680,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":2257,"thread_start_us":155901,"threads_started":3,"wal-append.queue_time_us":205007}
I20260709 13:02:19.646382  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:19.559919  4529 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:19.650707  1608 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.618881  4653 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.508498  4125 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.134s
I20260709 13:02:19.671531  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:19.658615  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:19.651914  4557 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.693076  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:19.693917  1607 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.694263  4557 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:19.695124  4557 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:19.682420  1613 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:19.653772  4649 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:19.696022  4557 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.637790  4702 consensus_queue.cc:1243] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:02:19.684829  1532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1795) took 2297 ms (client timeout 1592 ms). Trace:
W20260709 13:02:19.685844  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51190.9us
I20260709 13:02:19.687512  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 444) took 1107 ms. Trace:
I20260709 13:02:19.689611  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:19.714390  1690 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:19.714152  1540 rpcz_store.cc:276] 0709 13:02:18.579946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.657341 (+1077395us) service_pool.cc:224] Handling call
0709 13:02:19.686781 (+ 29440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.687128 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.687157 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.687225 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:19.687262 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.687321 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.687449 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.724107  4448 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:19.724488  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 90364.3us
I20260709 13:02:19.725054  4448 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:19.725687  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:19.726260  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.726680  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.727021  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.727427  1580 leader_election.cc:336] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.601s (SENT)
I20260709 13:02:19.727483  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:19.728358  4720 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:02:19.728543  2369 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46602 (request call id 299) took 1570 ms (client timeout 1680 ms). Trace:
W20260709 13:02:19.728950  2369 rpcz_store.cc:269] 0709 13:02:18.157935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.158194 (+   259us) service_pool.cc:224] Handling call
0709 13:02:19.727142 (+1568948us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:19.728482 (+  1340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3643264}
I20260709 13:02:19.729976  4557 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.731514  1608 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:19.731439  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:19.712489  1532 rpcz_store.cc:269] 0709 13:02:17.338832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.339064 (+   232us) service_pool.cc:224] Handling call
0709 13:02:19.636098 (+2297034us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b540014d2d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:19.636297 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":854952704}
W20260709 13:02:19.731428  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.736680  1613 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:19.735214  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:19.726691  2370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46602 (request call id 300) took 1566 ms (client timeout 1562 ms). Trace:
I20260709 13:02:19.751003  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:19.751909  1689 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:19.745194  2370 rpcz_store.cc:269] 0709 13:02:18.160015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.160273 (+   258us) service_pool.cc:224] Handling call
0709 13:02:19.725336 (+1565063us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:19.726588 (+  1252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3994368}
I20260709 13:02:19.747852  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:19.759994  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:19.740868  4125 consensus_queue.cc:1243] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:19.761693  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:19.767748  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 446) took 1151 ms. Trace:
I20260709 13:02:19.731695  4581 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:02:19.776217  2368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46602 (request call id 298) took 1623 ms. Trace:
I20260709 13:02:19.785247  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:19.803828  1532 rpcz_store.cc:276] 0709 13:02:18.616401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.766530 (+1150129us) service_pool.cc:224] Handling call
0709 13:02:19.767029 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.767404 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.767430 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.767491 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:19.767527 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.767583 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.767684 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.744617  4529 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.786751  4662 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:19.786994  4574 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.781770  4653 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.787341  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 445) took 1185 ms. Trace:
I20260709 13:02:19.812532  1535 rpcz_store.cc:276] 0709 13:02:18.580266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.653240 (+1072974us) service_pool.cc:224] Handling call
0709 13:02:19.742004 (+ 88764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.765022 (+ 23018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.765059 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.765120 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:19.765158 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.765225 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.765353 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:19.790048  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.813922  4613 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:19.815129  4529 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:19.752955  4557 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:19.816685  4653 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:19.816514  4557 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.795931  1684 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:19.798907  4453 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:19.817970  1616 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:19.803960  2368 rpcz_store.cc:276] 0709 13:02:18.152589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.152800 (+   211us) service_pool.cc:224] Handling call
0709 13:02:19.731104 (+1578304us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3e9c 00007fd02b9e3a5b 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:19.776138 (+ 45034us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12761984}
I20260709 13:02:19.793169  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1752) took 1759 ms. Trace:
I20260709 13:02:19.817080  1682 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:19.832700  2328 connection.cc:256] RPC call timeout handler was delayed by -1.3349287959999856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 13:02:19.834465  1689 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:19.818559  1538 rpcz_store.cc:276] 0709 13:02:18.033591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.468834 (+435243us) service_pool.cc:224] Handling call
0709 13:02:19.650978 (+1182144us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.652101 (+  1123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.792895 (+140794us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540014d2d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:19.793064 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2646308224}
I20260709 13:02:19.817281  4653 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:19.841985  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 56941.3us
I20260709 13:02:19.840487  4125 consensus_queue.cc:1059] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:02:19.887828  1690 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:19.862916  4373 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:19.859735  4453 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:19.898949  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 171602us
W20260709 13:02:19.903532  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.904688  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.907441  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.909574  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:19.908597  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 117147us
I20260709 13:02:19.893676  4373 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:19.911901  4373 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:19.912165  4453 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:19.914383  1686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1876) took 1614 ms (client timeout 1965 ms). Trace:
W20260709 13:02:19.914849  1686 rpcz_store.cc:269] 0709 13:02:18.299909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.300146 (+   237us) service_pool.cc:224] Handling call
0709 13:02:19.913912 (+1613766us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b540015c554. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:19.914164 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528113408}
W20260709 13:02:19.918113  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.917632  1532 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:19.918668  4650 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:19.919380  4650 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:19.641310  1541 rpcz_store.cc:276] 0709 13:02:18.123240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.424158 (+1300918us) service_pool.cc:224] Handling call
0709 13:02:19.514281 (+ 90123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.514752 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:02:19.515172 (+   420us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.638042 (+122870us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:19.638196 (+   154us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:19.638264 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.638363 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.638536 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2853,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":17733,"thread_start_us":108926,"threads_started":1}
W20260709 13:02:19.930071  1537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1805) took 2550 ms (client timeout 1527 ms). Trace:
W20260709 13:02:19.930543  1537 rpcz_store.cc:269] 0709 13:02:17.379327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.397822 (+ 18495us) service_pool.cc:224] Handling call
0709 13:02:19.145804 (+1747982us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54000701a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7fdc0 00007fd02eb0be18 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:19.929822 (+784018us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54001fb8d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:19.929986 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075901056}
I20260709 13:02:19.931747  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.932319  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.932562  1537 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:19.933079  1541 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:19.933656  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.934083  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.934804  1541 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:02:19.935051  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.935758  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:19.924280  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.919297  1579 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:19.925995  1616 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:19.936474  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.939097  1538 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:19.945036  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.942186  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:19.946990  1686 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:19.948864  1535 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:19.950748  4718 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.936s	user 0.003s	sys 0.000s
I20260709 13:02:19.956094  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1832) took 2376 ms. Trace:
I20260709 13:02:19.956583  4453 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:19.951856  4373 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.958789  4453 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:19.921803  4557 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:19.959862  4373 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:19.944655  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:19.964370  1580 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.608s (SENT)
I20260709 13:02:19.967643  1607 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:19.967747  1682 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:02:19.970798  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.973723  4662 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:19.974397  4662 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:19.974643  4748 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:19.975383  4581 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:19.976008  4581 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:19.976509  4702 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:19.977206  4702 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:19.978171  4653 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.978791  4702 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:19.986711  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:19.981004  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:19.996793  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.001031  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 92007.8us
I20260709 13:02:19.975852  4748 consensus_queue.cc:1243] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:02:19.983322  4681 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.655s	user 0.002s	sys 0.000s
I20260709 13:02:20.003847  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:19.981896  4661 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:20.005399  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.006881  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.007686  1541 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:20.011255  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:19.989104  4453 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:20.012593  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1817) took 1927 ms. Trace:
I20260709 13:02:19.997817  4662 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:20.016450  4693 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.017118  1537 raft_consensus.cc:2410] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:19.956475  1615 rpcz_store.cc:276] 0709 13:02:17.579173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.587413 (+1008240us) service_pool.cc:224] Handling call
0709 13:02:18.602744 (+ 15331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.603113 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.603140 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.614878 (+ 11738us) log.cc:844] Serialized 26 byte log entry
0709 13:02:18.963171 (+348293us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:18.963215 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:18.963378 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.949852 (+986474us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:19.955580 (+  5728us) raft_consensus.cc:1685] finished
0709 13:02:19.955605 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.955857 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8007,"spinlock_wait_cycles":5351296,"thread_start_us":277114,"threads_started":1,"wal-append.queue_time_us":368709}
I20260709 13:02:20.018285  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.017697  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:20.010413  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.022679  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.022727  1533 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:20.029987  4510 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.030376  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.030802  4510 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.031569  1686 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:20.032305  4510 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.033489  4429 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:20.033890  4714 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:20.035290  4709 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:20.035771  4709 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.036214  4702 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:20.035790  4693 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.036386  4672 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:20.037014  4672 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:20.037112  4709 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.038580  4693 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:20.038288  4672 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.035890  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.040588  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.041107  4708 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:20.041613  4693 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:20.041899  4708 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.042696  4693 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.025977  4453 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:20.043946  4693 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.045409  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 1735) took 2375 ms. Trace:
I20260709 13:02:20.045208  4453 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.045889  1534 rpcz_store.cc:276] 0709 13:02:17.669719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.198541 (+528822us) service_pool.cc:224] Handling call
0709 13:02:18.199151 (+   610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:18.215806 (+ 16655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.216719 (+   913us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:18.217238 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.689322 (+1472084us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b180036baa0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:02:19.995219 (+305897us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:20.023380 (+ 28161us) log.cc:844] Serialized 14 byte log entry
0709 13:02:20.027420 (+  4040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.044773 (+ 17353us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.044851 (+    78us) raft_consensus.cc:1685] finished
0709 13:02:20.045005 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.045205 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10739,"prepare.queue_time_us":12364,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":11546,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":13621,"spinlock_wait_cycles":12895488,"thread_start_us":197219,"threads_started":1,"wal-append.queue_time_us":1706209}
I20260709 13:02:20.048067  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:20.009008  4661 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:20.061203  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.066459  1535 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
W20260709 13:02:20.067384  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1822) took 2658 ms (client timeout 1518 ms). Trace:
I20260709 13:02:19.977437  4581 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.038632  4709 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.069725  4649 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.071290  4649 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:20.072207  4557 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.072846  4557 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.075161  4557 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:20.076428  1685 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:20.077163  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.077798  1533 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.077922  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:20.078908  1688 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.081171  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.081984  1690 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:20.083093  1690 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:20.063664  4529 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:02:20.088106  4651 consensus_queue.cc:1059] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:20.089406  4361 raft_consensus.cc:3055] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:20.075765  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.090613  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.092116  4495 raft_consensus.cc:3055] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:20.092535  4495 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:20.093220  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 149789us
I20260709 13:02:20.076251  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.097111  1689 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:20.097963  1688 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:20.098202  4743 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.090865  1687 raft_consensus.cc:2410] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:20.094987  1682 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:20.067194  4661 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:20.108052  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.108347  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:20.067831  1609 rpcz_store.cc:269] 0709 13:02:17.409154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.409320 (+   166us) service_pool.cc:224] Handling call
0709 13:02:20.067165 (+2657845us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b540040a6d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:20.067296 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4371794176}
I20260709 13:02:20.089885  4361 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:20.115485  4661 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.116400  4361 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.117726  4361 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:20.118290  4743 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.120751  4743 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:20.121013  1684 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:20.075783  4557 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:02:20.043243  4708 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.040020  4672 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:20.132306  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 76670.3us
W20260709 13:02:20.136209  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 194175us
I20260709 13:02:20.013834  1536 rpcz_store.cc:276] 0709 13:02:17.937337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.316504 (+379167us) service_pool.cc:224] Handling call
0709 13:02:18.347492 (+ 30988us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:18.347975 (+   483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:18.348016 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:19.445792 (+1097776us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b1800332380. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a
0709 13:02:19.446308 (+   516us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b2c00000f48. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:02:19.447341 (+  1033us) log.cc:844] Serialized 52 byte log entry
0709 13:02:19.565143 (+117802us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:19.647900 (+ 82757us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.859566 (+211666us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.859840 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.859908 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:19.859946 (+    38us) raft_consensus.cc:1685] finished
0709 13:02:19.859955 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:19.864391 (+  4436us) inbound_call.cc:177] Queueing success response
0709 13:02:19.978868 (+114477us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b1800332380. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b522 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
Metrics: {"prepare.queue_time_us":25330,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":12698,"raft.run_cpu_time_us":544,"raft.run_wall_time_us":91813,"spinlock_wait_cycles":29161984,"thread_start_us":320823,"threads_started":2,"wal-append.queue_time_us":211833}
W20260709 13:02:20.137476  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 190055us
W20260709 13:02:20.170521  1580 leader_election.cc:336] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.583s (SENT)
I20260709 13:02:20.139849  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.123833  4448 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.169234  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.104609  4373 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.125705  4557 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:20.227155  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.237658  4743 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.183707  4662 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.246572  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.230074  4315 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:20.258853  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.255961  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.241537  4743 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.233763  4557 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:02:20.263139  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.261658  1534 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:20.261910  1537 raft_consensus.cc:2410] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:20.271426  4453 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:20.272357  4453 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:20.273427  4453 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.276183  4315 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.252511  4581 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.281440  4495 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.282775  4495 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:20.285858  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.287493  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.288479  4631 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:02:20.288857  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.289956  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1856) took 1519 ms. Trace:
I20260709 13:02:20.290323  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.290376  1608 rpcz_store.cc:276] 0709 13:02:18.770953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.746332 (+975379us) service_pool.cc:224] Handling call
0709 13:02:19.761764 (+ 15432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.910667 (+148903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.910706 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.917064 (+  6358us) log.cc:844] Serialized 26 byte log entry
0709 13:02:20.133931 (+216867us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:02:20.133975 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.134061 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.289704 (+155643us) raft_consensus.cc:1685] finished
0709 13:02:20.289726 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.289871 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19397,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":327692,"threads_started":2,"wal-append.queue_time_us":335035}
W20260709 13:02:20.291826  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.295334  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:20.315577  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.228447  4448 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.256608  4662 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.322046  1536 raft_consensus.cc:2376] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8. Re-sending same reply.
I20260709 13:02:20.340853  1537 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
W20260709 13:02:20.341320  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.347632  1533 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:20.351135  4662 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.354296  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1848) took 2452 ms. Trace:
I20260709 13:02:20.361754  1614 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:20.360100  1610 rpcz_store.cc:276] 0709 13:02:17.902183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.402753 (+1500570us) service_pool.cc:224] Handling call
0709 13:02:19.468472 (+ 65719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:19.468865 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:19.500286 (+ 31421us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.743487 (+243201us) log.cc:844] Serialized 14 byte log entry
0709 13:02:19.971782 (+228295us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b180013a6e0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:20.110037 (+138255us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b180013a6e0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287 00007fd02eb23208
0709 13:02:20.353891 (+243854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:20.353953 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:20.354006 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:20.354083 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.354226 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4200,"prepare.queue_time_us":162966,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":4486,"raft.queue_time_us":28683,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":14084,"spinlock_wait_cycles":29182848,"thread_start_us":402938,"threads_started":3,"wal-append.queue_time_us":330789}
W20260709 13:02:20.359901  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 224677us
I20260709 13:02:20.370954  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.372483  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.372829  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.373623  1536 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:20.375157  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.377450  1537 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:20.382128  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:20.382740  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.382579  1580 leader_election.cc:336] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.681s (SENT)
I20260709 13:02:20.383838  1533 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:20.387089  1688 raft_consensus.cc:2376] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8. Re-sending same reply.
I20260709 13:02:20.390539  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.391681  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:20.393601  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.391480  1534 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:20.383900  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.410267  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.391119  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.420641  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.421202  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.421366  1532 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:20.430380  1541 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:20.433702  4564 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:20.434319  4564 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:20.434757  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.408572  4510 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:02:20.436086  4755 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:02:20.436174  4510 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:20.437438  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54908us
W20260709 13:02:20.438191  1580 leader_election.cc:336] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.683s (SENT)
I20260709 13:02:20.438390  4510 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:20.438583  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:20.440403  4474 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.440893  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:20.411630  4315 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:20.439949  1580 leader_election.cc:336] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.713s (SENT)
I20260709 13:02:20.443832  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.444208  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.451473  4448 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:20.455914  1537 raft_consensus.cc:2410] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:20.443876  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.458606  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:20.461627  1532 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:20.466471  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.467271  1541 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:20.435545  4564 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.469153  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:20.457059  4760 log.cc:927] Time spent T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:02:20.474802  4564 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.454596  4708 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:20.476459  4708 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:20.476908  4708 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.472924  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.479671  1536 raft_consensus.cc:2376] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5. Re-sending same reply.
I20260709 13:02:20.480499  1532 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6. Re-sending same reply.
I20260709 13:02:20.481503  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.395686  4557 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.485045  4557 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.489917  4474 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.490711  4743 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:20.493672  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.495009  1541 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:20.500766  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.501773  1537 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 2.
I20260709 13:02:20.504390  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.506847  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.508332  1536 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:20.514884  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:20.517482  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 76762.4us
I20260709 13:02:20.520942  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:20.526548  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.529965  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.527416  1653 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:20.531251  4720 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.532296  4608 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.536173  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.537856  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.538213  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:20.538757  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.539032  2370 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:20.539078  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:20.540333  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.540462  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:20.542447  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.542466  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.545773  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.546828  4315 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:20.547267  4315 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.547590  4315 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.502806  4743 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.548404  4743 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.548650  1579 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.550012  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.550673  4743 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:20.551429  4448 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.529949  4619 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:20.552351  4448 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:20.553771  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.555261  2369 raft_consensus.cc:2410] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:02:20.555781  4448 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.559677  1684 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:20.564360  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.569049  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.572227  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.574340  1533 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:20.506457  4770 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:20.577561  1538 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.001s
I20260709 13:02:20.580502  1538 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:20.582171  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.584209  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.584834  1536 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:20.585575  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:20.585924  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 146038us
I20260709 13:02:20.586174  1532 raft_consensus.cc:2376] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8. Re-sending same reply.
I20260709 13:02:20.587047  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.587051  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.587576  1538 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:20.590101  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:20.590868  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.590826  1533 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.591315  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.594403  1688 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:20.600993  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.601737  1540 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:20.604390  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:20.605553  4709 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.005s
I20260709 13:02:20.605674  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.606773  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.607306  1536 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:20.608462  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:20.616585  1580 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.719s (SENT)
I20260709 13:02:20.617151  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:20.618649  1580 leader_election.cc:336] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.726s (SENT)
I20260709 13:02:20.619102  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.623299  1533 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:20.625243  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.632838  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.642431  1533 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:20.645149  1688 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:20.595882  4770 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.650089  2362 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:02:20.651046  4691 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 2.127s	user 0.005s	sys 0.001s
I20260709 13:02:20.651932  1540 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:20.640621  4564 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:20.603816  4315 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.652972  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.653260  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.653998  1540 raft_consensus.cc:2376] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7. Re-sending same reply.
I20260709 13:02:20.654187  1533 raft_consensus.cc:2410] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:20.654856  4315 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:20.654970  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.655164  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.655992  1533 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:20.656430  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.635736  4453 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.657763  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.658391  4708 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.658717  1533 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:20.660145  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.660336  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.661172  1533 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:20.662328  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.661172  1540 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:20.663971  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.663955  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.665269  1533 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:20.667057  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:20.668145  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.666580  1540 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:20.668638  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.645066  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:20.668639  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 137167us
I20260709 13:02:20.673825  1536 raft_consensus.cc:2368] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
W20260709 13:02:20.675499  1580 leader_election.cc:336] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.764s (SENT)
I20260709 13:02:20.650761  4770 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:20.679028  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:20.680751  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.682682  1541 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:20.686112  1538 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:20.687579  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.692117  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.693120  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.696485  1536 raft_consensus.cc:2368] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:20.699997  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.700902  1537 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:20.702960  1533 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:20.691012  4668 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.703533  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.704870  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.678915  4608 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:20.713172  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.728091  4774 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:20.728353  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.728561  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.728735  4774 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.730815  4774 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:20.731096  1537 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:20.731091  1533 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:20.731763  1540 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:20.727615  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 58807.4us
I20260709 13:02:20.714076  4557 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:02:20.734016  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:20.734349  4557 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:20.734824  4557 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:20.736292  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.701885  4770 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:02:20.743600  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:20.744221  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.735734  4557 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.745455  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.745584  4557 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:20.746233  4315 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:20.746821  4315 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.752187  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.766075  1686 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:20.766841  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.773244  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:20.771899  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.777289  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:20.778033  2370 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.778046  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.778666  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:20.777436  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:20.747805  4315 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.732805  4708 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:20.783849  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.787068  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:20.790328  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.790464  1533 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:20.790840  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:20.789600  1580 leader_election.cc:336] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.774s (SENT)
I20260709 13:02:20.796762  4770 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:20.803064  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:20.808696  4770 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.808873  4709 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:20.809801  4709 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.810451  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:20.810039  4770 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.810792  4709 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.812386  4762 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:20.812609  4573 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:20.813107  4573 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:20.813499  4573 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:20.793404  4474 consensus_queue.cc:1059] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:02:20.821900  1580 leader_election.cc:336] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.774s (SENT)
I20260709 13:02:20.822690  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.823916  4453 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.475975   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:20.826839  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.822016  4649 consensus_meta.cc:287] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.750s	user 0.010s	sys 0.010s
I20260709 13:02:20.837280  1537 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:02:20.811720  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:20.831255  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.813417  1536 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:20.840700  2370 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:20.845244  1688 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:20.798111  4774 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:20.850020  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.854139  1537 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:20.829288  4650 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.846112  4662 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.863279  4662 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.864588  4762 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:20.865864  4662 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:20.847157  4373 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.866828  4373 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.867467  4762 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.869061  4373 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:20.854362  4708 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:20.872547  4708 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:20.873642  4708 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.862433  4495 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:20.859208  4649 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
W20260709 13:02:20.883893  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 62081.4us
I20260709 13:02:20.883870  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.890048  1533 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:20.881301  4495 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:20.899080  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.899916  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.907421  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:20.908143  1533 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:20.894632  4495 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:20.910029  1681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 1888) took 2078 ms (client timeout 1939 ms). Trace:
W20260709 13:02:20.910480  1681 rpcz_store.cc:269] 0709 13:02:18.811087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:18.811206 (+   119us) service_pool.cc:224] Handling call
0709 13:02:20.885495 (+2074289us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400118fd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:20.889404 (+  3909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015750016}
W20260709 13:02:20.919236  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:20.885593  4529 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:02:20.927019  1533 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:20.927934  4678 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:20.928944  1533 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:20.930231  1533 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:20.932096  4739 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.030s	user 0.000s	sys 0.004s
I20260709 13:02:20.933655  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1825) took 2808 ms. Trace:
I20260709 13:02:20.934010  1539 rpcz_store.cc:276] 0709 13:02:18.125663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:19.453810 (+1328147us) service_pool.cc:224] Handling call
0709 13:02:19.454405 (+   595us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:19.460210 (+  5805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:19.460245 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:19.460918 (+   673us) log.cc:844] Serialized 26 byte log entry
0709 13:02:19.506846 (+ 45928us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:19.506890 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:19.506977 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:20.931374 (+1424397us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:20.933287 (+  1913us) raft_consensus.cc:1685] finished
0709 13:02:20.933304 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:20.933496 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8981,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":156,"spinlock_wait_cycles":15549824,"thread_start_us":45396,"threads_started":1,"wal-append.queue_time_us":389275}
I20260709 13:02:20.941280  1536 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:20.942557  1536 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:20.944723  1614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 1838) took 3196 ms (client timeout 1565 ms). Trace:
W20260709 13:02:20.945130  1614 rpcz_store.cc:269] 0709 13:02:17.748436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.985993 (+237557us) service_pool.cc:224] Handling call
0709 13:02:20.944510 (+2958517us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b54001b58d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:20.944653 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5430191872}
I20260709 13:02:20.939888  1538 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:20.859069  4608 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:20.959697  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.965351  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.966099  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.966490  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.966735  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 60185.7us
W20260709 13:02:20.969067  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.967307  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.970649  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.971002  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:20.970971  1580 leader_election.cc:336] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.606s (SENT)
I20260709 13:02:20.971585  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.939262  4495 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:20.939268  4774 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:20.953017  4564 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:20.980157  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:20.988204  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:20.990015  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:20.990756  1610 raft_consensus.cc:2376] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6. Re-sending same reply.
I20260709 13:02:20.990265  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:20.984557  4564 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:20.993487  4495 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:20.994592  2362 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:02:20.995118  2362 pending_rounds.cc:85] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Aborting all ops after (but not including) 9
I20260709 13:02:20.995551  2362 pending_rounds.cc:107] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:02:20.995916  2362 raft_consensus.cc:2889] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:20.996145  4649 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:20.997597  1613 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:20.998026  1611 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:20.995764  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:21.000200  1608 raft_consensus.cc:2376] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5. Re-sending same reply.
I20260709 13:02:20.994982  4564 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:21.006768  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:21.007553  1534 raft_consensus.cc:2376] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7. Re-sending same reply.
I20260709 13:02:21.011945  4650 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.012120  4662 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:21.017150  4662 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:21.017520  4662 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.017544  2328 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:21.018594  4658 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:21.021524  4573 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.022711  4429 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.025739  1685 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:21.027906  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:21.029863  4658 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:21.031514  4658 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:21.032366  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 87399.6us
W20260709 13:02:21.033528  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 67582.6us
W20260709 13:02:21.034215  1580 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.672s (SENT)
W20260709 13:02:21.035722  1580 leader_election.cc:336] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.729s (SENT)
I20260709 13:02:21.036307  1580 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:20.992125  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:21.037276  1538 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:02:21.037820  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48774us
W20260709 13:02:21.047430  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.049240  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.055524  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:21.056437  1608 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.050107  4495 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:02:21.047405  4510 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:21.033214  4658 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:21.047888  4720 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:02:21.072983  1580 leader_election.cc:336] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.870s (SENT)
I20260709 13:02:21.073433  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:21.074590  1580 leader_election.cc:336] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.871s (SENT)
I20260709 13:02:21.074939  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:21.075800  4125 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.076213  4649 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:21.083654  1538 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:21.084252  4573 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:21.084971  1610 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:02:21.059091  4619 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:21.061357  4510 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:21.093315  1580 leader_election.cc:336] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.895s (SENT)
I20260709 13:02:21.093915  1608 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:21.100652  1614 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:21.104261  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 45405.8us
I20260709 13:02:21.110844  1541 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:21.130705  4626 consensus_queue.cc:1059] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:21.109751  4510 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.134711  4573 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:21.135857  4373 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:21.136513  4440 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:21.136677  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 60698.1us
W20260709 13:02:21.137542  1580 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.923s (SENT)
I20260709 13:02:21.137835  4440 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:21.137969  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:21.138023  4373 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:21.116196  4786 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 13:02:21.143221  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.144730  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:21.145761  1608 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:21.151081  1504 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:21.151814  1580 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.957s (SENT)
I20260709 13:02:21.152619  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:21.182745  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.151947  4619 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.208635  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:21.211006  1653 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:21.188624  4785 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:21.177587  4649 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.222277  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:21.212831  1653 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:21.226890  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:21.235831  1611 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:21.178623  4672 consensus_queue.cc:1059] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
W20260709 13:02:21.243189  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 91420.5us
W20260709 13:02:21.244467  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.220594  4770 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.248637  4650 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.248757  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1849) took 3320 ms. Trace:
I20260709 13:02:21.222424  4708 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.257038  4708 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.259188  4708 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:21.259224  1612 rpcz_store.cc:276] 0709 13:02:17.928318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.941177 (+3012859us) service_pool.cc:224] Handling call
0709 13:02:20.941473 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.941740 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:21.102056 (+160316us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.248375 (+146319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.248432 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:21.248497 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.248566 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.248698 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21967,"prepare.queue_time_us":167784,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":119,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":219824,"threads_started":2}
I20260709 13:02:21.205907  4564 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:02:21.262362  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.229791  4373 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:21.341292  1615 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:21.299495  4743 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.345947  1612 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:21.320556  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1834) took 1077 ms. Trace:
I20260709 13:02:21.237373  4529 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:21.323107  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 187692us
I20260709 13:02:21.300482  4429 raft_consensus.cc:3055] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:21.235596  4785 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:21.262915  4653 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.230104  4649 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:21.309238  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.281251  1505 connection.cc:256] RPC call timeout handler was delayed by -3.8248678460000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 13:02:21.362460  1505 connection.cc:256] RPC call timeout handler was delayed by -3.7870678460000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260709 13:02:21.344774  1580 leader_election.cc:336] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.988s (SENT)
I20260709 13:02:21.347589  1540 rpcz_store.cc:276] 0709 13:02:20.242938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.739629 (+496691us) service_pool.cc:224] Handling call
0709 13:02:20.739960 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:20.740180 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:20.780291 (+ 40111us) log.cc:844] Serialized 14 byte log entry
0709 13:02:21.151487 (+371196us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b180038d100. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a823a 00007fd02eb12a2a
0709 13:02:21.320056 (+168569us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:21.320155 (+    99us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:21.320213 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:21.320295 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:21.320471 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":29221,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":13996,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":4479,"spinlock_wait_cycles":50036480,"thread_start_us":154213,"threads_started":1}
I20260709 13:02:21.360369  1612 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:21.373066  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:21.362115  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.293179  4662 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.352065  4429 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:21.375803  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:21.376394  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:21.377240  1611 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:02:21.403474  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.363087  1505 connection.cc:256] RPC call timeout handler was delayed by -3.7276678460000312s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 13:02:21.353390  4619 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.406186  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:21.408288  1615 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:02:21.408519  1505 connection.cc:256] RPC call timeout handler was delayed by -3.6871678460000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:02:21.408967  1505 connection.cc:256] RPC call timeout handler was delayed by -3.2893678460000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:02:21.409320  1505 connection.cc:256] RPC call timeout handler was delayed by -2.2192678460000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3311s for a response
W20260709 13:02:21.409771  1505 connection.cc:256] RPC call timeout handler was delayed by -1.3795678460000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4244s for a response
I20260709 13:02:21.407024  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:21.412403  4448 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:21.412774  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 78574.5us
W20260709 13:02:21.413659  1580 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.027s (SENT)
I20260709 13:02:21.414131  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:21.418429  4448 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:21.419441  1580 leader_election.cc:336] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.066s (SENT)
I20260709 13:02:21.420027  4662 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:21.420756  1580 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.079s (SENT)
W20260709 13:02:21.422165  1580 leader_election.cc:336] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.122s (SENT)
I20260709 13:02:21.422426  4510 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:21.423470  1580 leader_election.cc:336] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.199s (SENT)
I20260709 13:02:21.423532  4642 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.423956  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:21.424189  4642 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:21.424919  4448 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:21.425860  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:21.426290  4642 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:21.389700  1435 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 6, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:21.428551  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.429117  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.439260  1609 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:21.440222  1538 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:21.360468  4529 raft_consensus.cc:697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:21.444806  1610 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:21.361155  4743 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.454344  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:21.469129  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.478781  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:21.483157  1533 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:21.483378  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:21.490610  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 94) took 10908 ms. Trace:
W20260709 13:02:21.490581  4796 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:02:21.491811  1689 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:21.493258  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:21.493116  1435 catalog_manager.cc:5697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.494099  1690 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
W20260709 13:02:21.495086  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.490314  4785 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.495821  4429 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:21.496765  4802 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 13:02:21.497820  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.498950  4743 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:21.499501  4510 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:21.500560  4529 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:21.502256  4793 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:02:21.448617  4619 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.491118  1437 rpcz_store.cc:276] 0709 13:02:10.592345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.594301 (+  1956us) service_pool.cc:224] Handling call
0709 13:02:21.490369 (+10896068us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:14.572269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:14.572873 (+   604us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:14.572913 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:02:14.572933 (+    20us) tablet.cc:662] Decoding operations
0709 13:02:14.574120 (+  1187us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:14.574182 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:14.574214 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:02:14.575310 (+  1096us) tablet.cc:701] Row locks acquired
0709 13:02:14.575328 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:02:14.575492 (+   164us) write_op.cc:270] Start()
0709 13:02:14.575614 (+   122us) write_op.cc:276] Timestamp: P: 1783602134575438 usec, L: 0
0709 13:02:14.575634 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:14.707167 (+131533us) log.cc:844] Serialized 4875 byte log entry
0709 13:02:15.449567 (+742400us) op_driver.cc:464] REPLICATION: finished
0709 13:02:16.127549 (+677982us) write_op.cc:301] APPLY: starting
0709 13:02:16.127650 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:16.127965 (+   315us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:16.208204 (+ 80239us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:17.019140 (+810936us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0532a 00007fd02ea8af14 00007fd02ea8aec3 00007fd02ea8ae38 00007fd02ea8adf3 00007fd02ea8a0dc 00007fd02eab3e16 00007fd02ea9bcbb 00007fd02ea8639d 00007fd02ea89d75
0709 13:02:17.117701 (+ 98561us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:17.117947 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:02:17.126406 (+  8459us) write_op.cc:312] APPLY: finished
0709 13:02:17.229698 (+103292us) log.cc:844] Serialized 88 byte log entry
0709 13:02:17.439343 (+209645us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:17.469404 (+ 30061us) write_op.cc:454] Released schema lock
0709 13:02:17.496549 (+ 27145us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:17.570094 (+ 73545us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:17.570140 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":10897,"mutex_wait_us":166057,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":669306,"apply.run_cpu_time_us":28374,"apply.run_wall_time_us":1432673,"num_ops":12,"prepare.queue_time_us":142044,"prepare.run_cpu_time_us":62915,"prepare.run_wall_time_us":287096,"raft.queue_time_us":307470,"raft.run_cpu_time_us":59228,"raft.run_wall_time_us":1685385,"replication_time_us":836970,"spinlock_wait_cycles":120893184,"thread_start_us":1942717,"threads_started":5,"wal-append.queue_time_us":570173,"wal-append.run_cpu_time_us":72655,"wal-append.run_wall_time_us":2513203}]]}
I20260709 13:02:21.505427  4619 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:21.497721  4429 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.495314  1435 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 7, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.525154  1609 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:21.539556  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:21.545161  1685 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:21.545224  1435 catalog_manager.cc:5697] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.549259  1435 catalog_manager.cc:5697] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.541594  4619 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:21.569149  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 120749us
I20260709 13:02:21.572654  4574 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.573331  4574 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.575567  4574 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:21.578172  1435 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 6, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.581146  1435 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.588617  4619 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.591171  4619 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:21.593508  4649 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:21.593719  4774 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.583909  1435 catalog_manager.cc:5697] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 8, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 8 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.600844  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1809) took 1114 ms. Trace:
I20260709 13:02:21.601339  1532 rpcz_store.cc:276] 0709 13:02:20.486679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:20.589062 (+102383us) service_pool.cc:224] Handling call
0709 13:02:21.600633 (+1011571us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54000fc3d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:21.600783 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501769984}
W20260709 13:02:21.573756  4803 log.cc:927] Time spent T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:02:21.637800  1435 catalog_manager.cc:5697] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 6, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.644625  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:21.645346  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:21.646692  1537 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.653808  1435 catalog_manager.cc:5697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:21.659185  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.666323  1435 catalog_manager.cc:5697] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 6, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.673056  1435 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:21.685298  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:21.686347  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 78464.9us
I20260709 13:02:21.680430  4774 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:21.687323  4774 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:21.688565  4774 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:21.708281  1435 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 5, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.719231  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:21.720906  1537 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:21.724987  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:21.743773  1654 leader_election.cc:336] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.518s (SENT)
W20260709 13:02:21.749163  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.756287  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:21.757346  1540 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:21.759793  4440 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:21.760511  4440 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:21.763635  4440 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:21.771826  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:21.773660  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:21.774603  4809 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.775187  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:21.775460  4809 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:21.779899  1435 catalog_manager.cc:5697] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 8, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 8 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.785197  4557 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:02:21.800945  1435 catalog_manager.cc:5697] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.809755  1435 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:21.816505  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 72752.6us
I20260709 13:02:21.820631  4440 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.833009  4440 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.832177  1435 catalog_manager.cc:5697] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.836172  1435 catalog_manager.cc:5697] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:21.837381  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 62297.3us
I20260709 13:02:21.837973  1435 catalog_manager.cc:5697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.867219  1536 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:02:21.885530  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:21.877976  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:21.865461  4653 consensus_meta.cc:287] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.008s
I20260709 13:02:21.888578  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:21.894411  1536 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:21.900247  4440 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:21.901449  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 56537.6us
W20260709 13:02:21.904088  4807 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.456s	user 0.000s	sys 0.010s
I20260709 13:02:21.919452  1534 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:02:21.935734  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 116960us
W20260709 13:02:21.937589  1654 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.565s (SENT)
I20260709 13:02:21.920720  4774 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:21.921818  1540 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:21.924193  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:21.940825  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:21.941252  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:21.942070  1611 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:21.941527  1609 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:21.926434  1435 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a reported cstate change: leader changed from <none> to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.947724  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:21.948523  1612 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.946343  1435 catalog_manager.cc:5697] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 2 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.931828  4125 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:21.949784  1690 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:21.959138  1435 catalog_manager.cc:5697] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 4, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 4 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:21.961349  1537 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:21.963488  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:21.964120  1616 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:21.965268  1611 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:21.957600  4125 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:21.969168  4125 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:21.970326  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:21.971014  1685 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:21.972626  1615 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:21.975814  2368 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:02:21.976617  1608 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:21.980345  1612 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:21.983088  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:21.984651  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47085.7us
I20260709 13:02:21.991572  1607 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:02:21.992636  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:21.993371  1611 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:21.991423  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:21.997026  1539 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:21.998399  1539 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:21.998754  1609 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:22.001050  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.001093  4125 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:22.002017  1609 raft_consensus.cc:2376] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6. Re-sending same reply.
I20260709 13:02:22.002978  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.004087  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.006186  1609 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:22.009760  4774 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:22.015131  1609 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:02:22.021987  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:21.989032  1435 catalog_manager.cc:5697] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:22.031420  1435 catalog_manager.cc:5697] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.035321  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.035382  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:22.034889  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:22.036392  1540 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:22.038695  1611 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:21.994920  4557 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:02:22.023756  4829 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:02:21.994686  4608 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.033991  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:22.030930  4448 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.034215  4315 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:21.990809  4658 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:02:22.042480  4373 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.054023  4448 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.067243  4448 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:22.041426  1616 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:22.069459  4650 raft_consensus.cc:2764] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:02:22.038378  4529 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:02:22.076607  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 127714us
I20260709 13:02:22.084930  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:22.089409  1611 raft_consensus.cc:2410] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:22.086755  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.064486  4373 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.071807  4557 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.102133  1616 raft_consensus.cc:2410] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:22.112792  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.116109  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:22.178309  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.179277  1609 raft_consensus.cc:2410] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:02:22.115294  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 74130.3us
I20260709 13:02:22.117692  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.179647  1611 raft_consensus.cc:2368] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6.
I20260709 13:02:22.180173  1607 raft_consensus.cc:2368] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:22.045926  4608 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:22.182211  1537 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:22.182420  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.174707  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:22.183547  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:22.116834  4373 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.189383  4835 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.225528  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.119421  4557 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.227777  4835 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:22.236086  4828 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.394s	user 0.005s	sys 0.003s
I20260709 13:02:22.237706  4835 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:22.226332  4827 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:02:22.244508  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:22.245416  1609 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:22.238461  4608 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:22.234462  4448 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.253670  4448 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.256331  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.257637  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:22.258155  1616 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.266942  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.268740  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.287534  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:22.288417  1613 raft_consensus.cc:2368] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6.
I20260709 13:02:22.291808  1609 raft_consensus.cc:2410] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:22.293002  1616 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:22.293306  1609 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: [6.3-8.4]
I20260709 13:02:22.297813  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:22.302445  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 72421.7us
I20260709 13:02:22.305285  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:22.305992  1532 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.304431  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:22.301126  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 121208us
I20260709 13:02:22.307588  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:22.308408  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.308969  1609 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:22.315946  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:22.321753  4835 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.322184  4835 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.322551  4835 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.325433  4841 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:22.325904  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.326522  4841 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:22.327661  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.328528  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.329337  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:22.329591  1607 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:02:22.330457  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.330662  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.331632  1607 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:22.331980  1612 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:22.330698  1532 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:22.343724  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.344681  1609 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:22.365270  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.366370  1616 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:22.342494  4714 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.362764  4841 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.379479  4714 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:22.435236  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63218.6us
I20260709 13:02:22.441047  4495 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:22.467935  4840 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:22.478150  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:22.480314  1580 connection.cc:256] RPC call timeout handler was delayed by -1.3384013240000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
W20260709 13:02:22.481053  1580 leader_election.cc:336] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.500s (SENT)
I20260709 13:02:22.481501  1580 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:22.484894  1610 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:22.485808  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:22.482836  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.515s (SENT) [suppressed 50 similar messages]
W20260709 13:02:22.476197  4838 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:02:22.497623  4714 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:22.505865  1579 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:22.511157  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:22.518543  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 77261.1us
I20260709 13:02:22.526521  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:22.573051  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 92028.4us
W20260709 13:02:22.661619  1580 connection.cc:256] RPC call timeout handler was delayed by -1.2421013239999752s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22410000000000002s for a response
I20260709 13:02:22.649197  4837 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:22.670056  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:22.670516  1682 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:02:22.490954  4125 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.516136  4653 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:02:22.655095  4619 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:22.657788  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 174998us
I20260709 13:02:22.516669  4854 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:22.502948  4785 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:22.655920  4842 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:22.675168  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:22.659575  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:22.677407  4619 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.678057  2364 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:22.683290  1611 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
W20260709 13:02:22.687503  1505 leader_election.cc:336] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.615s (SENT)
I20260709 13:02:22.687947  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.692353  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:22.675686  4854 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.679265  1681 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:22.672653  4852 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:02:22.660713  4373 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.701049  2362 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:22.705231  4862 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:22.705610  4373 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:22.700572  4854 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:22.683341  4574 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:22.695065  4785 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:22.726058  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48390.9us
I20260709 13:02:22.717274  4785 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:22.671981  4835 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:22.729221  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 55528.8us
I20260709 13:02:22.732990  1690 raft_consensus.cc:1240] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:22.685894  4837 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:22.735316  1580 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.993s (SENT)
I20260709 13:02:22.738129  1580 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.736876  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:22.726351  4862 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.732543  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:22.687201  4842 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.697456  4859 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:02:22.758312  1681 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:22.760668  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 98317.4us
W20260709 13:02:22.761387  1580 leader_election.cc:336] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.401s (SENT)
I20260709 13:02:22.761754  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:22.762905  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:22.748333  4619 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:22.780244  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:22.781401  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:22.764588  2362 raft_consensus.cc:2368] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
I20260709 13:02:22.740787  4662 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:02:22.781729  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:22.786284  4373 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:22.787320  4836 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.556s	user 0.000s	sys 0.004s
I20260709 13:02:22.790495  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:22.778227  4574 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:02:22.795053  1580 connection.cc:256] RPC call timeout handler was delayed by -1.1609008209999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2616s for a response
I20260709 13:02:22.795579  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:22.763479  4786 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:22.815910  1580 connection.cc:256] RPC call timeout handler was delayed by -1.1242931030000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:02:22.787809  4842 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:22.820808  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.746027  4862 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:22.805222  4856 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:02:22.818723  4860 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:02:22.843298  1580 connection.cc:256] RPC call timeout handler was delayed by -1.0533394359999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:02:22.819176  4495 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:22.815786  4672 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.815800  4574 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.779362  4864 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:22.844183  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:22.847813  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 43952.8us
I20260709 13:02:22.800007  4619 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 13:02:22.862609  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:22.861519  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.866021  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.822160  4510 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:02:22.851928  4574 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.847375  4653 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.879908  4653 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.880987  4373 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:22.882994  4653 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:22.882623  4373 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:22.856335  4440 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:02:22.885711  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:22.876575  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.887064  4653 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.887451  4653 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:22.887780  4653 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:22.854635  4672 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:22.891578  4650 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:22.871193  4864 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:22.896510  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.908826  4125 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:22.909142  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 88964.4us
I20260709 13:02:22.892198  4650 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:22.910768  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 47870.5us
I20260709 13:02:22.860895  4842 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:22.915040  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:22.873349  4844 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.917842  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.911218  4866 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:22.922336  4866 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:22.922730  4866 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:22.893395  4867 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:22.937322  4125 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:22.904152  4864 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:22.910971  4835 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:22.921536  4844 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:22.949167  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 98666us
W20260709 13:02:22.973621  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 55873.4us
I20260709 13:02:22.974548  1580 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:22.983870  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 201015us
I20260709 13:02:22.985313  4882 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:22.992733  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 77789.5us
I20260709 13:02:22.995954  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:22.999457  1580 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:22.929073  4851 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:02:22.974181  4844 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:23.008455  4876 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:22.972071  4875 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:22.946376  4864 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:23.053328  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 59776.1us
I20260709 13:02:22.945168  4850 consensus_queue.cc:1059] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:02:23.057688  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 59516.5us
I20260709 13:02:22.983486  4837 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:22.998705  4125 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:22.944774  4874 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:02:22.993319  4619 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:23.103367  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 107560us
W20260709 13:02:23.105440  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 48486.2us
W20260709 13:02:23.105404  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 46353.1us
I20260709 13:02:22.945670  4867 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:22.995440  4835 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:02:23.058374  4875 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:22.983210  4854 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.058104  4672 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.100586  4125 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:23.111598  4842 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.111697  4876 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:23.166071  1505 leader_election.cc:400] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6.
I20260709 13:02:23.168274  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:23.137118  4875 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:23.149133  4125 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:23.121297  4619 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:23.211943  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 103352us
W20260709 13:02:23.213378  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 135466us
I20260709 13:02:23.217947  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:23.218590  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:23.215770  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 106695us
I20260709 13:02:23.150285  4440 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:02:23.145280  4786 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
W20260709 13:02:23.226965  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 58836.4us
I20260709 13:02:23.210985  4315 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:23.200150  4862 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.233960  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.211460  4842 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:23.219336  4650 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.202593  4888 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:23.197222  4837 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:02:23.192600  4880 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:02:23.238446  1535 raft_consensus.cc:2410] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:23.196882  4510 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:02:23.241389  1682 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:02:23.242934  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:23.243604  4627 consensus_queue.cc:1059] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:02:23.245755  4448 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.245709  4888 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.237303  4315 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:23.251232  4869 consensus_queue.cc:1059] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:23.272874  4835 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.273517  4627 raft_consensus.cc:3055] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:23.273870  4627 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:23.274183  4890 raft_consensus.cc:3055] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:23.274708  4890 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:23.276396  4884 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:02:23.276633  4888 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:23.277457  4881 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:02:23.230894  4874 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:23.265827  4873 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:02:23.260855  4650 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:23.292147  4650 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:23.269686  4855 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:02:23.272480  4315 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.275921  4890 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:23.297163  4869 consensus_queue.cc:1175] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c98c328741aa493d87abafbf08f04944" responder_term: 5 status { last_received { term: 5 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 5 index: 6 } }
I20260709 13:02:23.297437  4890 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:23.274726  4627 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:23.299881  4627 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.271853  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:02:23.263236  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44745.6us
I20260709 13:02:23.240595  4862 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:23.308465  4855 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:23.310061  4855 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:23.310338  4619 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.312510  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:23.312577  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1605) took 1076 ms. Trace:
I20260709 13:02:23.314177  1611 rpcz_store.cc:276] 0709 13:02:22.235755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.235875 (+   120us) service_pool.cc:224] Handling call
0709 13:02:22.669971 (+434096us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5c001d5a8c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd032472161 00007fd032613a79 00007fd033acd9b6 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:23.312333 (+642362us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b5400409cd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:23.312460 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70468224}
I20260709 13:02:23.315505  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:23.315887  4862 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.311844  4855 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.316380  4894 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:02:23.317195  1505 leader_election.cc:400] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6.
I20260709 13:02:23.318071  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:23.318480  4862 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.260584  4842 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:23.320220  4888 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.327287  4440 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:23.287576  4851 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:02:23.309952  4574 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.322436  4894 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:23.323707  4842 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:23.324211  4786 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:23.325198  4854 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.321365  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:23.195600  4876 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:23.340716  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:23.239337  4866 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:23.319160  4862 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:23.348699  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:23.348876  1683 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:23.352123  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:23.347501  4888 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:23.354176  4888 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.354952  4888 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:23.360150  4874 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:23.362039  4876 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:23.369616  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:23.370716  1611 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:23.371423  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:23.372234  1609 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:23.377296  1535 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:23.332561  4653 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.380465  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:23.380909  4867 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:23.382716  1608 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:23.384509  1614 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.394840  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:23.400969  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.401305  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.402083  1536 raft_consensus.cc:2410] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:23.402083  1532 raft_consensus.cc:2410] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:23.409576  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.410677  4902 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:23.411283  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.412210  1536 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:23.412218  4574 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:23.413626  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.414454  1536 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:23.403184  4125 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.417006  1614 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:23.437244  4574 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:23.437733  4894 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:23.437904  4574 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.438949  4894 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:23.443444  4894 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:23.444100  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.443473  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:23.445278  1615 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:23.445436  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.446312  1539 raft_consensus.cc:2410] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:23.446965  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.447737  1540 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:23.456238  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:23.462280  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:23.464511  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:23.465371  1686 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:23.464493  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.466226  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.467063  1532 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:23.468762  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.469372  1533 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:23.469420  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:23.466308  1538 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:23.395665  4315 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.473395  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:23.477205  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:23.478315  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:23.479341  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.486742  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:23.491683  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:23.492566  1532 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:23.466733  4894 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:23.491724  1536 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:23.511313  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.512177  1536 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:23.516695  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:23.517918  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:23.510257  4894 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.557854  4851 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:23.552832  4859 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:23.519546  4862 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:23.555001  4619 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:23.563340  4626 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:23.597693  1532 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:23.603988  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:23.604779  1532 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:23.576689  4894 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:23.564589  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:23.608455  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.615592  2363 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:23.591548  4653 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.597476  4851 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:23.630786  1532 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:23.602115  4866 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:23.608210  4859 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:23.554080  4875 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:23.632699  4851 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:23.651789  4844 consensus_meta.cc:287] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.547s	user 0.004s	sys 0.008s
I20260709 13:02:23.605949  4862 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.606076  4619 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:23.651944  4864 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.549s	user 0.013s	sys 0.000s
I20260709 13:02:23.639891  4775 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:23.674808  4557 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.694321  4775 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.681519  4844 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.700126  4574 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:23.608968  4626 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:23.717607  4315 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:23.647562  4800 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.218s
I20260709 13:02:23.671715  4653 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:23.685788  4864 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:23.856204  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:23.713600  4859 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:23.856968  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 404993us
W20260709 13:02:23.858089  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 245839us
W20260709 13:02:23.848735  4907 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.249s	user 0.004s	sys 0.000s
I20260709 13:02:23.718528  4619 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.848304  4125 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:23.901774  1536 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:23.942361  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:23.951609  1536 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:23.877563  4905 log.cc:927] Time spent T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:02:23.965607  1611 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:24.000788  4841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.012s	sys 0.040s
W20260709 13:02:24.076917  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:23.935268  4653 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:24.016906  4909 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.159s	user 0.002s	sys 0.007s
W20260709 13:02:24.029598  4841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.041s
I20260709 13:02:24.103932  4844 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:24.109572  4901 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.421s	user 0.000s	sys 0.011s
I20260709 13:02:24.108418  4875 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:24.111931  4906 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.220s	user 0.002s	sys 0.001s
W20260709 13:02:24.115046  4918 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:02:24.117041  4920 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 13:02:24.119611  4919 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:02:24.137220  4923 log.cc:927] Time spent T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.415s	user 0.004s	sys 0.003s
I20260709 13:02:24.139184  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:24.139858  1615 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:24.140751  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:24.141255  1615 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:24.109376  4910 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.175s	user 0.009s	sys 0.010s
I20260709 13:02:24.137099  4626 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.158041  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:24.171444  1612 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:24.162515  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:24.143961  1504 leader_election.cc:400] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
I20260709 13:02:24.179343  1504 leader_election.cc:403] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:24.184490  4855 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:24.187955  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:24.190284  4894 consensus_meta.cc:287] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.006s
W20260709 13:02:24.190405  4851 consensus_meta.cc:287] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.508s	user 0.013s	sys 0.000s
W20260709 13:02:24.109038  4933 log.cc:927] Time spent T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:02:24.232707  1614 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.071s	sys 0.079s
I20260709 13:02:24.123561  4775 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.153754  4864 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.230372  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:24.229379  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50756us
I20260709 13:02:24.241669  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:24.244185  1614 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.072s	sys 0.079s
I20260709 13:02:24.258407  1615 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:24.275334  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:24.242573  4855 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:24.284335  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:24.265467  1536 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:24.263041  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:24.278988  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:24.242722  4894 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:24.289130  1540 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:24.286397  4855 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:24.293860  1616 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:24.294605  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:24.252636  4851 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.301071  1615 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:24.304212  4841 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:24.322332  1540 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:24.306819  4859 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:24.314298  4942 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:02:24.316092  4653 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.314023  4862 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.330487  4949 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:24.331168  4894 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:24.332103  4893 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.023s	user 0.006s	sys 0.004s
I20260709 13:02:24.339468  4851 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.333052  4859 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.342768  4859 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:24.344188  4931 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:02:24.344403  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1938) took 1391 ms. Trace:
I20260709 13:02:24.329084  4841 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:24.344756  1681 rpcz_store.cc:276] 0709 13:02:22.952514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.952737 (+   223us) service_pool.cc:224] Handling call
0709 13:02:22.989987 (+ 37250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.055723 (+ 65736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.055772 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.060369 (+  4597us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.231553 (+171184us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:23.241953 (+ 10400us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.247415 (+  5462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.247495 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.331395 (+1083900us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:24.335408 (+  4013us) raft_consensus.cc:1685] finished
0709 13:02:24.344148 (+  8740us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.344315 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37158,"prepare.queue_time_us":13386,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":70421,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":29044,"spinlock_wait_cycles":26600704,"thread_start_us":91006,"threads_started":1,"wal-append.queue_time_us":175122}
I20260709 13:02:24.346071  4841 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:24.327661  4945 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:24.363206  4650 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:24.380261  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 79710.3us
I20260709 13:02:24.367816  4495 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.398065  4904 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.681s	user 0.005s	sys 0.000s
W20260709 13:02:24.401352  4924 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.681s	user 0.005s	sys 0.000s
W20260709 13:02:24.427395  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.370s	user 0.021s	sys 0.030s
W20260709 13:02:24.427827  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.370s	user 0.021s	sys 0.030s
I20260709 13:02:24.392869  4495 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.455196  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:24.455225  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 1.456e+06us
I20260709 13:02:24.369807  4945 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.459797  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:24.467787  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:24.469364  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.471312  2365 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:24.485839  2328 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.486784  4896 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:24.487402  4869 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.490599  4495 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.493072  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:24.493762  2365 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:24.495525  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.465509  4950 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:02:24.500957  4945 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.501066  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:24.501742  1685 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:24.508462  4495 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:24.509008  4872 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.630s	user 0.002s	sys 0.008s
I20260709 13:02:24.509279  4495 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.512385  4574 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:24.513095  4574 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.516458  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:24.517963  2365 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:24.511806  4495 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.491840  4855 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:24.519906  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:24.521574  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1923) took 1145 ms. Trace:
I20260709 13:02:24.523842  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1922) took 1149 ms. Trace:
I20260709 13:02:24.522019  1611 rpcz_store.cc:276] 0709 13:02:23.375664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.385428 (+  9764us) service_pool.cc:224] Handling call
0709 13:02:23.385763 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.970955 (+585192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.521322 (+550367us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400420c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:24.521478 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332975488}
I20260709 13:02:24.524441  1607 rpcz_store.cc:276] 0709 13:02:23.374326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.377489 (+  3163us) service_pool.cc:224] Handling call
0709 13:02:23.379024 (+  1535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.391626 (+ 12602us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.391656 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.392219 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.490545 (+ 98326us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:23.874054 (+383509us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.523507 (+649453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.523595 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.523635 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:24.523647 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.523781 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":653137,"prepare.queue_time_us":697914,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":4230,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":466646,"threads_started":2,"wal-append.queue_time_us":175572}
I20260709 13:02:24.526046  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:24.529392  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:24.530773  4619 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.531256  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:24.531764  1607 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:24.532342  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1921) took 1158 ms. Trace:
I20260709 13:02:24.532509  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1935) took 1071 ms. Trace:
I20260709 13:02:24.532970  1607 rpcz_store.cc:276] 0709 13:02:23.460753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.531244 (+1070491us) service_pool.cc:224] Handling call
0709 13:02:24.531566 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.532269 (+   703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.532451 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.530898  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:24.535207  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:24.531525  4619 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:24.532764  1609 rpcz_store.cc:276] 0709 13:02:23.373697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.376933 (+  3236us) service_pool.cc:224] Handling call
0709 13:02:23.377235 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.389431 (+ 12196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.389471 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.390101 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.518233 (+128132us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:23.970270 (+452037us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.397549 (+427279us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b240028a2e8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b8a19c4 00007fd02b89facb 00007fd02ba5adc9 00007fd02ba5aa55 00007fd02ba5a09d 00007fd02e68c10e 00007fd02e6a388c 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221
0709 13:02:24.526869 (+129320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.526978 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.527020 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:24.532154 (+  5134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.532284 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":556310,"prepare.queue_time_us":670288,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":13202,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":274180480,"thread_start_us":577743,"threads_started":2,"wal-append.queue_time_us":261941}
I20260709 13:02:24.547341  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.549536  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:24.552800  2328 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.554173  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:24.568454  4879 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:24.569607  1685 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:24.570996  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:24.574115  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1928) took 1139 ms. Trace:
I20260709 13:02:24.574676  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:24.533581  4949 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:24.580590  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 115822us
I20260709 13:02:24.583600  4574 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.584306  4854 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:24.581028  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 114756us
I20260709 13:02:24.574860  1614 rpcz_store.cc:276] 0709 13:02:23.434422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.478165 (+ 43743us) service_pool.cc:224] Handling call
0709 13:02:23.513027 (+ 34862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.513439 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.513472 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.526342 (+ 12870us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.673926 (+147584us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.268758 (+594832us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.400976 (+132218us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b240028a2e8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b8a19c4 00007fd02b89facb 00007fd02ba5adc9 00007fd02ba5aa55 00007fd02ba5a09d 00007fd02e68c10e 00007fd02e6a388c 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221
0709 13:02:24.552539 (+151563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.552674 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.552737 (+    63us) raft_consensus.cc:1685] finished
0709 13:02:24.573870 (+ 21133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.574029 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284217,"prepare.queue_time_us":515467,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":27,"raft.queue_time_us":6931,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":29553,"spinlock_wait_cycles":270957952,"thread_start_us":662051,"threads_started":2,"wal-append.queue_time_us":144898}
I20260709 13:02:24.579636  4869 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.543715  4495 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:02:24.569483  4429 consensus_queue.cc:1059] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:02:24.609642  1580 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.611148  4897 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:24.596946  4954 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:02:24.625658  1579 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:24.599543  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:24.587225  4949 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.626802  4945 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.659902  2365 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:24.662359  1682 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
W20260709 13:02:24.667433  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 57902.8us
I20260709 13:02:24.669970  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.670858  4653 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.671255  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.671379  4854 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:24.675298  1580 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.675738  1614 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:24.678292  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1929) took 1241 ms. Trace:
I20260709 13:02:24.661011  4868 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:24.672732  4945 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.700654  4868 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:24.701243  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1908) took 1225 ms. Trace:
I20260709 13:02:24.697562  4672 raft_consensus.cc:3055] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:24.698789  4949 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.699636  4619 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.700137  4855 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:24.701344  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 1934) took 1918 ms. Trace:
I20260709 13:02:24.701736  1538 rpcz_store.cc:276] 0709 13:02:23.475393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.475520 (+   127us) service_pool.cc:224] Handling call
0709 13:02:23.500387 (+ 24867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.500738 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:23.591628 (+ 90890us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.700604 (+1108976us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b180034eca0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287 00007fd02eb23208
0709 13:02:24.700782 (+   178us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.700867 (+    85us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.700932 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.701014 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.701161 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90963,"prepare.queue_time_us":176870,"prepare.run_cpu_time_us":19666,"prepare.run_wall_time_us":164106,"spinlock_wait_cycles":4790656,"thread_start_us":343730,"threads_started":2,"wal-append.queue_time_us":505436}
I20260709 13:02:24.727130  4557 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:24.727749  4557 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.718122  2363 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:24.703773  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1915) took 1223 ms. Trace:
I20260709 13:02:24.679344  4125 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:24.720363  4897 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:24.701144  4868 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:24.722378  4899 log.cc:927] Time spent T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.153s	user 0.005s	sys 0.007s
I20260709 13:02:24.722630  4945 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.723855  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:24.754509  1685 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:24.725567  4874 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.727370  1683 rpcz_store.cc:276] 0709 13:02:22.782765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.783163 (+   398us) service_pool.cc:224] Handling call
0709 13:02:22.783435 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.351404 (+567969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.698233 (+1346829us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b5400303754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:24.701279 (+  3046us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299959680}
I20260709 13:02:24.728664  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 497) took 1200 ms. Trace:
I20260709 13:02:24.755573  4874 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:24.755615  1538 rpcz_store.cc:276] 0709 13:02:23.528405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.727797 (+1199392us) service_pool.cc:224] Handling call
0709 13:02:24.728150 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.728322 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.728349 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.728390 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:24.728423 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.728493 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.728602 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.711776  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.730791  1541 rpcz_store.cc:276] 0709 13:02:23.480316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.480477 (+   161us) service_pool.cc:224] Handling call
0709 13:02:23.480814 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.481044 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:23.602980 (+121936us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.703299 (+1100319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.703370 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.703429 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.703543 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.703694 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":882291,"prepare.queue_time_us":160278,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":16226,"raft.queue_time_us":853980,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7844,"thread_start_us":344440,"threads_started":2,"wal-append.queue_time_us":306027}
W20260709 13:02:24.685264  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 149467us
I20260709 13:02:24.757664  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:24.757925  4874 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.730165  4557 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.710395  4672 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:24.752648  4775 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:24.752612  4608 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.767647  2328 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:24.758374  1538 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:02:24.747536  4866 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:24.682441  1612 rpcz_store.cc:276] 0709 13:02:23.436631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.172538 (+735907us) service_pool.cc:224] Handling call
0709 13:02:24.173117 (+   579us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:24.544229 (+371112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.544285 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:24.569908 (+ 25623us) log.cc:844] Serialized 52 byte log entry
0709 13:02:24.675448 (+105540us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.676174 (+   726us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.677263 (+  1089us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.677469 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.677587 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.678092 (+   505us) raft_consensus.cc:1685] finished
0709 13:02:24.678112 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.678237 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":396403,"prepare.queue_time_us":238,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":96,"raft.queue_time_us":376144,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":121,"thread_start_us":78510,"threads_started":1,"wal-append.queue_time_us":89048}
I20260709 13:02:24.747316  4902 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:24.803464  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1918) took 1321 ms. Trace:
W20260709 13:02:24.803928  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 92251.7us
I20260709 13:02:24.805013  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.775857  4125 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.774603  4965 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:24.819319  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1928) took 1227 ms. Trace:
I20260709 13:02:24.819962  1538 rpcz_store.cc:276] 0709 13:02:23.592357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.810759 (+1218402us) service_pool.cc:224] Handling call
0709 13:02:24.818587 (+  7828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.818848 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.818889 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.818964 (+    75us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.819012 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.819092 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.819239 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:24.822327  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.804387  1532 rpcz_store.cc:276] 0709 13:02:23.482115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.632120 (+150005us) service_pool.cc:224] Handling call
0709 13:02:23.642107 (+  9987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.642346 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:23.644477 (+  2131us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.767421 (+1122944us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.803036 (+ 35615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.803106 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.803167 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.803249 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.803390 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":872583,"prepare.queue_time_us":77008,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":850497,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":279037,"threads_started":3,"wal-append.queue_time_us":540975}
I20260709 13:02:24.793241  4876 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
I20260709 13:02:24.824998  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 498) took 1219 ms. Trace:
I20260709 13:02:24.829329  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1917) took 1345 ms. Trace:
I20260709 13:02:24.827708  1538 rpcz_store.cc:276] 0709 13:02:23.605512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.821037 (+1215525us) service_pool.cc:224] Handling call
0709 13:02:24.823316 (+  2279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.824525 (+  1209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.824570 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.824636 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.824690 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.824777 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.824939 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.809756  4429 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:24.832754  1534 rpcz_store.cc:276] 0709 13:02:23.481805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.611753 (+129948us) service_pool.cc:224] Handling call
0709 13:02:23.616725 (+  4972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.617014 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:23.856005 (+238991us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.827276 (+971271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.827329 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.827372 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.827432 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.827537 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":779467,"prepare.queue_time_us":102171,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":758154,"raft.run_cpu_time_us":14722,"raft.run_wall_time_us":40489,"spinlock_wait_cycles":14675328,"thread_start_us":460349,"threads_started":3,"wal-append.queue_time_us":302613}
I20260709 13:02:24.841679  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1911) took 1365 ms. Trace:
I20260709 13:02:24.812652  4862 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:24.799598  4608 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:24.819001  4965 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:24.889005  1539 rpcz_store.cc:276] 0709 13:02:23.476513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.477211 (+   698us) service_pool.cc:224] Handling call
0709 13:02:23.477547 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.477798 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:23.559484 (+ 81686us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.354890 (+795406us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b18003361c0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a823a
0709 13:02:24.840660 (+485770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.841303 (+   643us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.841355 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.841440 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.841615 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":404595,"prepare.queue_time_us":132650,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":439840,"spinlock_wait_cycles":18774016,"thread_start_us":213843,"threads_started":3,"wal-append.queue_time_us":121827,"wal-append.run_cpu_time_us":2680,"wal-append.run_wall_time_us":1035977}
W20260709 13:02:24.877696  4961 log.cc:927] Time spent T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:24.841145  4908 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:24.884349  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1919) took 1402 ms. Trace:
I20260709 13:02:24.843492  4429 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:24.843327  4800 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:24.903409  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1914) took 1424 ms. Trace:
I20260709 13:02:24.906121  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1930) took 1283 ms. Trace:
I20260709 13:02:24.917562  1534 rpcz_store.cc:276] 0709 13:02:23.622634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.845657 (+1223023us) service_pool.cc:224] Handling call
0709 13:02:24.905580 (+ 59923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.905759 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.905784 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.905825 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.905855 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.905904 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.906054 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.792014  4775 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:24.894109  4919 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:24.807353  4866 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:24.803407  4902 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.911971  1533 rpcz_store.cc:276] 0709 13:02:23.482404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.634982 (+152578us) service_pool.cc:224] Handling call
0709 13:02:23.672838 (+ 37856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.673142 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:23.686827 (+ 13685us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.883844 (+1197017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.883926 (+    82us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.883988 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.884091 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.884273 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":829472,"prepare.queue_time_us":46902,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":763320,"raft.run_cpu_time_us":6150,"raft.run_wall_time_us":36094,"thread_start_us":300486,"threads_started":2,"wal-append.queue_time_us":388214}
I20260709 13:02:24.915851  1537 rpcz_store.cc:276] 0709 13:02:23.479070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.479219 (+   149us) service_pool.cc:224] Handling call
0709 13:02:23.479591 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.479843 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:23.559766 (+ 79923us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.903049 (+1343283us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.903104 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.903151 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.903216 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.903342 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":798769,"prepare.queue_time_us":139764,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":770797,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8028,"thread_start_us":650756,"threads_started":3,"wal-append.queue_time_us":630202}
I20260709 13:02:24.928160  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1936) took 1209 ms. Trace:
I20260709 13:02:24.929206  1537 rpcz_store.cc:276] 0709 13:02:23.718993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.926388 (+1207395us) service_pool.cc:224] Handling call
0709 13:02:24.926650 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.926820 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.926846 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.927707 (+   861us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:24.927836 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.927914 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.928082 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:24.918819  4908 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.932761  4859 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:24.933281  4859 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:24.934227  4908 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.914228  4429 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:24.936875  4941 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.702s	user 0.005s	sys 0.000s
I20260709 13:02:24.937500  4608 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.901937  4672 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.941428  2364 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 438) took 2140 ms. Trace:
I20260709 13:02:24.941884  2364 rpcz_store.cc:276] 0709 13:02:22.800847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.801034 (+   187us) service_pool.cc:224] Handling call
0709 13:02:22.819597 (+ 18563us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:22.909996 (+ 90399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:22.910032 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:22.929935 (+ 19903us) log.cc:844] Serialized 52 byte log entry
0709 13:02:23.079515 (+149580us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:23.079578 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.941015 (+1861437us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54004dd5d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:24.941064 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.941114 (+    50us) raft_consensus.cc:1685] finished
0709 13:02:24.941125 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.941364 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":623,"raft.queue_time_us":17411,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":19024,"spinlock_wait_cycles":169984000,"thread_start_us":139660,"threads_started":1,"wal-append.queue_time_us":159829,"wal-append.run_cpu_time_us":2992,"wal-append.run_wall_time_us":1156829}
I20260709 13:02:24.944165  4864 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:24.944396  4965 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:24.945766  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 140856us
I20260709 13:02:24.946673  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.947161  4864 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:24.945904  4965 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:24.910332  4876 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:24.947883  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.944427  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1924) took 1524 ms. Trace:
I20260709 13:02:24.955679  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1937) took 1236 ms. Trace:
W20260709 13:02:24.959095  1505 leader_election.cc:336] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.515s (SENT)
I20260709 13:02:24.959808  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:24.958807  1608 rpcz_store.cc:276] 0709 13:02:23.420167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.420336 (+   169us) service_pool.cc:224] Handling call
0709 13:02:23.458353 (+ 38017us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:02:23.468298 (+  9945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.468328 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:02:23.480245 (+ 11917us) log.cc:844] Serialized 78 byte log entry
0709 13:02:23.619569 (+139324us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:23.862916 (+243347us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.522913 (+659997us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b18002e09c0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287 00007fd02eb23208
0709 13:02:24.523653 (+   740us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.802210 (+278557us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.943977 (+141767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.944167 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.944207 (+    40us) raft_consensus.cc:1685] finished
0709 13:02:24.944218 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.944368 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":342641,"prepare.queue_time_us":652706,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":113,"raft.queue_time_us":880595,"raft.run_cpu_time_us":514,"raft.run_wall_time_us":25872,"spinlock_wait_cycles":8665856,"thread_start_us":414251,"threads_started":3,"wal-append.queue_time_us":349801}
I20260709 13:02:24.959370  1537 rpcz_store.cc:276] 0709 13:02:23.719299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.930223 (+1210924us) service_pool.cc:224] Handling call
0709 13:02:24.930519 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.930742 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.930779 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:24.930836 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.955254 (+ 24418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.955376 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.955579 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:24.966095  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:24.964607  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 820892us
I20260709 13:02:24.911737  4862 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:24.969599  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:24.947939  4864 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:24.948302  4874 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:24.957445  4854 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:24.923141  4800 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.965245  4876 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:24.989096  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:24.991326  1505 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.516s (SENT)
I20260709 13:02:24.996603  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1934) took 1542 ms. Trace:
I20260709 13:02:24.990168  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1921) took 1507 ms. Trace:
I20260709 13:02:24.992079  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1937) took 1514 ms. Trace:
I20260709 13:02:25.011392  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
W20260709 13:02:24.971858  4786 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.618s	user 0.015s	sys 0.001s
I20260709 13:02:24.992826  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1933) took 1546 ms. Trace:
I20260709 13:02:25.018702  1613 rpcz_store.cc:276] 0709 13:02:23.453976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.489415 (+1035439us) service_pool.cc:224] Handling call
0709 13:02:24.489744 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.671097 (+181353us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b48000f15d8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd033a31aa1 00007fd033a28b37 00007fd033a289ca 00007fd033b2026f 00007fd033b1ff37 00007fd033b3455c 00007fd033b34508 00007fd033b34488 00007fd033b34443 00007fd033b336ec 00007fd032a5da96
0709 13:02:24.794439 (+123342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.795281 (+   842us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.795743 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.914365 (+118622us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.914404 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.914484 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.996307 (+ 81823us) raft_consensus.cc:1685] finished
0709 13:02:24.996326 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.996530 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91101,"raft.queue_time_us":95068,"raft.run_cpu_time_us":2133,"raft.run_wall_time_us":86095,"spinlock_wait_cycles":5568896,"thread_start_us":303354,"threads_started":2,"wal-append.queue_time_us":171622}
I20260709 13:02:25.018651  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.009490  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1925) took 1492 ms. Trace:
I20260709 13:02:25.019338  1609 rpcz_store.cc:276] 0709 13:02:23.477465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.545190 (+1067725us) service_pool.cc:224] Handling call
0709 13:02:24.545585 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:24.672174 (+126589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.672224 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:24.680609 (+  8385us) log.cc:844] Serialized 52 byte log entry
0709 13:02:24.769544 (+ 88935us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:24.795927 (+ 26383us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.938996 (+143069us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b18002e1320. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287 00007fd02eb23208
0709 13:02:24.939207 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.939294 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.975900 (+ 36606us) raft_consensus.cc:1685] finished
0709 13:02:24.991852 (+ 15952us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.991999 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69809,"prepare.queue_time_us":31635,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":195245,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":6473,"spinlock_wait_cycles":9997952,"thread_start_us":66022,"threads_started":1,"wal-append.queue_time_us":137454}
I20260709 13:02:25.024205  1540 rpcz_store.cc:276] 0709 13:02:23.518057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.340154 (+822097us) service_pool.cc:224] Handling call
0709 13:02:24.340411 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.759468 (+419057us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.759502 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.760127 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.925322 (+165195us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:24.925356 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.925417 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.009221 (+ 83804us) raft_consensus.cc:1685] finished
0709 13:02:25.009249 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.009425 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":419666,"raft.queue_time_us":454181,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":12259,"thread_start_us":122260,"threads_started":1,"wal-append.queue_time_us":218010}
I20260709 13:02:25.022691  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.019228  1536 rpcz_store.cc:276] 0709 13:02:23.483293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.293178 (+809885us) service_pool.cc:224] Handling call
0709 13:02:24.293414 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.753014 (+459600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.753041 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.753552 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.900715 (+147163us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.900777 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.900885 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.989876 (+ 88991us) raft_consensus.cc:1685] finished
0709 13:02:24.989900 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.990094 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":475965,"raft.queue_time_us":480203,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":37144,"thread_start_us":146470,"threads_started":1,"wal-append.queue_time_us":224948}
I20260709 13:02:25.049320  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 499) took 1151 ms. Trace:
I20260709 13:02:25.049397  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 494) took 1719 ms. Trace:
I20260709 13:02:25.022185  1615 rpcz_store.cc:276] 0709 13:02:23.446137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.306119 (+859982us) service_pool.cc:224] Handling call
0709 13:02:24.307613 (+  1494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.581799 (+274186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.581851 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.586833 (+  4982us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.682348 (+ 95515us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.712902 (+ 30554us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.716109 (+  3207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.716371 (+   262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:24.992638 (+276267us) raft_consensus.cc:1685] finished
0709 13:02:24.992658 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:24.992772 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":242807,"prepare.queue_time_us":33301,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":281405,"spinlock_wait_cycles":26070528,"thread_start_us":69948,"threads_started":1,"wal-append.queue_time_us":197697}
I20260709 13:02:25.025601  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:25.037323  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:25.047662  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:25.048105  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1939) took 1328 ms. Trace:
I20260709 13:02:25.049743  1536 rpcz_store.cc:276] 0709 13:02:23.898020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.048704 (+1150684us) service_pool.cc:224] Handling call
0709 13:02:25.048952 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.049085 (+   133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.049100 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.049130 (+    30us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:25.049150 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.049186 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.049276 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:25.050969  1537 rpcz_store.cc:276] 0709 13:02:23.734746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.967123 (+1232377us) service_pool.cc:224] Handling call
0709 13:02:24.967685 (+   562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.047690 (+ 80005us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.047723 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.047770 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:25.047807 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.047875 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.048012 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72462,"raft.queue_time_us":77280}
I20260709 13:02:25.053109  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.049976  1535 rpcz_store.cc:276] 0709 13:02:23.329761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.329918 (+   157us) service_pool.cc:224] Handling call
0709 13:02:23.330243 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:23.378480 (+ 48237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.049076 (+1670596us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b5400400e54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:25.049320 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107805952}
I20260709 13:02:25.054819  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:25.023581  4786 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.670s	user 0.016s	sys 0.001s
I20260709 13:02:25.058909  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:25.065271  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:24.989919  4902 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:25.075950  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:24.991959  4866 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:24.934244  4859 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:25.082319  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 91031.5us
I20260709 13:02:24.988444  4874 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.061347  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.064558  4864 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.087826  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:25.066337  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:24.991712  4972 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:25.025854  4842 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.038203  4958 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:25.082285  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1927) took 1525 ms. Trace:
I20260709 13:02:25.061082  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.023524  4855 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:02:24.987947  4956 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:02:24.986224  4775 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:24.989472  4960 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:25.088645  1535 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.074733  4608 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.064637  4785 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:25.083046  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:25.130263  1505 leader_election.cc:336] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.586s (SENT)
W20260709 13:02:25.234464  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 104237us
I20260709 13:02:25.081789  4440 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:25.087805  4908 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:25.177224  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 116273us
I20260709 13:02:25.279210  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1941) took 1307 ms. Trace:
I20260709 13:02:25.176520  1541 rpcz_store.cc:276] 0709 13:02:23.556581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.757625 (+1201044us) service_pool.cc:224] Handling call
0709 13:02:24.757972 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:24.776422 (+ 18450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.776451 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:24.802766 (+ 26315us) log.cc:844] Serialized 52 byte log entry
0709 13:02:24.967924 (+165158us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:25.079162 (+111238us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.081926 (+  2764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.082005 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.082047 (+    42us) raft_consensus.cc:1685] finished
0709 13:02:25.082060 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.082227 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79795,"raft.queue_time_us":61417,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":8641,"thread_start_us":213129,"threads_started":2,"wal-append.queue_time_us":172257}
I20260709 13:02:25.280701  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.282325  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.283104  1541 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:25.279646  1536 rpcz_store.cc:276] 0709 13:02:23.971466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.051503 (+1080037us) service_pool.cc:224] Handling call
0709 13:02:25.051796 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.052015 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:25.101521 (+ 49506us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.278857 (+177336us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.278913 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.278961 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.279023 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.279153 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":200776,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"thread_start_us":197423,"threads_started":2}
I20260709 13:02:25.286994  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.169184  4866 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.100811  4842 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.188180  4877 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:25.188550  2362 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:25.189213  4974 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.198117  4968 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:25.198764  4979 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:02:25.199105  4973 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:25.199573  4970 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.200950  4952 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.202286  4971 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:25.205530  4903 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 1.552s	user 0.002s	sys 0.013s
I20260709 13:02:25.176564  4958 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:25.235627  1505 leader_election.cc:336] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.648s (SENT)
I20260709 13:02:25.187435  4864 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:25.287788  1536 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:25.346141  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.182790  4972 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.362345  4972 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.314967  4785 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:25.342377  4125 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:25.364962  4972 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:25.291217  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:25.294696  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 206367us
I20260709 13:02:25.303102  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.367437  1609 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:02:25.368572  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.303550  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.304836  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.306038  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.306046  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:25.294138  4868 consensus_meta.cc:287] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.003s
I20260709 13:02:25.309741  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1933) took 1610 ms. Trace:
I20260709 13:02:25.286464  4841 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:25.315505  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1931) took 1639 ms. Trace:
I20260709 13:02:25.290686  4440 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:25.293479  4842 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.337558  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.339015  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.299544  4955 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.360999  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.361619  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:25.369606  1613 raft_consensus.cc:2410] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:25.373224  1535 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:25.292228  4908 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.396996  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.304811  4877 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:25.302469  4968 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.392228  1538 rpcz_store.cc:276] 0709 13:02:23.676583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.892709 (+1216126us) service_pool.cc:224] Handling call
0709 13:02:24.911968 (+ 19259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.912210 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:25.058226 (+146016us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.315121 (+256895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.315182 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.315236 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.315307 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.315442 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45740,"prepare.queue_time_us":216308,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":2786,"raft.queue_time_us":19864,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6540,"thread_start_us":389760,"threads_started":2}
I20260709 13:02:25.419865  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.424101  1541 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:25.510527  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 274927us
W20260709 13:02:25.511480  1505 leader_election.cc:336] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.686s (SENT)
I20260709 13:02:25.511992  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:25.433981  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.335014  4971 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.474320  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.299147  4429 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:25.474826  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.365346  4125 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.346683  4958 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.473646  1608 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:25.366794  4864 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.483819  1535 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:25.347232  4876 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:25.496449  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.625154  1535 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:25.428519  4868 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:25.474896  1614 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:25.484414  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.420779  4841 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:25.392077  1534 rpcz_store.cc:276] 0709 13:02:23.699582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.918659 (+1219077us) service_pool.cc:224] Handling call
0709 13:02:24.921091 (+  2432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:24.921370 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:25.086469 (+165099us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.309284 (+222815us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.309363 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.309424 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.309508 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.309659 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54796,"prepare.queue_time_us":251819,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":10064,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":25816,"thread_start_us":379043,"threads_started":2,"wal-append.queue_time_us":275382}
I20260709 13:02:25.514081  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.510174  1611 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:25.429059  4800 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:25.517225  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.497208  4956 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:25.299437  4866 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.484514  4862 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:25.336071  4970 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.315699  4973 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:25.607041  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.483924  4972 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.519732  4971 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.525501  4775 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:25.485862  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 87699.6us
W20260709 13:02:25.551060  4903 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:25.633159  1613 raft_consensus.cc:2368] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:25.515208  4968 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.650964  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.635646  1535 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.678257  1535 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.686381  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.688431  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.687433  1615 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:25.668563  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:25.663019  1505 leader_election.cc:336] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.694s (SENT)
I20260709 13:02:25.498467  4955 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.704787  1609 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:25.705727  4841 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.634841  4864 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:25.694796  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:25.712174  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 49225.2us
W20260709 13:02:25.713184  1505 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.766s (SENT)
I20260709 13:02:25.713601  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.697614  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.716475  1535 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:02:25.716856  1535 pending_rounds.cc:85] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 3
I20260709 13:02:25.706211  4955 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:25.714298  4986 log.cc:927] Time spent T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:02:25.719458  4973 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:25.720091  4973 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:25.720795  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1934) took 2002 ms. Trace:
I20260709 13:02:25.655687  4877 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.726922  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.727842  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.728478  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.717072  1535 pending_rounds.cc:107] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:02:25.707150  4841 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.716240  4775 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.718947  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.695218  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.715494  4448 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.721940  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1918) took 2342 ms. Trace:
I20260709 13:02:25.730806  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.721194  1533 rpcz_store.cc:276] 0709 13:02:23.718427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.924528 (+1206101us) service_pool.cc:224] Handling call
0709 13:02:24.924894 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.925273 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.925299 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.964085 (+ 38786us) log.cc:844] Serialized 26 byte log entry
0709 13:02:25.138046 (+173961us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:25.138096 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.138183 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.720566 (+582383us) raft_consensus.cc:1685] finished
0709 13:02:25.720589 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.720733 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23370,"raft.queue_time_us":1708,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":132,"thread_start_us":134203,"threads_started":1,"wal-append.queue_time_us":412922}
I20260709 13:02:25.731024  1615 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:25.732120  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.732391  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.734014  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.734555  4859 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.734982  1615 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:25.735939  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.736279  4448 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.737740  1608 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:25.738523  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.732780  1538 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:25.739383  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.740216  1534 raft_consensus.cc:2410] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:25.711894  4785 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:25.731143  1610 rpcz_store.cc:276] 0709 13:02:23.370433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.371563 (+  1130us) service_pool.cc:224] Handling call
0709 13:02:23.376643 (+  5080us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:23.377016 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:23.377045 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:23.381911 (+  4866us) log.cc:844] Serialized 26 byte log entry
0709 13:02:23.496936 (+115025us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:23.591628 (+ 94692us) log.cc:844] Serialized 14 byte log entry
0709 13:02:23.592828 (+  1200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:23.592934 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.205023 (+1612089us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b240028a408. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b8a19c4 00007fd02b89facb 00007fd02ba5adc9 00007fd02ba5aa55 00007fd02ba5a09d 00007fd02e68c10e 00007fd02e6a388c 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221
0709 13:02:25.698689 (+493666us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b2c000b8068. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02cdb8291 00007fd02cdd30ca 00007fd02eb014ad 00007fd02eb08f8e 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:02:25.712784 (+ 14095us) raft_consensus.cc:1685] finished
0709 13:02:25.712801 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:25.712955 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2042,"prepare.queue_time_us":691676,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":8295,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":7393,"spinlock_wait_cycles":295598336,"thread_start_us":208631,"threads_started":2,"wal-append.queue_time_us":214852}
I20260709 13:02:25.742791  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.731447  1613 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:25.742929  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:25.743947  1534 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.744253  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.744823  1613 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:25.745548  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.745651  1580 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.746117  1613 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:25.746994  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.729499  1535 raft_consensus.cc:2889] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:25.747818  1613 raft_consensus.cc:2410] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:02:25.736123  4972 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:02:25.748615  4650 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:25.749181  1615 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:25.747851  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.749486  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.753633  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.755101  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.755779  1533 raft_consensus.cc:2368] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:25.661031  4956 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:25.757014  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.752004  1610 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:25.768262  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.680437  4440 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.783102  1610 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:25.774617  1615 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:25.757787  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:25.790642  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.738528  4448 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:25.776227  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 106282us
I20260709 13:02:25.797192  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.806455  1533 raft_consensus.cc:2393] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:25.750660  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.811308  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:25.742566  4973 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.758636  4955 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.804210  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.812099  1615 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.819245  1538 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:25.812644  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:25.812865  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:25.816665  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:25.821736  1610 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:25.823839  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.800417  4650 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:25.817152  4429 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:25.826045  4960 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.865517  4956 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:25.832659  4775 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.833280  4998 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:25.867137  4998 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.866863  4775 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.867515  4998 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.840967  4866 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:25.868804  4868 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:25.869073  4775 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:25.828879  4650 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:25.870886  4650 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.828922  4785 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.838287  4448 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.873697  4785 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.848937  4125 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:25.883368  1534 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:25.830242  4970 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:25.889611  1615 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:25.891176  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.892635  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.853981  1610 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:25.850247  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:25.819815  4971 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:25.897846  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.902153  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:25.848047  4973 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:25.891994  1615 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:25.875954  4785 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:25.889684  4965 consensus_meta.cc:287] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.928s	user 0.013s	sys 0.000s
I20260709 13:02:25.903519  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:25.905061  1534 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.912854  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:25.913708  1533 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:25.914003  1610 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:25.909396  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.914971  1615 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:25.921103  1536 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:25.917028  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 93300.9us
I20260709 13:02:25.922529  1580 leader_election.cc:400] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:25.922857  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:25.923448  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:25.925904  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:25.907359  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:25.930466  1534 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:25.931008  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:25.904100  4842 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.932559  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:25.934603  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 108058us
I20260709 13:02:25.937809  1615 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:25.937341  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:25.938494  5004 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:25.937366  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:25.946987  2362 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:25.948359  1610 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:25.927076  4965 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:25.954545  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:25.921429  4973 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.964170  1615 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:25.986930  1579 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:25.955295  4650 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:25.955837  4956 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:25.964601  4841 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:25.991794  1534 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.996294  4672 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:25.991891  4956 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.002691  4956 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:25.991745  4965 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:26.006714  4965 raft_consensus.cc:697] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:26.014998  1541 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:02:26.024336  4990 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.527s	user 0.005s	sys 0.000s
I20260709 13:02:26.037331  4894 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:26.037930  4894 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:26.037930  4965 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.038931  4894 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:26.052383  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 97937.3us
I20260709 13:02:26.053050  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:26.053544  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:26.054148  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.057688  1614 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:26.073729  1615 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:26.070133  1534 raft_consensus.cc:2410] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:26.060707  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.078941  4662 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:26.080775  4775 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:26.081265  4775 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.081692  4775 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.083727  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1932) took 2637 ms. Trace:
I20260709 13:02:26.075429  4970 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.084520  4842 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.085232  4842 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.085776  4842 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.087127  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 505) took 1091 ms. Trace:
I20260709 13:02:26.088794  4844 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.089275  4844 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.091212  4844 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.087574  1537 rpcz_store.cc:276] 0709 13:02:24.996189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.081275 (+ 85086us) service_pool.cc:224] Handling call
0709 13:02:25.082250 (+   975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.686697 (+604447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.686731 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.686794 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:25.686851 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.086861 (+400010us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400400954. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:26.086910 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.087064 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1389776128}
I20260709 13:02:26.095350  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:26.084177  1616 rpcz_store.cc:276] 0709 13:02:23.445882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.303192 (+857310us) service_pool.cc:224] Handling call
0709 13:02:24.303623 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:24.553070 (+249447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.553117 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:24.576365 (+ 23248us) log.cc:844] Serialized 26 byte log entry
0709 13:02:24.787059 (+210694us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.814468 (+ 27409us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.948213 (+133745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.948297 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:25.720108 (+771811us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b48000f15d8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd033a31aa1 00007fd033a28b37 00007fd033a289ca 00007fd033b2026f 00007fd033b1ff37 00007fd033b3455c 00007fd033b34508 00007fd033b34488 00007fd033b34443 00007fd033b336ec 00007fd032a5da96
0709 13:02:26.082541 (+362433us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b240028a498. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b8a19c4 00007fd02b89facb 00007fd02ba5adc9 00007fd02ba5aa55 00007fd02ba59fb0 00007fd02e6d0488 00007fd02e6d0be8 00007fd02e6a8398 00007fd02e6a376a 00007fd02e6a2bb6
0709 13:02:26.083510 (+   969us) raft_consensus.cc:1685] finished
0709 13:02:26.083530 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.083667 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1266672,"prepare.queue_time_us":27451,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":3064,"raft.queue_time_us":410247,"raft.run_cpu_time_us":10242,"raft.run_wall_time_us":1150276,"spinlock_wait_cycles":68355840,"thread_start_us":186420,"threads_started":1,"wal-append.queue_time_us":284360}
I20260709 13:02:26.097644  1616 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:26.075559  4957 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:26.105101  4650 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.109756  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:26.111012  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:26.111613  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51005.2us
I20260709 13:02:26.113029  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.113785  4998 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.115754  2369 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:26.116408  4970 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:26.116786  4970 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.117151  4970 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.118028  4968 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.119531  1681 raft_consensus.cc:2393] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:26.059880  4999 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.072608  4854 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.120558  4999 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.121170  4854 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.121899  4864 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.122779  4999 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.123437  4854 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.076531  4785 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.124301  4785 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.124708  4785 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.126987  1616 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:02:26.127920  1610 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.128422  1616 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:26.039933  4894 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.114368  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:26.111562  1614 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:26.132776  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:26.134305  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:26.135336  4991 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.135850  4991 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.135670  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.136415  4991 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.137377  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.138265  4608 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:26.138695  4608 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:26.139089  4608 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.140101  4862 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:26.140522  4862 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.140844  4862 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:26.144305  4866 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:26.144656  4876 consensus_queue.cc:1059] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:26.130623  4957 raft_consensus.cc:697] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:26.145684  4866 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:26.146047  4866 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:26.145993  4957 consensus_queue.cc:237] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.146924  4866 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.148904  4973 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.144225  4974 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:26.123888  4864 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.115939  4998 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.104063  4971 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.156580  4842 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:26.167764  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.168278  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 98800.1us
I20260709 13:02:26.173259  4608 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.177024  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.177273  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:26.174337  4984 log.cc:927] Time spent T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.036s	user 0.004s	sys 0.005s
I20260709 13:02:26.185889  1614 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:26.186591  4841 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:26.187098  4841 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:26.193207  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:26.195340  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.194075  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.199308  1688 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.165691  4968 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.204768  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.210702  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.210911  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.213560  4440 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:26.214211  4440 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.216025  4949 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:26.188606  4842 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:02:26.219272  4842 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:26.219666  4842 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:26.220546  4842 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.221771  4842 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.221841  4956 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:26.224982  4927 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.957s	user 0.004s	sys 0.011s
I20260709 13:02:26.225128  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1929) took 2615 ms. Trace:
I20260709 13:02:26.225610  1532 rpcz_store.cc:276] 0709 13:02:23.610203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.824061 (+1213858us) service_pool.cc:224] Handling call
0709 13:02:24.894350 (+ 70289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:24.895268 (+   918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:24.895327 (+    59us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:24.896124 (+   797us) log.cc:844] Serialized 52 byte log entry
0709 13:02:24.982539 (+ 86415us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:24.982601 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:24.982725 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.173664 (+1190939us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:26.224801 (+ 51137us) raft_consensus.cc:1685] finished
0709 13:02:26.224823 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.225057 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8540,"raft.queue_time_us":6613,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":8019,"spinlock_wait_cycles":21888256,"thread_start_us":23147,"threads_started":1,"wal-append.queue_time_us":164670}
I20260709 13:02:26.188025  4841 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.228230  4854 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:26.230264  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1932) took 2547 ms. Trace:
I20260709 13:02:26.231163  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1940) took 2351 ms. Trace:
I20260709 13:02:26.237534  1540 rpcz_store.cc:276] 0709 13:02:23.880427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.036543 (+1156116us) service_pool.cc:224] Handling call
0709 13:02:25.036835 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.129973 (+ 93138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:25.130003 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.130043 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:25.130074 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.230937 (+1100863us) spinlock_profiling.cc:243] Waited 92.1 ms on lock 0x7b5400099a54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:26.230986 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.231106 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211803008}
I20260709 13:02:26.237289  1539 rpcz_store.cc:276] 0709 13:02:23.682988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.908070 (+1225082us) service_pool.cc:224] Handling call
0709 13:02:24.908520 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:25.028387 (+119867us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:25.083965 (+ 55578us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.171926 (+ 87961us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:25.171984 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:25.172051 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:25.682533 (+510482us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b18003ff280. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:26.229996 (+547463us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001fb3d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:26.230044 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.230197 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11765,"prepare.queue_time_us":224223,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":44,"raft.queue_time_us":2683,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5858,"spinlock_wait_cycles":324322432,"thread_start_us":141955,"threads_started":2,"wal-append.queue_time_us":104801}
I20260709 13:02:26.233445  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:26.233812  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 94152.1us
I20260709 13:02:26.239732  2368 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:26.240131  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.241719  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:26.161237  4775 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.183142  4864 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:26.244851  1682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35722 (request call id 467) took 1705 ms (client timeout 1885 ms). Trace:
I20260709 13:02:26.245710  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:26.247113  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.263060  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.263242  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:26.248354  1682 rpcz_store.cc:269] 0709 13:02:24.539355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.539621 (+   266us) service_pool.cc:224] Handling call
0709 13:02:26.244642 (+1705021us) spinlock_profiling.cc:243] Waited 86.5 ms on lock 0x7b54002d6c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:26.244778 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198895488}
I20260709 13:02:26.264894  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.265640  1539 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:26.256588  4608 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.270390  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:26.268954  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.249094  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:26.273017  2362 raft_consensus.cc:2393] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 7: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:26.243101  4557 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.273644  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.275003  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1949) took 1188 ms. Trace:
I20260709 13:02:26.275421  1536 rpcz_store.cc:276] 0709 13:02:25.086596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.361273 (+274677us) service_pool.cc:224] Handling call
0709 13:02:26.274816 (+913543us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54001df6d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:26.274944 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007379328}
I20260709 13:02:26.276731  4785 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.277520  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.278204  1687 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.278919  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:26.258026  4958 consensus_meta.cc:287] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.008s
I20260709 13:02:26.279286  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.276894  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:26.256951  4971 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:02:26.259716  5005 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.242s	user 0.002s	sys 0.001s
I20260709 13:02:26.256664  4440 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:26.279904  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.277154  1683 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:26.283464  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.284368  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:26.281944  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.280376  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.297461  1682 raft_consensus.cc:2368] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
I20260709 13:02:26.285310  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:26.297963  1536 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:26.298137  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 82399.4us
I20260709 13:02:26.291497  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.268451  4974 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:26.294983  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.295225  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.252530  4653 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:26.293515  4971 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:26.304921  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.305116  4971 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:26.305280  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.303772  1541 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:26.306658  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:26.307286  1541 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.299093  1532 raft_consensus.cc:2410] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:02:26.308341  4557 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:26.308935  4557 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.243232  4874 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.311076  4557 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.312296  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.299404  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:26.300149  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.300354  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:26.313503  1538 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:26.300721  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.301200  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:26.302948  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:26.315714  1533 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.304535  1537 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:26.317217  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.317672  1654 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:26.300312  4878 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.247531  4854 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.293752  4958 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.355397  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1644) took 1039 ms. Trace:
I20260709 13:02:26.355785  1609 rpcz_store.cc:276] 0709 13:02:25.316373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.516950 (+200577us) service_pool.cc:224] Handling call
0709 13:02:26.355207 (+838257us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b540014afd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:26.355314 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116817152}
I20260709 13:02:26.356236  1685 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:26.328514  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.357564  4854 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.358214  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 475) took 1182 ms. Trace:
I20260709 13:02:26.359438  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:26.327068  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:26.361060  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.361181  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:26.331835  1536 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:26.332011  4785 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.322897  4440 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:26.304884  4653 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.323161  4956 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.301426  4862 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.269435  4864 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.349177  4775 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.349675  5011 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.303385  4974 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.398663  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.331833  4878 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:26.353685  5012 log.cc:927] Time spent T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:02:26.354703  1541 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:26.369535  4557 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:26.413589  4557 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.414222  4557 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.358597  1685 rpcz_store.cc:276] 0709 13:02:25.176420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.176643 (+   223us) service_pool.cc:224] Handling call
0709 13:02:25.178167 (+  1524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:26.356635 (+1178468us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.358003 (+  1368us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400118ad4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:26.358154 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2709135104}
I20260709 13:02:26.372468  4894 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:26.416401  4866 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:26.416620  4894 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:26.359210  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.417732  4894 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.370800  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:26.390718  5013 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:02:26.385975  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.332640  4993 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.421833  4862 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.422622  1539 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.365020  4642 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.363550  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.404170  1540 raft_consensus.cc:2368] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:26.389704  4998 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:02:26.404989  4786 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:26.406584  4653 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.408207  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.409684  4864 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.410148  4854 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:26.375151  4440 raft_consensus.cc:697] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:26.391968  4874 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.404446  4878 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.425976  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:26.426586  1533 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:26.494720  1533 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:26.431600  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.496702  1539 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:26.496807  1538 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:26.431614  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.434839  4869 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:02:26.435743  5008 log.cc:927] Time spent T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.431s	user 0.002s	sys 0.000s
I20260709 13:02:26.436662  2369 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 227) took 1390 ms. Trace:
I20260709 13:02:26.506431  2369 rpcz_store.cc:276] 0709 13:02:25.046374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:25.046551 (+   177us) service_pool.cc:224] Handling call
0709 13:02:26.436451 (+1389900us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001a6b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:26.436594 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448879488}
I20260709 13:02:26.439122  4991 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.401891  4974 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.467981  5002 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:26.471391  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.471587  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.441919  4842 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:26.450870  4642 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.444465  4876 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.474606  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48524
I20260709 13:02:26.551931  1616 raft_consensus.cc:606] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Received request to transfer leadership
I20260709 13:02:26.527405  1533 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [6.4-9.6]
W20260709 13:02:26.478749  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.485302  1504 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:26.553681  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 68447.5us
I20260709 13:02:26.554587  1504 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:26.489914  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.554010  1685 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:26.559357  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.490862  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:26.560727  1537 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.500298  1610 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:02:26.500167  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 74300.4us
I20260709 13:02:26.505465  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1936) took 3034 ms. Trace:
I20260709 13:02:26.568259  1607 rpcz_store.cc:276] 0709 13:02:23.470723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:24.534571 (+1063848us) service_pool.cc:224] Handling call
0709 13:02:24.538356 (+  3785us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:24.587100 (+ 48744us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:24.594163 (+  7063us) log.cc:844] Serialized 14 byte log entry
0709 13:02:24.808663 (+214500us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:24.809318 (+   655us) log.cc:844] Serialized 52 byte log entry
0709 13:02:24.809554 (+   236us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:24.964675 (+155121us) log.cc:844] Serialized 14 byte log entry
0709 13:02:25.715184 (+750509us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b18002e12c0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:26.504929 (+789745us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5400349ca0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea83733 00007fd02eb08dbf 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c
0709 13:02:26.505011 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:26.505140 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:26.505193 (+    53us) raft_consensus.cc:1685] finished
0709 13:02:26.505211 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:26.505386 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79231,"prepare.queue_time_us":901626,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":4027,"raft.queue_time_us":127365,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":239,"spinlock_wait_cycles":28641920,"thread_start_us":330858,"threads_started":3,"wal-append.queue_time_us":78426,"wal-append.run_cpu_time_us":11325,"wal-append.run_wall_time_us":1316882}
I20260709 13:02:26.571659  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.572525  1539 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:26.573995  1580 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.450299  4968 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:26.440817  4970 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.508193  1536 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:02:26.457573  4908 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.401614  5011 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.552523  1616 raft_consensus.cc:614] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:26.476140  1653 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:26.575615  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:26.581508  2369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.480798  4958 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.508550  4862 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:26.586076  1534 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:02:26.553232  4965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.024s	sys 0.007s
I20260709 13:02:26.598153  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:26.590230  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 114208us
W20260709 13:02:26.599133  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.600164  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.506294  4429 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:02:26.506590  4895 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.597908  2369 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:26.685784  2364 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:26.678467  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:26.552232  5002 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:26.721637  2363 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:26.705502  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 302284us
I20260709 13:02:26.611804  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:02:26.677584  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:26.702457  1537 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:26.689101  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.604411  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.587201  4775 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.589035  4864 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:26.513818  4854 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.752753  4854 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.752777  4662 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:26.753340  4854 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.754002  4662 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.754123  4854 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.755292  4950 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:26.755694  4950 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:26.756980  4854 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.756578  4950 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.608402  4999 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.758699  4999 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.597612  4998 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:26.591120  4968 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.762205  4968 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.754549  4662 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.688840  4363 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.777387  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:26.749747  5002 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:26.715349  4965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.033s	sys 0.008s
I20260709 13:02:26.507462  4874 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.590680  4972 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:26.784490  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:26.783620  1579 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:26.779196  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 222745us
I20260709 13:02:26.791697  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.792841  1681 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
W20260709 13:02:26.767663  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 216474us
I20260709 13:02:26.788529  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:26.768620  4950 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.789882  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.582155  4876 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.795063  1685 raft_consensus.cc:606] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:26.581363  4842 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.726677  4862 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.824613  4862 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:26.795137  4315 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:26.834535  4315 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:26.835057  4315 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:26.789856  4958 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:02:26.849892  4642 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.853082  5011 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.856730  4842 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:26.861822  4874 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.865872  4557 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.870251  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.804805  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.872258  4842 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:26.877506  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 72951.4us
W20260709 13:02:26.891528  5015 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.116s	user 0.002s	sys 0.001s
I20260709 13:02:26.893415  1437 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 10, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:02:26.895658  5020 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.158s	user 0.000s	sys 0.003s
I20260709 13:02:26.895130  1437 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 9 to 10, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:26.897107  1437 catalog_manager.cc:5697] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.898519  1437 catalog_manager.cc:5697] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:26.797154  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:26.904743  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 169250us
I20260709 13:02:26.808710  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.810070  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.810844  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:26.811566  4784 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.786808  4894 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:26.906263  1504 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.804971  4956 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:02:26.801574  5002 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.785351  4864 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:26.719754  4895 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.710134  4878 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.676054  4440 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.816906  4971 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:26.817378  4841 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:26.784960  4363 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:26.818684  4970 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:26.819052  5016 log.cc:927] Time spent T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:02:26.820425  4495 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:26.822075  4991 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.797848  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.814603  4876 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.906438  2367 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:26.907169  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:26.804291  4968 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.909158  1504 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.910084  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.913095  1610 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:26.913558  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:26.914604  1615 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:26.914885  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:26.914919  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:26.899940  1437 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.920161  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.977128  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.965138  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.955991  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:26.925168  1533 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:26.943631  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.082847  1537 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:27.083257  1610 pending_rounds.cc:85] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 3
W20260709 13:02:27.084151  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 175076us
I20260709 13:02:27.084456  1610 pending_rounds.cc:107] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:27.085067  1610 raft_consensus.cc:2889] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:27.085302  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.085557  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:26.932519  1608 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:02:26.985723  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.086230  1614 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:26.984889  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.089197  1686 raft_consensus.cc:2393] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:27.090250  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 490229us
I20260709 13:02:27.090849  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.093389  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.094194  1504 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.904917  4557 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:26.985538  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.096599  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.081796  1688 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:27.100651  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.916134  4866 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:27.102397  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 146101us
I20260709 13:02:27.109531  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.094375  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:26.916374  4874 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:27.105273  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 185220us
I20260709 13:02:27.111116  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:26.911327  4842 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:26.934640  4672 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:27.122364  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.123884  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.096727  5011 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:27.128736  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.089028  4965 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:27.102594  4876 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:26.932335  4890 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.182s
I20260709 13:02:26.925858  5017 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.189s
I20260709 13:02:26.916792  4784 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.114210  5022 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:26.934607  4949 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.185s
I20260709 13:02:27.110486  4991 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.121778  4999 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:27.114447  4968 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.124541  4786 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:02:27.117777  5023 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.118067  4672 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:27.128921  2362 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:27.137483  1504 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:27.194540  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 57099.2us
I20260709 13:02:27.195859  1504 leader_election.cc:400] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
I20260709 13:02:27.196321  1504 leader_election.cc:403] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:27.136096  4965 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:27.197223  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.120494  4866 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.201531  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.206504  1504 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:27.113106  4862 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.208269  4970 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.209106  4775 raft_consensus.cc:2764] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:27.195516  4949 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:27.212453  4874 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.212785  4972 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:27.204852  4557 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.213883  4662 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:26.942622  4864 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.217244  4859 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:27.218135  4965 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:27.220280  5019 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.471s	user 0.004s	sys 0.002s
I20260709 13:02:27.131850  4842 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.224150  4784 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:27.225312  5024 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:02:27.228385  1536 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:27.377229  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:27.339960  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:27.229234  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 119518us
I20260709 13:02:27.230448  1539 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:27.390638  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:27.391328  1539 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:27.234131  1535 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:27.233413  2367 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:27.248526  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:27.394232  1532 raft_consensus.cc:2393] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 7: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
W20260709 13:02:27.211851  5018 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.451s	user 0.001s	sys 0.004s
I20260709 13:02:27.192925  5011 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.193392  5029 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:27.254498  1538 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.188927  4876 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:27.261158  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 135697us
I20260709 13:02:27.244143  5025 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.234855  4991 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:27.262724  4878 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:27.422775  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 294158us
I20260709 13:02:27.245522  5023 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:27.319062  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.253796  4949 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:27.334419  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.335191  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.336053  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.336423  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:27.428198  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 109284us
I20260709 13:02:27.428855  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.429004  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.430069  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.430204  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.430544  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.336155  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.335484  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.337802  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.339260  4894 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.432444  4894 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.435297  4894 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:27.348515  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.309810  4672 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.354841  4842 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.436344  1683 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:27.436942  4842 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.324292  4557 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:27.311168  4859 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:27.356235  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.358584  4971 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.303007  4775 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:27.368889  4862 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:27.374765  4315 consensus_meta.cc:287] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.003s
I20260709 13:02:27.395094  1539 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:27.387897  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.399672  1535 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:27.401167  1536 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:27.408058  1653 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:27.419691  2329 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.420617  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:27.335246  4972 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:27.461171  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 53280.5us
I20260709 13:02:27.466648  1612 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:27.460711  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:27.471421  1609 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:27.397716  4653 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:27.442548  1689 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:27.445719  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.410372  5022 raft_consensus.cc:697] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:27.427786  4974 consensus_meta.cc:287] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.874s	user 0.011s	sys 0.002s
I20260709 13:02:27.451049  4557 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:27.423702  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.472884  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:27.476002  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 88169.6us
I20260709 13:02:27.493741  1504 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:27.495223  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.474947  1607 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:02:27.478691  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:27.474831  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 55245us
I20260709 13:02:27.498709  1609 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:27.418509  5025 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:27.500516  5025 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.485313  1613 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:27.504510  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:27.415103  5011 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.508610  5011 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.428273  5028 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:02:27.512447  5023 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.490862  4945 raft_consensus.cc:3055] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:27.514776  4945 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:27.437810  4662 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:02:27.515683  4945 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.516646  4557 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.518548  4949 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.476143  5036 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:02:27.427511  4991 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.476603  4894 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:27.482107  4972 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.521198  4974 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.487124  4653 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:27.523491  4950 consensus_meta.cc:287] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
I20260709 13:02:27.426906  4890 consensus_queue.cc:1059] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:02:27.418817  4876 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:27.526993  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 103392us
I20260709 13:02:27.535934  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.458958  5038 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:27.473764  4866 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.533463  4895 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:27.516726  5007 log.cc:927] Time spent T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.510s	user 0.000s	sys 0.008s
I20260709 13:02:27.539400  5011 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.487380  4862 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:02:27.586398  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 92013.9us
I20260709 13:02:27.527093  4970 raft_consensus.cc:2764] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:27.646621  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:27.590704  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 134044us
I20260709 13:02:27.468817  4315 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.595086  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.491751  4971 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:27.460619  4775 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.578786  4945 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:27.545822  4878 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:27.608414  1541 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:27.587456  4949 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:27.651172  4890 raft_consensus.cc:3055] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:27.594506  4557 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.590189  4894 raft_consensus.cc:697] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:27.667887  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:27.668700  2365 raft_consensus.cc:2368] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
I20260709 13:02:27.667236  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.670073  1684 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:02:27.648115  4866 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:27.673146  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 178074us
I20260709 13:02:27.520746  5022 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.662299  4878 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.679984  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:27.657527  5033 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:27.656782  4950 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:02:27.665097  4890 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:27.695387  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 1871) took 1419 ms. Trace:
I20260709 13:02:27.726545  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:27.720635  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47840.8us
I20260709 13:02:27.728336  1504 leader_election.cc:400] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
I20260709 13:02:27.729717  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:27.753074  5048 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:27.663841  4971 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.753927  4894 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.691694  4878 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.699178  4862 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.764652  1540 rpcz_store.cc:276] 0709 13:02:26.269974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.270128 (+   154us) service_pool.cc:224] Handling call
0709 13:02:27.689110 (+1418982us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001e8554. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:27.689254 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305449344}
W20260709 13:02:27.777015  5053 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:02:27.784320  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:27.785342  1540 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:27.773514  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 89811.7us
I20260709 13:02:27.680255  4866 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.800495  5056 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:27.801155  5056 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:27.804772  4874 consensus_meta.cc:287] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.002s
I20260709 13:02:27.805367  4874 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
W20260709 13:02:27.811800  5049 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:02:27.814018  4653 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:27.817088  4315 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:27.770488  5037 log.cc:927] Time spent T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 13:02:27.779368  5045 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:02:27.761742  5054 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.828299  4874 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:27.829174  5052 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:02:27.829167  4874 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:27.839725  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 52000us
W20260709 13:02:27.841317  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.845640  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.848624  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:27.851058  1533 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:27.849552  4956 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:02:27.852979  4315 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:27.853688  4890 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.694994  4970 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:27.873235  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:27.880596  4877 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:27.882335  4315 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:27.882870  4315 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.883267  4315 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:27.887969  5017 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:27.851872  5056 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.791456  4862 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:27.900964  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.898321  4876 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.900647  5056 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:27.904534  5056 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.906775  5056 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:27.907817  4672 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.910446  4775 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:27.915539  2362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 332) took 1561 ms. Trace:
I20260709 13:02:27.918973  2362 rpcz_store.cc:276] 0709 13:02:26.354004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.354648 (+   644us) service_pool.cc:224] Handling call
0709 13:02:26.355040 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.202340 (+847300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.912776 (+710436us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400523354. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:27.915422 (+  2646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734337792}
I20260709 13:02:27.919826  4859 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.920228  4855 consensus_queue.cc:1059] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:27.921365  4859 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:27.922364  4841 consensus_meta.cc:287] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.005s
I20260709 13:02:27.923485  1539 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:02:27.924204  5036 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.917376  4971 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.926285  4495 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:27.927754  5025 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.933804  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:27.937136  5036 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.941574  4855 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:27.942607  4363 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.936314  4970 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.944605  4862 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.944548  4970 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.935984  4495 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:27.946835  4970 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.943841  4855 raft_consensus.cc:3055] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:27.950667  4855 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:27.952024  1532 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:27.953485  1532 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:27.951721  4855 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.956519  1614 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:27.957746  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.958595  5025 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.949441  4974 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.961294  4878 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:27.965106  4866 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:27.967880  4315 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:27.969265  5011 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:27.970201  1540 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:27.970427  4315 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:27.946602  4495 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:27.971251  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:27.979499  4878 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:27.980509  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:27.983574  1536 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:27.986706  1437 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 3 to 6, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.991430  2362 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:27.994220  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:27.989311  1437 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.005360  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:28.006937  2362 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:27.981154  4949 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:27.975267  4970 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:28.009282  1532 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:28.009177  5002 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:27.957132  4855 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.018373  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1964) took 1710 ms. Trace:
I20260709 13:02:28.021664  1534 rpcz_store.cc:276] 0709 13:02:26.307745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.441276 (+133531us) service_pool.cc:224] Handling call
0709 13:02:26.441650 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:26.721164 (+279514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.017945 (+1296781us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001fa9d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:28.018285 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":331605376}
I20260709 13:02:28.022610  1536 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
W20260709 13:02:27.980798  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47049.3us
I20260709 13:02:28.012616  4970 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.025274  1654 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:28.027094  1536 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:28.026999  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:28.013710  4949 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.030654  4894 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:28.034860  4315 consensus_queue.cc:1059] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:28.036839  4851 consensus_queue.cc:1059] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:28.045280  4894 raft_consensus.cc:3055] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:28.045950  4894 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:28.046032  4851 raft_consensus.cc:3055] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:28.046612  4851 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:28.041042  4998 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:28.053851  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.047495  4851 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.028206  4859 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.056617  4998 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:28.057320  4851 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.057246  4998 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:28.059947  4970 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.062341  4998 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:28.063723  4970 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.052423  4949 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.064255  4970 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.066619  4970 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.019410  5002 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:28.073565  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:28.077417  1537 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:28.092152  1534 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.047266  4894 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.096339  4894 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:28.097180  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 502239us
I20260709 13:02:28.098019  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.099390  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.091174  5002 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.102633  5002 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.103778  4859 consensus_queue.cc:1059] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:28.104830  4859 raft_consensus.cc:3055] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:28.105186  4859 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:28.106027  4859 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:28.108628  4991 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.109289  5044 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:28.109695  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 329101us
I20260709 13:02:28.110184  4842 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.110704  4653 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.111447  4653 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:28.111639  1504 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:28.111881  4653 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:28.112408  4653 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.113356  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.114017  1683 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:28.114933  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:28.108666  4859 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.113538  4968 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:28.118777  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.120965  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.109767  5044 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:28.128209  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.129356  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:28.129746  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.097410  4642 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:28.116925  5025 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:28.131137  5038 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.126688  4965 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:02:28.133826  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:28.134451  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60148 (request call id 26) took 1351 ms. Trace:
I20260709 13:02:28.132720  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.134861  1685 rpcz_store.cc:276] 0709 13:02:26.788218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.788372 (+   154us) service_pool.cc:224] Handling call
0709 13:02:28.132196 (+1343824us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540035d2a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea85520 00007fd02eb02652 00007fd033ad060a 00007fd02d0567d4 00007fd02d056762 00007fd02d056691 00007fd02d05660c 00007fd02d0558c2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:28.132480 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262755072}
I20260709 13:02:28.136129  1580 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:28.139128  1539 raft_consensus.cc:2393] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:28.141800  1534 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:28.125012  5023 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:28.129063  5044 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:28.143616  1534 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:28.134639  4895 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:28.124341  4968 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.148605  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:28.144811  5023 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:28.164516  5063 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.164777  5023 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.165182  5063 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.167609  5063 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.143151  4991 raft_consensus.cc:2764] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:02:28.142529  5029 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:28.138594  5025 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:28.207120  2370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 452) took 1295 ms. Trace:
I20260709 13:02:28.210502  4890 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:28.214356  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.164861  2362 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:28.176961  4895 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:28.230317  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.231164  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.660s (SENT) [suppressed 23 similar messages]
I20260709 13:02:28.207763  2370 rpcz_store.cc:276] 0709 13:02:26.911962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.912452 (+   490us) service_pool.cc:224] Handling call
0709 13:02:26.912767 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.114391 (+201624us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:27.417698 (+303307us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.653991 (+236293us) log.cc:844] Serialized 14 byte log entry
0709 13:02:27.654179 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:27.654223 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:27.654281 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:27.884194 (+229913us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b1800421360. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1
0709 13:02:27.885544 (+  1350us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b1800421360. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:28.206739 (+321195us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54004dd5d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:28.206810 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.207027 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47092,"prepare.queue_time_us":405210,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":4403,"raft.queue_time_us":48123,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":5387,"spinlock_wait_cycles":489033728,"thread_start_us":471653,"threads_started":2,"wal-append.queue_time_us":270101}
I20260709 13:02:28.221050  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:28.221851  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 85820.7us
I20260709 13:02:28.232578  1611 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.233156  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.252715  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.253724  1613 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
W20260709 13:02:28.256839  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.278693  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.280248  5029 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:28.292856  1653 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:28.262094  4851 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:28.335696  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1971) took 1108 ms. Trace:
I20260709 13:02:28.336249  1538 rpcz_store.cc:276] 0709 13:02:27.226797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.226944 (+   147us) service_pool.cc:224] Handling call
0709 13:02:27.233644 (+  6700us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.405559 (+171915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.332736 (+927177us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b54000befd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:28.335615 (+  2879us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45404416}
I20260709 13:02:28.285228  4949 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.339602  4949 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:28.342350  4842 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:28.343119  4842 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:28.343686  4653 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.344180  5029 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.343616  4842 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.348192  4842 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.347550  1437 catalog_manager.cc:5697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.349225  5036 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:28.349483  1437 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.353010  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:28.353278  5025 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:28.353699  1537 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:28.354071  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 1962) took 2046 ms. Trace:
I20260709 13:02:28.354472  1541 rpcz_store.cc:276] 0709 13:02:26.307132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:26.403436 (+ 96304us) service_pool.cc:224] Handling call
0709 13:02:26.403793 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.659580 (+1255787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.353811 (+694231us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540030b454. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:28.354003 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2770053376}
W20260709 13:02:28.354643  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.333170  5073 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:28.351189  1437 catalog_manager.cc:5697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:28.364161  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.367063  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:28.372467  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:28.373118  1538 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:28.306689  5017 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:28.433354  5023 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.376859  5017 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:28.442284  1611 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
I20260709 13:02:28.442607  1538 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:28.446374  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.331010  4895 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:28.529838  5084 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:02:28.531522  5017 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.533038  2370 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:02:28.544742  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 311724us
I20260709 13:02:28.555246  4653 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.555979  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:28.558539  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.436879  5076 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 13:02:28.558969  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.561194  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:28.551548  5070 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:02:28.574095  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.599732  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:28.600657  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:28.564857  4991 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.606094  5086 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:28.609417  1580 leader_election.cc:400] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:28.611160  1614 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:28.611122  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.611325  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.613807  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.592568  4968 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.615797  4653 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:28.600464  4896 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:28.617722  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.624872  1614 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:28.618541  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.618857  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.619402  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.626365  1613 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:28.626880  1609 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:28.631584  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.631989  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.632483  1609 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.633801  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.634618  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.647298  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.647406  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.649564  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.648242  1607 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:28.596762  5074 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.647459  1612 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.655355  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.655411  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.657760  1613 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.598196  4662 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.659327  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.662215  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.662858  1607 raft_consensus.cc:2410] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:28.663259  1616 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:28.606088  4890 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:28.669508  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.673465  1614 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:28.666626  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.673997  1609 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:28.674474  1615 raft_consensus.cc:2368] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
W20260709 13:02:28.656332  5085 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:02:28.656723  5070 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:02:28.614480  5023 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.681761  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.694666  1537 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:28.694891  1610 raft_consensus.cc:2410] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:28.616783  4972 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:28.684119  1613 raft_consensus.cc:2410] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:28.684285  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.691726  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 1986) took 1366 ms. Trace:
I20260709 13:02:28.697430  1533 rpcz_store.cc:276] 0709 13:02:27.325365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.380191 (+ 54826us) service_pool.cc:224] Handling call
0709 13:02:28.691548 (+1311357us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54001e7654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:28.691661 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804858240}
I20260709 13:02:28.648871  5086 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:28.700358  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:28.705325  5083 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:02:28.705350  1612 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:28.707713  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 1989) took 1251 ms. Trace:
I20260709 13:02:28.676659  4859 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.708541  4859 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.708254  1608 rpcz_store.cc:276] 0709 13:02:27.456672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.456830 (+   158us) service_pool.cc:224] Handling call
0709 13:02:27.483620 (+ 26790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:27.524943 (+ 41323us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:28.117815 (+592872us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b180019b820. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba18455 00007fd0325003c7 00007fd02eb129a7 00007fd02eb220bf 00007fd02eb22038
0709 13:02:28.250531 (+132716us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.297156 (+ 46625us) log.cc:844] Serialized 14 byte log entry
0709 13:02:28.569471 (+272315us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:28.570024 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:02:28.570161 (+   137us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:28.570196 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.570264 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:28.707435 (+137171us) raft_consensus.cc:1685] finished
0709 13:02:28.707463 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:28.707642 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82177,"prepare.queue_time_us":181458,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":112,"raft.queue_time_us":151338,"raft.run_cpu_time_us":1004,"raft.run_wall_time_us":27429,"spinlock_wait_cycles":3836288,"thread_start_us":448846,"threads_started":3,"wal-append.queue_time_us":300679}
I20260709 13:02:28.712997  4315 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:28.714265  4315 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.716446  4315 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:28.724090  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.725145  1612 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:28.726140  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.727507  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.728387  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:28.728767  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.728587  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.667881  5074 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.730679  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.731730  1607 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:28.732540  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.734110  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.735015  1610 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:28.736402  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.737893  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.738545  1613 raft_consensus.cc:2376] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7. Re-sending same reply.
I20260709 13:02:28.739547  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.729175  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.741376  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.742403  1614 raft_consensus.cc:2410] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 8 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:02:28.728662  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.672768  4890 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:28.744654  4890 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:28.735917  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.745934  1610 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:28.616393  4991 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:28.754576  1612 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:28.757437  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.758388  1615 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 2.
I20260709 13:02:28.673074  4662 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:28.774870  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.780671  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:28.781665  1609 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:28.784543  5044 consensus_meta.cc:287] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.623s	user 0.012s	sys 0.001s
I20260709 13:02:28.784991  5044 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:28.786837  1505 leader_election.cc:336] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.209s (SENT)
I20260709 13:02:28.787139  5044 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.788898  4991 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:28.789705  5086 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:28.773466  5074 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:28.801331  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.805378  1609 raft_consensus.cc:2368] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:02:28.798702  4859 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:28.810075  4874 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:28.810295  1505 leader_election.cc:336] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.246s (SENT)
I20260709 13:02:28.836479  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:28.817209  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.818216  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.818496  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.838868  1688 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:02:28.819119  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.823112  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.839933  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.823969  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.824693  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:28.843111  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:28.843211  4315 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:28.825337  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.828325  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.840104  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.845285  1682 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:28.845532  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.846431  1683 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:28.847039  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:28.847388  4950 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:28.848282  4950 consensus_queue.cc:1243] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer c98c328741aa493d87abafbf08f04944 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:28.850667  4495 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:28.839111  1690 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:28.853267  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:28.844560  1687 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
W20260709 13:02:28.861510  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 261879us
W20260709 13:02:28.910122  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 47101.9us
I20260709 13:02:28.915177  1688 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:02:28.917061  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:28.917783  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 84171.8us
I20260709 13:02:28.922051  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:28.851718  4894 consensus_queue.cc:1059] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:02:28.842597  4991 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:28.925864  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:28.932301  4878 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:28.848404  4877 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:02:28.942090  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:28.947978  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:28.950057  1537 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:28.959188  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:28.799220  5017 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:28.963032  4894 raft_consensus.cc:3055] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:28.915061  4874 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:28.963835  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:28.933502  4642 consensus_meta.cc:287] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.003s
I20260709 13:02:28.971107  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:28.860978  4958 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:02:28.987241  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 519) took 1315 ms. Trace:
I20260709 13:02:28.987752  1540 rpcz_store.cc:276] 0709 13:02:27.671808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:27.851858 (+180050us) service_pool.cc:224] Handling call
0709 13:02:27.858909 (+  7051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:27.970785 (+111876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:28.986911 (+1016126us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000cb2d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:28.987158 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255490816}
I20260709 13:02:28.989406  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:28.985817  4957 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:29.007036  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.036s	sys 0.044s
W20260709 13:02:29.008199  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.036s	sys 0.044s
I20260709 13:02:28.985070  5044 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:29.014377  4315 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:29.019402  4315 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:02:29.006795  5002 consensus_meta.cc:287] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.888s	user 0.009s	sys 0.005s
I20260709 13:02:29.021320  4315 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:29.026448  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:29.027855  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.028527  1607 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:28.976565  4894 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:29.019639  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:29.026140  4315 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.038455  4315 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.041323  1610 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:28.993979  4874 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.047399  4874 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.003556  4859 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:02:29.017894  5089 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:29.021077  4950 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:29.052906  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:29.054482  1608 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:29.056224  4440 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:29.057755  4784 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.033020  4895 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.036520  1482 connection.cc:573] client connection to 127.0.107.194:43963 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:02:29.080876  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.020273  5044 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.132151  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:29.133044  1608 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.142876  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:29.060168  4950 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.130110  4859 raft_consensus.cc:993] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:29.145526  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:29.157009  1610 raft_consensus.cc:2376] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10. Re-sending same reply.
I20260709 13:02:29.127019  5029 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:29.130340  5081 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:29.160389  1615 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:29.076825  5002 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:02:29.153002  5023 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:29.157330  4950 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.065194  5089 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.153934  4440 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:29.143968  5092 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:29.159690  4874 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.135160  4895 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.170058  5090 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.193495  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 156066us
I20260709 13:02:29.131781  4784 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.170030  4642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43382 (request call id 0) took 5778 ms. Trace:
I20260709 13:02:29.190704  5036 raft_consensus.cc:1081] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:29.215396  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:29.215654  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:29.216230  1540 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:29.215413  1608 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:29.144917  4894 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.223121  1532 pending_rounds.cc:85] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 3
I20260709 13:02:29.223290  1607 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:29.223664  1532 pending_rounds.cc:107] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:29.170161  5029 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.228363  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:29.224022  1532 raft_consensus.cc:2889] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:29.229187  1535 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:29.225077  1615 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:29.172071  5081 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.237103  1615 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:29.221587  4958 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.222870  5017 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:29.204483  5092 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.206645  4874 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.245532  4957 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:29.275000  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.209422  5090 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.277040  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:29.241570  4894 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.276324  5036 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.283799  4877 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.248744  4958 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.292744  4855 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:29.292119  5017 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:29.328357  5093 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:02:29.328500  4877 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.331094  5044 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.292709  5036 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:29.345721  5095 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
W20260709 13:02:29.358908  5103 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:02:29.359037  5096 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:02:29.356643  5098 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:02:29.364984  5092 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.367446  5090 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.354013  5089 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:29.399793  1487 auto_rebalancer.cc:893] Removing replace marker failed: recv error from unknown peer: Transport endpoint is not connected
W20260709 13:02:29.401381  1487 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:02:29.401906  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:02:29.416831  1533 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:29.441340  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:29.443003  1609 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:29.441380  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:29.448027  1608 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:29.364284  5036 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:29.363826  5029 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.336391  4855 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:29.462522  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:29.348014  5017 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.465461  5081 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:29.469791  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.478667  4874 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.480180  4895 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.209264  4642 rpcz_store.cc:276] 0709 13:02:23.383184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:23.383416 (+   232us) service_pool.cc:224] Handling call
0709 13:02:24.187721 (+804305us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5400689fa0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea85520 00007fd02eb0eb42 00007fd02eb0d800 00007fd02eb069fa 00007fd033ace4c9 00007fd02d04ac54 00007fd02d04abe2 00007fd02d04ab11 00007fd02d04aa8c 00007fd02d049d42
0709 13:02:25.137714 (+949993us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b58004433d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea640aa 00007fd02eae6447 00007fd02eb0370a 00007fd02eb0476a 00007fd02eb0391b 00007fd02eb0f03c 00007fd02eb0e6b3 00007fd02eb069fa 00007fd033ace4c9 00007fd02d04ac54
0709 13:02:25.628231 (+490517us) log.cc:844] Serialized 501 byte log entry
0709 13:02:26.230853 (+602622us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b180043afe0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:26.414014 (+183161us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b5400689fa0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7ddbe 00007fd02ea88930 00007fd02ea888d8 00007fd02ea88858 00007fd02ea88813 00007fd02ea87a9c 00007fd034973626 00007fd03496ddd8 00007fd02eac47cb 00007fd02eac72c0
0709 13:02:29.160404 (+2746390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17449,"raft.run_cpu_time_us":819,"raft.run_wall_time_us":31631,"spinlock_wait_cycles":479681408,"thread_start_us":180356,"threads_started":1,"wal-append.queue_time_us":220969,"wal-append.run_cpu_time_us":5818,"wal-append.run_wall_time_us":1567973}
I20260709 13:02:29.481920  4841 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:29.559291  4841 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.249074  4440 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.487542  4991 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.483026  4800 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.502720  4784 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.348829  4877 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.524243  4970 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:29.525050  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:29.530642  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:29.565008  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 752aab0c230943e5a7d35d3d2ff9e555 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:29.580212  5038 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:29.543040  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:29.596517  4970 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.596522  4800 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.607285  1684 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:29.608999  4991 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.610430  4800 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:29.611925  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:29.612784  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:29.613142  1539 raft_consensus.cc:2393] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:29.596630  4874 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:29.614729  4874 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.615679  1614 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:29.563953  4841 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:29.339819  4957 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:29.622920  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.592460  5038 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:29.632100  5119 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:29.633206  5119 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.638216  5017 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:29.595142  4855 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.641055  4855 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.657248  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:29.658088  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:29.659102  1607 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.659230  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:29.660380  1614 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:29.662019  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:29.663120  1609 raft_consensus.cc:2410] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:29.658135  1613 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.666453  1537 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:29.668542  4662 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:29.668581  4958 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:29.627262  4874 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.619915  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:29.629069  4991 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.686813  1536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:02:29.687470  2328 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:29.678941  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:29.716805  4958 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:29.717682  4958 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.719544  1613 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:29.727387  4841 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:29.729722  4841 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.714038  1536 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:29.733934  1536 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.736593  4315 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.737368  4315 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.737778  2370 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:29.719810  4958 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:29.688268  5038 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.696293  5119 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.739943  4315 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:29.785588  5122 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:29.754341  1615 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:29.745837  4950 consensus_meta.cc:287] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.014s
I20260709 13:02:29.801838  4970 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:29.741148  4662 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:29.803331  4662 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.754050  2365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 344) took 1620 ms. Trace:
I20260709 13:02:29.750320  1579 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:29.742390  5034 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:29.806233  5107 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:29.807380  5107 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:29.807996  5107 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:29.811050  1504 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:29.743940  4877 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.769361  5081 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:29.800771  4841 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:29.741853  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 54694.3us
W20260709 13:02:29.753304  4890 consensus_meta.cc:287] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 1.008s	user 0.017s	sys 0.011s
W20260709 13:02:29.788492  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 169068us
I20260709 13:02:29.816742  4890 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.820240  5119 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:29.820881  5119 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.821422  5119 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:29.789079  4859 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:29.823081  4859 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.812898  4874 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:29.825762  4874 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.808737  2370 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:29.807258  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 57241.9us
I20260709 13:02:29.749068  5029 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:29.745594  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1669) took 1133 ms. Trace:
I20260709 13:02:29.807085  4950 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.831456  1611 rpcz_store.cc:276] 0709 13:02:28.612155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.613536 (+  1381us) service_pool.cc:224] Handling call
0709 13:02:29.744997 (+1131461us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b5400344254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:29.745330 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":988165504}
W20260709 13:02:29.773057  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 114483us
I20260709 13:02:29.840453  5081 consensus_queue.cc:1059] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:29.842806  5081 raft_consensus.cc:3055] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:29.841876  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:29.843204  5081 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:29.808725  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.823565  4859 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:29.851578  1607 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:29.797034  5038 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:29.812433  5034 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:29.880014  4877 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:29.805176  2365 rpcz_store.cc:276] 0709 13:02:28.133196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:28.133353 (+   157us) service_pool.cc:224] Handling call
0709 13:02:29.218958 (+1085605us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3a22 00007fd0348fcc09 00007fd033a56ee0 00007fd033b200ab 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:02:29.219191 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:29.219451 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:29.502175 (+282724us) log.cc:844] Serialized 14 byte log entry
0709 13:02:29.669394 (+167219us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:29.678131 (+  8737us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:29.732711 (+ 54580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:29.753577 (+ 20866us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:29.753814 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3701,"prepare.queue_time_us":143872,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":25701,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":219,"spinlock_wait_cycles":10487552,"thread_start_us":374448,"threads_started":2,"wal-append.queue_time_us":229148}
W20260709 13:02:29.779855  4495 consensus_meta.cc:287] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.928s	user 0.018s	sys 0.006s
W20260709 13:02:29.869431  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49738us
I20260709 13:02:29.904992  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:29.881966  5034 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:29.910300  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:29.830983  5029 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:29.909408  4895 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:29.946204  4895 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:29.951651  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 65483.6us
I20260709 13:02:29.952216  5092 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:29.953218  1504 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:29.954418  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 76255.1us
I20260709 13:02:29.957901  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:29.955760  1504 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:29.958425  4991 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:29.908320  4877 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:29.976064  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:29.978443  5002 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:29.979115  5002 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:29.996377  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 154937us
I20260709 13:02:29.997617  1580 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:29.932201  5089 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:30.000243  5089 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.002907  5089 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:30.003504  5089 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.004277  4662 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:30.004446  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:29.968418  4841 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.008483  4950 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:30.008697  4841 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.009562  5120 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:30.010121  5120 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.010578  5120 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.011336  4841 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:29.937103  4970 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.012281  4970 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.013893  5029 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:30.014631  4970 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:30.015434  4890 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:30.016891  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:29.999557  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:29.930867  4874 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:30.023208  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 93533.2us
I20260709 13:02:29.967994  4991 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:30.029939  5117 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.267s	user 0.006s	sys 0.000s
I20260709 13:02:30.021708  4877 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.035962  4991 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:29.984566  5081 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.050069  5081 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.054111  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:30.055626  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.056522  5092 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.058490  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.069859  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.070542  4991 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.071640  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.071889  1535 raft_consensus.cc:1240] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:30.078655  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.063766  1536 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:29.983955  5002 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
W20260709 13:02:30.086086  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 48712.1us
I20260709 13:02:30.032910  4970 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.095326  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:30.102878  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63436.2us
I20260709 13:02:30.108987  4991 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:30.109851  5125 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:30.110522  5125 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.110961  5125 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.113580  1688 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:02:30.114004  1688 pending_rounds.cc:85] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 4
I20260709 13:02:30.114215  1688 pending_rounds.cc:107] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:30.114475  1688 raft_consensus.cc:2889] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:30.114796  1688 pending_rounds.cc:107] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:02:30.115028  1688 raft_consensus.cc:2889] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:30.108858  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 109446us
I20260709 13:02:30.088740  5092 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.117848  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:30.124856  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.136861  1684 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.136463  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.143836  1683 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:30.147637  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.147858  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.148553  1682 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:30.149359  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.149781  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.150169  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.150822  1689 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:30.151397  1688 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:30.152107  5054 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:30.076143  4874 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:30.182756  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.174173  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.193344  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:30.195470  5127 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:02:30.197500  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.198472  1541 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:30.181730  5092 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:30.202749  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 170) took 20982 ms (client timeout 15000 ms). Trace:
I20260709 13:02:30.203320  5092 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:30.205587  4894 consensus_meta.cc:287] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.917s	user 0.018s	sys 0.000s
I20260709 13:02:30.206745  2365 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
W20260709 13:02:30.203258  1435 rpcz_store.cc:269] 0709 13:02:09.255039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:09.255478 (+   439us) service_pool.cc:224] Handling call
0709 13:02:30.202456 (+20946978us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:22.709797 (+     0us) spinlock_profiling.cc:243] Waited 3.72 ms on lock 0x7b180039cac0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:22.710025 (+   228us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:22.710809 (+   784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:22.710863 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:02:22.710881 (+    18us) tablet.cc:662] Decoding operations
0709 13:02:22.715965 (+  5084us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:22.716144 (+   179us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:22.716179 (+    35us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:02:23.054055 (+337876us) tablet.cc:701] Row locks acquired
0709 13:02:23.101405 (+ 47350us) write_op.cc:260] PREPARE: finished
0709 13:02:23.140601 (+ 39196us) write_op.cc:270] Start()
0709 13:02:23.221199 (+ 80598us) write_op.cc:276] Timestamp: P: 1783602143124619 usec, L: 0
0709 13:02:23.223532 (+  2333us) op_driver.cc:348] REPLICATION: starting
0709 13:02:23.295796 (+ 72264us) log.cc:844] Serialized 9515 byte log entry
0709 13:02:23.329288 (+ 33492us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02b9fe0ac 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b
0709 13:02:24.329174 (+999886us) op_driver.cc:464] REPLICATION: finished
0709 13:02:24.491390 (+162216us) write_op.cc:301] APPLY: starting
0709 13:02:24.491504 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:24.491993 (+   489us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:24.492056 (+    63us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:24.498234 (+  6178us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:24.498561 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:02:24.498593 (+    32us) write_op.cc:312] APPLY: finished
0709 13:02:24.499029 (+   436us) log.cc:844] Serialized 163 byte log entry
0709 13:02:24.524883 (+ 25854us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:24.545536 (+ 20653us) write_op.cc:454] Released schema lock
0709 13:02:24.580931 (+ 35395us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:24.627005 (+ 46074us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:24.630398 (+  3393us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":260483,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":141125,"apply.run_cpu_time_us":6074,"apply.run_wall_time_us":105031,"num_ops":24,"prepare.queue_time_us":54589,"prepare.run_cpu_time_us":22272,"prepare.run_wall_time_us":682343,"raft.queue_time_us":194235,"raft.run_cpu_time_us":27399,"raft.run_wall_time_us":160378,"replication_time_us":1097743,"spinlock_wait_cycles":29987328,"thread_start_us":350135,"threads_started":4,"wal-append.queue_time_us":138176,"wal-append.run_cpu_time_us":55190,"wal-append.run_wall_time_us":2070654}]]}
I20260709 13:02:30.152886  5054 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.209015  1685 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:30.209972  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.210745  1607 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:30.193562  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.214558  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.214977  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.215684  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:30.217869  2367 raft_consensus.cc:2393] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:30.218515  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.214319  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.221976  1684 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:02:30.153326  4970 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.154512  5107 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.214275  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:30.179566  4874 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.230726  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.227402  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:30.228842  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 52455.8us
I20260709 13:02:30.209985  5054 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.234375  4895 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:30.236889  1536 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.237323  5107 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:30.238113  5090 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.238628  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.238770  5090 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.239334  1611 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:30.240109  4874 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.241262  5090 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.241677  4970 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:30.244805  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.245826  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.246251  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.226959  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.247900  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.248485  4958 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:30.250684  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.253285  2370 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:30.254480  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.255339  1607 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:30.231451  1614 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:30.265715  2367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:02:30.266036  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.266326  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.266530  2367 raft_consensus.cc:606] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:30.266840  1681 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:30.267462  1609 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:30.267827  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.267975  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.268158  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.268455  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.269166  1541 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:30.269582  4877 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:30.271364  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.273382  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.267848  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.264053  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:30.275956  2329 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.276799  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.277742  1535 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:30.279953  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.280516  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.281551  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.281549  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.284894  5034 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.288347  5054 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:30.289022  5054 raft_consensus.cc:697] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:30.290151  5054 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:30.292443  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 334688us
I20260709 13:02:30.293576  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.295292  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.297614  5113 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:30.298243  5113 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:30.299158  5113 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.301113  5123 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.302007  5123 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:30.302343  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.303493  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.304178  1504 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:30.274981  1689 raft_consensus.cc:2410] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 11 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:02:30.304548  1610 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:30.306036  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:30.297379  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.287727  5034 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.312690  1616 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:30.316744  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:30.317487  1688 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.320020  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.324947  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.323879  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.329193  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:30.321213  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 43614.7us
I20260709 13:02:30.313007  5133 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:02:30.333014  5119 consensus_meta.cc:287] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.008s
I20260709 13:02:30.335597  1616 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:30.336614  1689 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:02:30.336942  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.337808  1682 raft_consensus.cc:2410] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:30.340924  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.345306  1681 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:30.328297  5081 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:30.346267  5081 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.348369  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.348789  5081 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:30.344894  5120 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.355170  5120 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.335996  5133 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.356614  5133 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.356520  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.358219  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.359797  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:30.360194  5123 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.361002  5123 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.336642  5119 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.331341  4970 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:30.378223  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 74882.8us
I20260709 13:02:30.391989  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:30.392951  1681 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:30.393332  1681 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:30.394348  1681 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.395735  1681 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.404207  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:30.408627  1653 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:30.404960  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.411058  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.371903  4874 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.410902  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.415282  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:30.414076  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 142080us
I20260709 13:02:30.414960  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:30.419642  1688 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
W20260709 13:02:30.433115  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.434231  1687 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:30.431317  5081 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:02:30.442229  1532 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:30.449555  1681 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:30.454715  5081 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:30.432365  5120 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.463716  5081 consensus_queue.cc:1243] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:30.461416  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.438617  5123 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:30.471197  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 69396.9us
I20260709 13:02:30.482246  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.483244  1540 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:30.484918  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.482378  1541 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:30.494240  5038 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:30.463742  5119 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.494839  5038 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:30.495970  5038 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.497565  5038 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:30.503031  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 98040.4us
I20260709 13:02:30.442230  5125 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.502986  1616 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:02:30.504228  1534 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
W20260709 13:02:30.512980  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 97923us
I20260709 13:02:30.519907  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.526173  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:30.528581  1532 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:30.528453  4957 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:30.530485  1579 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:30.544413  1505 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.545437  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:30.546242  1534 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:30.546861  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.514382  2362 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:30.560271  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.560992  2370 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
W20260709 13:02:30.561501  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.560302  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.568475  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.560546  4957 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:30.566782  1616 raft_consensus.cc:2955] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:30.571128  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:30.570983  4957 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:30.572732  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 80409us
I20260709 13:02:30.575963  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:30.576684  1541 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.513425  5123 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.578570  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.579335  2370 raft_consensus.cc:2393] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:30.577661  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:30.550853  5119 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.560022  5132 raft_consensus.cc:2764] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:02:30.590437  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:30.590710  2328 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:30.587293  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:30.588518  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.596643  1681 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:30.591454  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:30.594523  1579 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:30.598376  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:30.585278  4859 consensus_meta.cc:287] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.004s
I20260709 13:02:30.593942  5140 consensus_queue.cc:1059] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:02:30.594179  5125 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.616847  5107 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:30.617904  5107 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:30.618211  5107 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:30.619131  5107 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.619927  5123 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.620353  5081 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:30.620981  5081 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.621382  5081 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:30.578276  4958 raft_consensus.cc:2764] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
W20260709 13:02:30.622764  5134 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:02:30.630354  5107 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:30.610388  4970 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:30.633296  4970 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:30.634759  4970 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.609733  1540 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:30.599769  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.612110  5041 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.612524  4947 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.612877  1579 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:30.614153  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:30.605715  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:30.607743  5135 log.cc:927] Time spent T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:02:30.646126  1685 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:30.602161  5120 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.650264  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:30.595603  4874 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.654201  1537 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
W20260709 13:02:30.660171  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 69302.4us
I20260709 13:02:30.664709  5141 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:30.666932  5131 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
W20260709 13:02:30.667797  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.668632  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 53062.1us
I20260709 13:02:30.669938  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:30.670264  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.670859  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.658524  4895 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:30.655514  5123 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.654807  5120 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.611625  4859 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:30.678429  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 88775.4us
W20260709 13:02:30.679320  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.647853  5041 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.668018  5132 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.677187  5089 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:02:30.696563  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:30.677376  4895 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.706343  1541 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
I20260709 13:02:30.674239  5092 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.683820  5120 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:30.708900  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 92747us
I20260709 13:02:30.680881  5141 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:30.728485  1690 raft_consensus.cc:2368] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:30.729020  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:30.717829  4895 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:30.765182  5041 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:30.765404  4949 consensus_queue.cc:1059] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:02:30.770238  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 50820.1us
I20260709 13:02:30.775599  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.783080  1579 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.760368  4874 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:30.718621  5081 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:30.780318  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 78584.6us
I20260709 13:02:30.751559  5090 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:30.728929  4958 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:02:30.797094  5154 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:30.796851  5141 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.806233  5090 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:30.812870  4958 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:30.813426  4958 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:30.814085  5090 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:30.814692  4958 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.800244  2329 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.747853  5132 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.826840  5154 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:30.834640  5148 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:30.763931  5092 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.790197  4890 raft_consensus.cc:993] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:30.804659  5133 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.791320  5131 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:30.864027  4859 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:30.864537  5131 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:30.865957  5034 raft_consensus.cc:3055] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:30.865846  5131 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:30.867501  5131 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:30.872943  1504 leader_election.cc:400] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:30.873425  1504 leader_election.cc:403] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:02:30.836863  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 108015us
I20260709 13:02:30.855459  4878 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:30.856226  4890 raft_consensus.cc:1081] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:30.859941  5107 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.861478  5153 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.866417  5034 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:30.819813  4958 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:30.780244  5089 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.879787  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:30.886103  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.888652  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 88693.5us
I20260709 13:02:30.889951  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.849429  5148 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:30.899832  1539 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:30.902518  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.905606  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.911248  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:30.912344  1615 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:30.920912  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
W20260709 13:02:30.888921  5151 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
W20260709 13:02:30.927073  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 83239.4us
W20260709 13:02:30.928335  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:30.928840  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:30.879426  4878 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:30.923127  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 140130us
I20260709 13:02:30.878199  4874 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.967197  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:30.967475  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 124788us
I20260709 13:02:30.968317  1613 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:02:30.969456  4878 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:30.933615  1536 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:30.966439  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:30.971789  1615 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:30.967267  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:30.900745  5140 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:30.915786  5125 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:30.915786  5123 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:30.927222  5152 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
W20260709 13:02:31.011030  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 82777.6us
I20260709 13:02:30.990758  5002 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.893241  5107 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.024230  1533 raft_consensus.cc:2393] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:31.018810  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 90401.1us
I20260709 13:02:31.025384  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:30.932832  5119 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:30.992779  5153 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.001580  5162 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.017737  4970 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.028620  5154 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.990797  5089 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.073033  5133 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.073717  5132 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.074865  5132 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.078508  4970 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.080279  4859 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:31.081487  4970 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.082638  5081 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.056819  5119 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.074010  5158 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.086768  5119 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.094178  5092 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.102854  5153 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.103682  5154 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.106350  5154 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:31.108218  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 184548us
I20260709 13:02:31.109337  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.059978  5162 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.117040  5162 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.121459  4970 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.125168  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.129527  4970 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:31.130756  5107 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:31.131804  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 88995.6us
W20260709 13:02:31.133366  5038 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.004s
I20260709 13:02:31.044876  5140 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:31.140425  5140 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:31.140950  4877 consensus_queue.cc:1059] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:31.141535  5140 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.039553  5034 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.144119  5034 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.148995  4894 raft_consensus.cc:3055] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:31.149441  4894 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:31.150401  4894 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.028469  5002 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:31.075879  5149 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:31.201802  5140 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.206405  5089 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.081511  4859 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.184417  5133 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.209475  5133 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.212661  5133 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.184653  5002 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:31.187012  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 76050.5us
I20260709 13:02:31.215176  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.187501  4970 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:31.188813  5158 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.219262  5158 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.194905  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:31.220717  1681 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.221417  4970 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.195178  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.195315  4894 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.075882  5132 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.224277  5132 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:31.195765  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 55224.9us
I20260709 13:02:31.124092  5148 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.234040  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.234151  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.223004  5120 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.230700  1681 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
W20260709 13:02:31.245608  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 278483us
I20260709 13:02:31.247072  1579 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:31.254360  1504 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.259075  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.259783  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.275434  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.280699  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.282716  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.284694  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:31.284991  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.284588  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.276336  5140 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:31.216704  4895 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:31.292016  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.275604  5158 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:31.298094  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.299293  1683 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:31.303025  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:31.286141  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 242472us
W20260709 13:02:31.310439  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.287426  5133 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:31.285419  5119 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:31.311723  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 96697.8us
I20260709 13:02:31.323472  1686 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:02:31.323964  1686 pending_rounds.cc:85] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 6
I20260709 13:02:31.324470  1686 pending_rounds.cc:107] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:02:31.324779  1686 raft_consensus.cc:2889] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:31.308128  5038 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.315953  5158 raft_consensus.cc:697] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:31.317320  5170 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.326308  5107 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.325425  5133 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:31.349151  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.351526  4895 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:31.332370  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 288268us
I20260709 13:02:31.379884  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.383638  4878 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.384691  5120 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:31.385366  2367 raft_consensus.cc:1240] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:31.390412  5140 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:31.390595  1682 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:31.390947  5140 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.391445  5140 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.392244  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:34908
I20260709 13:02:31.392832  1539 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.393174  1539 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:31.395118  5158 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.387900  4878 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.400184  4874 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:31.400913  1533 raft_consensus.cc:1240] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:31.403398  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.404640  1654 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:31.405112  4957 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.405508  4957 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.405843  4957 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.405755  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.406289  5002 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:31.406888  5043 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:31.407364  5043 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.407689  5043 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.342361  5167 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:02:31.409405  5148 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:31.409881  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.369429  4859 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:31.344707  5038 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:31.424568  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.427060  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:31.406345  5131 consensus_meta.cc:287] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.001s
I20260709 13:02:31.423720  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.433465  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:31.436750  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.383062  5119 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.430405  1579 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.435763  5157 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:31.437769  5157 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.438319  5157 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.438637  1579 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.439334  5089 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:31.439536  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:31.440308  2362 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.441263  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:31.439850  5089 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.442041  5089 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.442230  1533 raft_consensus.cc:2393] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:31.443305  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:31.443936  1688 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.449420  4895 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:31.449764  5171 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.450162  4895 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:31.450387  5171 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.451215  4895 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.453648  5171 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.454980  5041 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:31.456713  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:31.459127  2362 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:02:31.460179  2370 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:31.441358  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.462381  5133 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.439678  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:31.466688  1616 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:31.469398  4495 consensus_queue.cc:1059] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:31.470767  4949 raft_consensus.cc:3055] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:31.471213  4949 raft_consensus.cc:740] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:31.472316  4949 consensus_queue.cc:260] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.473716  4949 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:31.476722  5132 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.436990  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:31.482800  1688 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
W20260709 13:02:31.482883  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 45972.8us
I20260709 13:02:31.484015  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.376793  5107 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.485133  4495 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:31.485288  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:31.486717  5107 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.379437  5170 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:31.489378  4958 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.001s
I20260709 13:02:31.489907  1685 raft_consensus.cc:606] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:31.490358  1685 raft_consensus.cc:614] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:31.490862  1687 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:31.489645  5170 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.412935  5054 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:02:31.497442  1579 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:31.497618  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 159256us
I20260709 13:02:31.498413  1504 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.470980  5140 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.484282  1539 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.500650  1541 raft_consensus.cc:1240] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 3. Current term is 4. Ops: []
I20260709 13:02:31.501147  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:31.498606  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63803us
I20260709 13:02:31.502997  5119 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:31.507308  5119 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.507696  5119 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:31.510181  5089 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.510713  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.513417  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.514736  4970 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:31.515137  4970 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.515483  4970 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.516477  5038 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.504050  4495 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:02:31.521503  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.532228  1539 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:31.526886  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.541688  5043 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.528680  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:02:31.529080  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:31.527100  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:31.552611  1681 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:31.514007  5089 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.522518  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.532953  1689 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:31.532858  4874 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:31.555801  4874 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:31.556951  4874 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.527038  5140 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.552652  1682 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:31.530928  5170 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:31.533205  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.551903  1608 raft_consensus.cc:606] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:31.573534  1608 raft_consensus.cc:614] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:31.549492  4970 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.537307  4957 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.580021  1681 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:02:31.590452  4958 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:31.590538  4878 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:31.592756  5034 consensus_queue.cc:1059] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:31.591177  4958 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.593835  1609 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:31.588792  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:31.589723  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.594563  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:31.599162  1615 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:31.583954  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 100062us
I20260709 13:02:31.601800  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:31.593842  5034 raft_consensus.cc:3055] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:31.604580  1539 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:31.605685  1688 raft_consensus.cc:1240] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:31.609723  1682 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:31.603082  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.611300  1579 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.616441  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
W20260709 13:02:31.624816  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.596864  5170 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:31.600659  4958 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.634754  5120 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:31.635396  5120 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.635874  5120 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.640275  5041 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:31.617723  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:31.604645  5034 raft_consensus.cc:740] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:31.629782  5133 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:31.630244  5165 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:31.630630  5090 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:31.669607  5165 raft_consensus.cc:697] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:31.626775  4495 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.671600  4495 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.671386  5170 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.672823  4495 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:31.628391  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 95269.8us
I20260709 13:02:31.602627  4890 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:31.666405  5133 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:31.668643  5043 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:31.646145  4895 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:31.611002  5148 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:31.677137  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:31.644394  4440 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:31.715238  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 126531us
I20260709 13:02:31.715185  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:31.702787  4877 raft_consensus.cc:2764] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:31.708575  4440 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:31.712780  4895 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:31.719185  4859 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:31.724174  5158 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.735175  4958 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.745628  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:31.740273  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:31.708779  5054 consensus_queue.cc:1059] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:02:31.722916  4890 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:31.728662  5168 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:31.747404  1690 raft_consensus.cc:606] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:31.755091  1690 raft_consensus.cc:614] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:31.713229  5148 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.757453  5148 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:31.757781  5120 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.738659  4859 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:31.776566  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.741436  5157 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.746773  4970 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.781070  1505 leader_election.cc:400] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:02:31.759229  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:31.730377  5034 consensus_queue.cc:260] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.746938  5158 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.778836  4859 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.795085  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:31.748555  5133 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.778442  5119 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.789075  2362 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:31.670601  5165 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:31.854993  5180 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:02:31.855072   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:31.857082  4958 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:31.801285  5131 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.805810  5148 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:31.862973   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:31.869827  5119 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.901284  5157 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:31.903398  5185 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:02:31.904027  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 125023us
I20260709 13:02:31.905102  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:31.906665  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:31.907429  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 89784us
I20260709 13:02:31.908456  5158 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.878340  5034 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:31.912281  5120 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:31.909178  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:31.870647  5181 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:02:31.915148  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:31.915421  1653 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.849582  5090 raft_consensus.cc:3055] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:31.852767  4970 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.875869  5148 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:31.930472  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:31.927747  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.880692  4957 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:31.880957  5155 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.789565  4440 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.802002  4895 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.920825  5090 raft_consensus.cc:740] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:31.944178  1688 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:31.924173  4877 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:31.952687  1504 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:31.827664  4890 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:31.926635  5120 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:31.959877  1615 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:02:31.926321  5184 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:31.933167  5148 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:31.915908  5131 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.928257  4874 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.944317  5168 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:31.960664  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:31.948854  5155 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.972980  5131 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:31.974532  5191 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:31.963238  4970 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.978888  1686 raft_consensus.cc:2468] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:31.979040  4874 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:31.980136  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:31.982470  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:31.983603  1684 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:31.954783  4877 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:31.999696  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:31.991793  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 85237.9us
I20260709 13:02:31.966883  4440 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:31.965448  4957 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:32.011724  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:32.019747  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:32.023275  1682 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:32.014593  4877 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.012495  5131 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:32.040452  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:31.990768  5133 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:32.045812  5163 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:32.016736  4957 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:32.048295  4957 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.048444  5120 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:32.049317  5120 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:32.050472  5120 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.022614  5157 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:32.053679  5155 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.053891  5184 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:32.054572  5184 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.019527  5119 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:02:32.056874  5119 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:32.057251  5119 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:32.058125  5119 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.037411  5090 consensus_queue.cc:260] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:32.043772  4894 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.063092  5184 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.064198  5131 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.073992  5131 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:32.047418  5188 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:02:32.012630  5168 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:32.076246  4495 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.077919  5168 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:32.078528  5168 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:32.079043  5168 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.059396  5119 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.081826  4495 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:02:32.086261  5168 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.089249  4970 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:32.095872  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 61870.6us
I20260709 13:02:32.100858  4894 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.101523  4894 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:32.102561  5148 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.047304  4859 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.104794  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.105683  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.107604  1690 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:32.104852  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.112269  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.111819  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:32.104892  1686 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:32.119566  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:32.134084  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.135464  5107 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.136237  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.136909  1686 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:32.135963  5107 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.137557  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.138670  1681 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:32.139204  5107 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.139871  5107 consensus_queue.cc:1059] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:32.140470  1686 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:32.140900  5107 raft_consensus.cc:3055] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:32.141387  5107 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:32.111323  5192 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 13:02:32.197227  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.125298  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:32.113483  5193 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:02:32.198170  1689 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:32.202039  1579 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:32.142570  5107 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.115085  4874 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.132110  5133 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:32.103971  4894 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:32.224467  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 179573us
I20260709 13:02:32.227281  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:32.218555  1580 leader_election.cc:336] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.534s (SENT)
I20260709 13:02:32.228855  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:32.216645  5089 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:32.237138  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 111972us
I20260709 13:02:32.247602  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:32.127859  4970 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:02:32.211001  5155 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:02:32.257262  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 245627us
I20260709 13:02:32.235803  4958 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.255196  2370 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:02:32.237928  5089 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:32.236806  5107 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.268090  1535 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:32.258558  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.262995  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:32.320490  1615 raft_consensus.cc:2376] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8. Re-sending same reply.
I20260709 13:02:32.295516  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:32.336912  1580 leader_election.cc:336] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.573s (SENT)
I20260709 13:02:32.251262  5170 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.251467  4874 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:32.337371  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:32.296751  4895 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:32.330299  5089 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.338421  5054 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.346673  5202 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:32.371405  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 124976us
I20260709 13:02:32.367594  5202 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:32.400147  5198 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:02:32.401450  5202 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.398391  5133 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:32.420717  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 83843.5us
W20260709 13:02:32.421845  1580 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.630s (SENT)
I20260709 13:02:32.348143  4895 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:32.422276  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:32.423273  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 127890us
I20260709 13:02:32.413635  2328 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:32.351379  5168 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.429399  1539 raft_consensus.cc:1240] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:02:32.370746  5170 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.372277  5148 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:32.397735  4874 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:32.443760  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:32.429411  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:32.349006  4877 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:32.393507  5054 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:32.474047  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:32.444386  5170 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.617127  2362 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:02:32.649747  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.531941  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:32.647073  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 217809us
W20260709 13:02:32.596813  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.461531  4894 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.658928  1539 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:32.512907  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:32.465503  5132 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:32.671139  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:32.463192  5156 raft_consensus.cc:2804] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:32.681912  5200 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.676544  4894 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.685019  4894 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:32.602077  5148 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.507397  5120 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:32.716681  1532 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:32.493803  5038 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.701642  5054 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:32.704458  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:32.556911  5157 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.736423  5157 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.707183  1609 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.717099  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:32.749943  1533 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:32.462873  4874 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.474882  5155 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.238s
I20260709 13:02:32.755465  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:32.754155  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:32.770656  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:32.772265  1533 raft_consensus.cc:2393] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:32.716982  5156 raft_consensus.cc:697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:32.781677  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:32.739324  5038 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.739706  5157 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:32.621215  4895 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.725345  5148 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.800661  1532 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:32.794703  4440 consensus_meta.cc:287] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.782s	user 0.012s	sys 0.000s
I20260709 13:02:32.761076  5132 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:32.814544  4877 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:32.821099  5148 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:32.822806  5209 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:02:32.823294  5199 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.434s	user 0.001s	sys 0.001s
I20260709 13:02:32.805491  4895 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.827644  1609 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:32.828766  5204 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.377s	user 0.000s	sys 0.002s
W20260709 13:02:32.829977  4957 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.781s	user 0.009s	sys 0.001s
I20260709 13:02:32.853813  4957 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.856312  1682 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:32.855654  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:32.864578  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:32.865034  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:32.865456  1539 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.865796  1541 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:32.867311  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:32.868114  1616 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:32.869058  5131 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:32.883069  1541 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:32.886937  1616 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:32.889205  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:32.889775  1616 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:32.894677  5038 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.895951  4874 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.898435  4859 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:32.901329  1616 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:02:32.910509  5119 consensus_meta.cc:287] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.001s
I20260709 13:02:32.858356  5156 consensus_queue.cc:237] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:32.915920  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:32.916874  1615 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:32.917023  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:32.917637  1532 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:32.918442  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:32.918807  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:32.919406  1532 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:32.921465  5107 consensus_meta.cc:287] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.002s
I20260709 13:02:32.922245  1610 raft_consensus.cc:2410] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:32.922124  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:32.922796  1614 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:32.922251  4957 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:32.924414  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.924722  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:32.929337  1532 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:32.983254  5184 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:32.983773  5201 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:32.983872  5184 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:32.939452  2370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 247) took 1322 ms (client timeout 1634 ms). Trace:
I20260709 13:02:32.947279  5090 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:32.948786  5089 consensus_meta.cc:287] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.553s	user 0.011s	sys 0.000s
I20260709 13:02:32.951603  2367 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:02:32.951937  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:32.956789  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.957763  5170 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:32.960210  5148 consensus_queue.cc:1059] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:32.960877  5168 consensus_meta.cc:287] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.002s
I20260709 13:02:32.961269  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 95) took 10111 ms. Trace:
I20260709 13:02:32.961905  5228 consensus_queue.cc:1059] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.963316  4440 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:32.964186  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:32.964960  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.966272  1690 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:32.969527  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.969846  1684 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:32.970295  5132 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:32.970881  1681 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:33.020995  1687 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:32.971493  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:32.975878  2365 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.025331  1686 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:32.984539  5201 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:32.985069  1539 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:32.988510  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 333218us
I20260709 13:02:32.989200  5133 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:02:32.936331  2362 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:32.991591  1608 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:02:32.998256  1607 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:32.999974  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:32.957829  1614 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:32.992517  2370 rpcz_store.cc:269] 0709 13:02:31.617267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.617421 (+   154us) service_pool.cc:224] Handling call
0709 13:02:32.939275 (+1321854us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54001dc754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:32.939362 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320957696}
I20260709 13:02:33.018512   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:33.036880  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:33.033982  1608 pending_rounds.cc:85] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 5
I20260709 13:02:33.038597  1608 pending_rounds.cc:107] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:02:33.038919  1608 raft_consensus.cc:2889] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:33.034430  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.040606  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.019788  1685 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
W20260709 13:02:33.028708  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 64591.8us
W20260709 13:02:33.034240  1580 leader_election.cc:336] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.651s (SENT)
I20260709 13:02:33.041507  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:33.016176  1437 rpcz_store.cc:276] 0709 13:02:22.796880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:22.798522 (+  1642us) service_pool.cc:224] Handling call
0709 13:02:24.309682 (+1511160us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5400002210. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e4640 00007fd0348bbb76 00007fd0349c5c3e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc 00007fd032e85392 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:32.908002 (+8598320us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:30.477282 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:30.500988 (+ 23706us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:30.501056 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:02:30.501083 (+    27us) tablet.cc:662] Decoding operations
0709 13:02:30.502768 (+  1685us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:30.502912 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:30.502956 (+    44us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:02:30.560728 (+ 57772us) tablet.cc:701] Row locks acquired
0709 13:02:30.583318 (+ 22590us) write_op.cc:260] PREPARE: finished
0709 13:02:30.607092 (+ 23774us) write_op.cc:270] Start()
0709 13:02:30.616231 (+  9139us) write_op.cc:276] Timestamp: P: 1783602150590246 usec, L: 0
0709 13:02:30.616265 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:02:30.617060 (+   795us) log.cc:844] Serialized 4046 byte log entry
0709 13:02:31.408159 (+791099us) op_driver.cc:464] REPLICATION: finished
0709 13:02:31.633070 (+224911us) spinlock_profiling.cc:243] Waited 63.1 ms on lock 0x7b180001cd20. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:31.633309 (+   239us) write_op.cc:301] APPLY: starting
0709 13:02:31.633428 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:31.633771 (+   343us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:31.633824 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:31.912280 (+278456us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:31.912637 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:02:31.912690 (+    53us) write_op.cc:312] APPLY: finished
0709 13:02:31.913054 (+   364us) log.cc:844] Serialized 76 byte log entry
0709 13:02:31.913248 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.913383 (+   135us) write_op.cc:454] Released schema lock
0709 13:02:31.913446 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:31.913830 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:31.913857 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3181871,"reported_tablets":14,"spinlock_wait_cycles":4756608,"child_traces":[["op",{"apply.queue_time_us":27280,"apply.run_cpu_time_us":5825,"apply.run_wall_time_us":280506,"num_ops":10,"prepare.queue_time_us":260954,"prepare.run_cpu_time_us":32301,"prepare.run_wall_time_us":265217,"raft.queue_time_us":169643,"raft.run_cpu_time_us":13105,"raft.run_wall_time_us":61600,"replication_time_us":765866,"spinlock_wait_cycles":145077504,"thread_start_us":402471,"threads_started":4,"wal-append.queue_time_us":258720,"wal-append.run_cpu_time_us":35247,"wal-append.run_wall_time_us":2043345}]]}
I20260709 13:02:33.049714  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:33.018757  5170 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.018941  5168 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:33.051645  1580 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.681s (SENT)
I20260709 13:02:33.053330  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:33.056317  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.057032  1540 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.058358  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:33.012862  5089 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:33.060927  1580 leader_election.cc:336] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.716s (SENT)
I20260709 13:02:33.044065  5196 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:33.063055  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:33.047196  5132 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.065644  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:33.069471  2370 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:33.071086  1534 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:33.069977  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:33.059048  5202 raft_consensus.cc:2764] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:02:33.059979  5170 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.076756  4957 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:33.077327  4957 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:33.078506  5170 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:33.078369  4957 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.079825  4894 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:33.081085  5228 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:33.074069  2367 raft_consensus.cc:2393] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:33.074469  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 45960.1us
I20260709 13:02:33.055584  5157 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:33.064397  4958 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:33.062199  5148 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.088011  5201 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:33.061892  5119 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:33.091933  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:33.059828  5133 raft_consensus.cc:697] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:33.081540  5228 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:33.125890  5232 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:33.127033  4895 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:33.126820  5228 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.098453  5196 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:33.127655  4895 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.075353  5132 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.130541  5132 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:33.109760  5089 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:33.087060  5157 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.112604  5202 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.031565  5230 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:02:33.118455  5184 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:33.119143  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:33.120321  5238 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:33.120791  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:33.122108  5155 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:33.122808  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 71696.4us
I20260709 13:02:33.123509  5158 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:33.123749  5133 consensus_queue.cc:237] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:33.124629  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63730us
I20260709 13:02:33.125036  5119 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.139004  5196 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.137559  5157 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.141657  5202 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.143774  2367 raft_consensus.cc:2410] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:33.499838  1612 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:33.319100  1682 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:02:33.501652  1616 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:02:33.402263  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 327400us
I20260709 13:02:33.503391  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:33.204993  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.321144  1689 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:02:33.504611  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 385581us
I20260709 13:02:33.220237  1536 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:33.314028  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.135545  1540 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:33.509704  1608 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:33.505409  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:33.511474  1579 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:33.238653  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:33.506024  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:33.513983  1541 raft_consensus.cc:3060] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:33.510685  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:33.560992  1539 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
W20260709 13:02:33.510852  1580 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.769s (SENT) [suppressed 38 similar messages]
W20260709 13:02:33.561282  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 50741.6us
I20260709 13:02:33.565090  1653 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:33.564958  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54137.9us
I20260709 13:02:33.567032  1686 raft_consensus.cc:2410] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:33.460500  5165 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.572075  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:33.572973  1683 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:33.572373  5165 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.319360  1436 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:33.573674  4957 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:33.574187  4957 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:33.575091  4957 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.574878  1436 catalog_manager.cc:5697] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.194938  5226 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:02:33.578825  1580 leader_election.cc:336] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.871s (SENT)
I20260709 13:02:33.579268  5226 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:33.579447  1580 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:33.581336  5242 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:02:33.130556  4895 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:33.580555  5226 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.581082  5232 consensus_queue.cc:1059] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:33.174419  5089 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:33.249387  4877 raft_consensus.cc:3055] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:33.595616  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:33.516080  4440 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.599735  4440 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.290179  5201 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.564204  5173 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:02:33.568568  5167 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:02:33.222844  5090 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.370s
I20260709 13:02:33.393694  5243 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.590210  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:33.592180  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.516508  4859 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:33.195746  4495 raft_consensus.cc:3055] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:33.146339  4874 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:33.594657  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.579047  1436 catalog_manager.cc:5697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 7 to 8, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:33.436685  5041 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.516922  5238 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:33.597636  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.637981  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.597610  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.638358  1541 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:02:33.638432  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.639011  1534 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.575836  5165 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:33.569134  5184 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:33.632490  4495 raft_consensus.cc:740] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:33.644943  1534 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:33.644901  4495 consensus_queue.cc:260] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.645895  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.646231  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.646530  4495 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:33.646792  1538 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.647578  1539 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:33.647886  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.648293  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.648659  1538 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:33.637800  4890 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:02:33.650457  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.651103  1537 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.652324  5202 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:33.614538  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.653337  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:33.653607  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:33.624466  1580 leader_election.cc:336] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.007s (SENT)
I20260709 13:02:33.654250  1538 raft_consensus.cc:2368] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:33.654488  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:33.630256  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:33.600783  5240 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:02:33.634876  1540 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:33.635066  1533 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:33.611692  5226 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:33.612067  4895 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:33.632800  5230 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.670569  5230 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.637176  5218 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:02:33.637411  4874 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.678957  1536 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
I20260709 13:02:33.625957  5243 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.687783  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.636685  1436 catalog_manager.cc:5697] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 3 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:33.599917  4958 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:33.649780  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.582265  5155 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:33.596025  4877 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:33.649581  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.713068  1690 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:02:33.713784  1541 raft_consensus.cc:2393] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.718238  1690 pending_rounds.cc:85] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 10
I20260709 13:02:33.718576  1690 pending_rounds.cc:107] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:02:33.718732  1690 raft_consensus.cc:2889] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:33.722688  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:33.723681  1686 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:02:33.727085  1532 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:33.736526  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:33.737986  4958 raft_consensus.cc:697] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:33.738723  5243 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:33.741657  5218 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:33.744431  5197 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:33.745617  1537 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:33.745144  5197 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.746676  5157 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.748808  5197 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:33.753396  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.755051  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.755573  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.756078  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.756664  1533 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:33.756610  1538 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:33.757097  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.757930  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.758352  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.758414  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.759182  1539 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.759313  1682 raft_consensus.cc:1275] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:33.765954  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.766788  1535 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:33.771253  5228 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.807013  5167 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:02:33.810868  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.776808  1436 catalog_manager.cc:5697] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 4 to 6, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:33.811094  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.811736  1537 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.811944  1539 raft_consensus.cc:2368] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:33.782456  5157 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:33.783391  5202 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:33.640661  5041 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.788410  5184 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:33.813035  5202 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.813231  5184 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.788796  4895 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:33.712651  5155 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:33.789086  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 148926us
I20260709 13:02:33.790539  5232 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:33.791134  5170 raft_consensus.cc:3055] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:33.794607  4440 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:33.795593  4877 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.773046  1541 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:33.838019  5155 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.841464  5232 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.811291  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.843238  1540 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:33.812362  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.814471  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.844486  1535 raft_consensus.cc:2393] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.844640  1537 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:33.814806  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.739188  4958 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.839041  5170 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:33.812443  1436 catalog_manager.cc:5697] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 1 to 2, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:33.829584  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.850199  1538 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:02:33.833067  1504 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.038s	sys 0.089s
I20260709 13:02:33.832737  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:33.850704  1504 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.038s	sys 0.089s
I20260709 13:02:33.850924  1539 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
W20260709 13:02:33.851054  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 683366us
I20260709 13:02:33.833261  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.835637  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.847131  5170 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.615315  5201 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:33.844003  5041 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:33.851879  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:33.852799  1533 raft_consensus.cc:2376] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8. Re-sending same reply.
I20260709 13:02:33.861802  1686 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:02:33.837931  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.602865  5089 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:33.858866  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.864974  1538 raft_consensus.cc:2393] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.866586  1536 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.863315  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:33.850358  5119 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:33.859905  1436 catalog_manager.cc:5697] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 5 to 7, leader changed from <none> to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:33.881965  1608 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
W20260709 13:02:33.883653  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:33.885039  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.886101  1538 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:33.889652  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.875938  5041 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:33.903358  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:33.867630  5238 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:02:33.888123  5170 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.887957  4877 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:33.910053  1436 catalog_manager.cc:5697] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 2 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:33.916064  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.917122  1536 raft_consensus.cc:2368] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:33.918303  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:33.918911  1538 raft_consensus.cc:2376] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8. Re-sending same reply.
I20260709 13:02:33.901472  5232 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:33.902379  5041 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.968005  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:33.983444  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 478109us
I20260709 13:02:33.921273  5184 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:33.985296  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:33.986860  1536 raft_consensus.cc:2410] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:33.985046  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:33.994234  1436 catalog_manager.cc:5697] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:33.925061  5202 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:33.966728  5041 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:34.002027  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:34.003793  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.006331  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.004658  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:02:34.033834  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.007261  1536 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:34.034096  1436 catalog_manager.cc:5697] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 1 to 3, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.014669  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:34.046931  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:34.000217  4440 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:34.047952  1536 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:34.051096  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.046919  1614 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
W20260709 13:02:34.052172  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 487184us
I20260709 13:02:34.058060  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:34.073693  2329 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:34.011046  4495 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:34.083631  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:34.096407  1536 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:34.084702  1608 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:34.092566  5233 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:34.094092  5230 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:34.030010  5140 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.036448  5201 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:34.000552  5184 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:02:34.011670  5173 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:02:34.102838  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:34.108454  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:34.121435  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.122252  1536 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:34.123279  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:34.125243  1612 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:34.100682  5054 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:34.109190  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:34.112612  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.132833  1538 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:02:34.111789  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 498187us
I20260709 13:02:34.114156  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:34.134445  1609 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.134893  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:34.116000  1607 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:34.128497  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:34.140152  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.106539  4874 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:34.145046  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.074471  4890 consensus_queue.cc:1048] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:02:34.157272  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 274821us
I20260709 13:02:34.153097  1609 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:34.154706  1614 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:34.158249  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:34.158915  1615 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:34.159158  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.160132  1536 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:34.162261  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.124377  5157 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.128997  5090 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:34.138260  5054 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:34.128132  4440 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:34.228250  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.138942  4495 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:34.228971   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:02:34.229599  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.230026  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.230327  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.231012  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:34.232055  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.238484  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.153486  5230 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.119885  5140 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:34.244429  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:34.245047  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:34.245692  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 172098us
I20260709 13:02:34.246021  1536 raft_consensus.cc:2410] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:34.255226  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:34.256093  1687 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:34.242570  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:34.227210  5054 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:34.239264  1538 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:34.162163  5226 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.277796  5226 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.278268  4440 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.226923  5157 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.283109  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.370980  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.566644  1536 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:34.567153  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:34.567461  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:34.430228  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.568179  1533 raft_consensus.cc:2376] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11. Re-sending same reply.
I20260709 13:02:34.303043  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:34.468238  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.570564  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.436308  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 263721us
W20260709 13:02:34.572199  1580 leader_election.cc:336] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.656s (SENT)
I20260709 13:02:34.506536  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.567176  1538 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:34.573477  1534 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:34.574321  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.575001  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.574411  1538 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:34.580528  1687 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:34.434072  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.570417  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.583210  1532 raft_consensus.cc:2410] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:34.457108  4495 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.468470  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.587064  1539 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:34.578037  1688 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:34.578501  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:34.575357  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:34.579530  1533 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
W20260709 13:02:34.577373  1580 leader_election.cc:336] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.032s (SENT)
I20260709 13:02:34.589473  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.589501  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:34.590126  1538 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:34.590778  1534 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.574954  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:34.622466  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.689405  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.713358  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:34.688490  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.744597  1535 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:34.744717  1540 raft_consensus.cc:2393] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:34.287494  5259 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:34.256547  5230 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.394513  4957 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:34.564883  5258 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:02:34.743835  1682 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:34.374107  4894 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.562774  5090 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:34.641433  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.395063  5253 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:02:34.759904  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 185011us
I20260709 13:02:34.761868  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.896674  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:34.897080  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:34.892876  1539 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:34.897631  2362 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:02:34.851509  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.023s	sys 0.036s
I20260709 13:02:34.549765  5133 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:34.899016  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:34.912283  5133 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:34.912503  2368 raft_consensus.cc:2376] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4. Re-sending same reply.
I20260709 13:02:34.838277  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:34.875098  1656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.001s	sys 0.009s
I20260709 13:02:34.822654  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.913568  1537 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:34.913302  5133 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.914288  1536 raft_consensus.cc:2410] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
W20260709 13:02:34.913575  1656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.001s	sys 0.012s
W20260709 13:02:34.916170  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:34.899062  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.786405  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:34.898516  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.023s	sys 0.040s
I20260709 13:02:34.796932  1532 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:02:34.921423  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:34.920799  1538 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:02:34.871019  5252 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
W20260709 13:02:34.758527  5155 consensus_meta.cc:287] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.917s	user 0.019s	sys 0.003s
I20260709 13:02:34.585702  5233 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:34.833333  5256 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 13:02:34.859647  1682 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
W20260709 13:02:34.893450  5202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.007s
W20260709 13:02:34.929466  1607 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.001s	sys 0.018s
I20260709 13:02:34.931958  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:34.914405  5133 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:34.766646  5090 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:34.929171  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 351824us
I20260709 13:02:34.763358  5261 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.843452  5255 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:34.959556  1538 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:02:34.922356  5254 log.cc:927] Time spent T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.661s	user 0.000s	sys 0.002s
I20260709 13:02:34.939697  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:34.941030  1607 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.001s	sys 0.018s
I20260709 13:02:34.800371  5184 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:34.834355  5226 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:34.944238  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:34.946105  1580 leader_election.cc:336] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.093s (SENT)
I20260709 13:02:34.766919  5089 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:34.947432  5230 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:34.947764  5157 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:34.940768  5202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.004s	sys 0.008s
I20260709 13:02:34.929816  4859 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.962162  1534 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:34.977849  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:34.929960  5228 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.965266  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:34.980466  1536 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:34.787745  4894 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.963110  1532 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:34.766390  4957 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.763387  5259 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:34.965934  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:34.938853  5260 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:02:34.934414  5155 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.964699  5247 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:02:34.989698  5250 log.cc:927] Time spent T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:02:34.989825  2365 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46602 (request call id 362) took 1396 ms. Trace:
W20260709 13:02:34.990177  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44117us
W20260709 13:02:34.994976  5041 consensus_meta.cc:287] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.966s	user 0.002s	sys 0.008s
W20260709 13:02:34.995121  4877 consensus_meta.cc:287] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.074s	user 0.005s	sys 0.005s
I20260709 13:02:34.997393  4894 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:34.975267  5226 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:34.986555  5228 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:35.000780  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.001016  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.001304  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:35.004359  5259 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:34.941645  5233 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:34.970475  5261 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:34.969246  5140 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:35.007279  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.017202  1580 leader_election.cc:336] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.103s (SENT)
I20260709 13:02:35.016834  2365 rpcz_store.cc:276] 0709 13:02:33.593496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.593659 (+   163us) service_pool.cc:224] Handling call
0709 13:02:33.595498 (+  1839us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.616749 (+ 21251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.616781 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.633661 (+ 16880us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.121530 (+487869us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:34.121571 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.121665 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:34.989615 (+867950us) raft_consensus.cc:1685] finished
0709 13:02:34.989633 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:34.989765 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13236,"raft.queue_time_us":13441,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":13141,"thread_start_us":441690,"threads_started":1,"wal-append.queue_time_us":746580}
W20260709 13:02:35.058729  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.020674  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.020774  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 565) took 1200 ms. Trace:
I20260709 13:02:34.983448  4859 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:35.045470  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 80629.2us
I20260709 13:02:35.046329  1538 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:02:35.066605  1538 pending_rounds.cc:85] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 4
I20260709 13:02:35.066836  1538 pending_rounds.cc:107] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:35.067057  1538 raft_consensus.cc:2889] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:35.067054  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:02:35.005158  5257 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.732s	user 0.004s	sys 0.000s
W20260709 13:02:35.010612  4440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.010s	sys 0.014s
W20260709 13:02:35.049678  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 71337.4us
I20260709 13:02:35.064097  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.021037  5255 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.071547  1536 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:35.076259  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:35.060981  1690 rpcz_store.cc:276] 0709 13:02:33.805882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.805996 (+   114us) service_pool.cc:224] Handling call
0709 13:02:33.806320 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.806654 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.806679 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.807296 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 13:02:34.108936 (+301640us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:02:34.108977 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.109164 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.006233 (+897069us) raft_consensus.cc:1685] finished
0709 13:02:35.006249 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.006385 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1100,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":301166,"threads_started":1,"wal-append.queue_time_us":497300}
I20260709 13:02:35.083650  1532 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:35.087877  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:35.088380  5261 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.089550  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.090629  5233 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.090989  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.091281  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.091719  1540 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:35.092404  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:35.070994  4440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.010s	sys 0.014s
I20260709 13:02:35.092788  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.093648  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.094004  1539 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.094762  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.095463  1534 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:35.022114  5247 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.096743  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.098286  5247 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:35.099265  4859 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:35.066406  5170 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.152s	user 0.013s	sys 0.000s
I20260709 13:02:35.102871  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.093675  1540 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:35.106541  1504 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:35.100186  5155 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.053128  5041 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.117180  1539 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:35.118381  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.119119  1539 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:35.119313  1536 raft_consensus.cc:2393] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 4: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:35.119724  1504 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:35.068663  5230 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.121532  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:35.123142  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 105966us
I20260709 13:02:35.090039  5090 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.127826  4957 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:35.128247  5090 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:35.069128  5089 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:35.121394  2367 raft_consensus.cc:2393] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 12: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:35.123175  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.069114  5271 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:35.130108  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.131124  2362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "151c008abeca49c386849be63d874dca"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:02:35.202486  2362 raft_consensus.cc:606] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:35.203111  2362 raft_consensus.cc:614] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:35.131909  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:35.122360  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:35.132869  1616 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:35.140095  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:35.100950  5248 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:35.118587  5157 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.141971  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.139912  5230 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.142300  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 566) took 1334 ms. Trace:
I20260709 13:02:35.065934  5226 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:35.195587  1580 leader_election.cc:336] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.200s (SENT)
I20260709 13:02:35.315932  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:35.129181  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 62781.6us
I20260709 13:02:35.121822  5260 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.132700  5202 raft_consensus.cc:2804] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:02:35.322027  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 126517us
I20260709 13:02:35.307235  1685 rpcz_store.cc:276] 0709 13:02:33.807621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.807771 (+   150us) service_pool.cc:224] Handling call
0709 13:02:33.808374 (+   603us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.808709 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.808739 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.809518 (+   779us) log.cc:844] Serialized 501 byte log entry
0709 13:02:34.032610 (+223092us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:34.032668 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.032767 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.004798 (+972031us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b2400238dd8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b8a19c4 00007fd02b89facb 00007fd02ba5adc9 00007fd02ba5aa55 00007fd02ba5a09d 00007fd02e68c10e 00007fd02e6a388c 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221
0709 13:02:35.132243 (+127445us) raft_consensus.cc:1685] finished
0709 13:02:35.132264 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.142232 (+  9968us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79237888,"thread_start_us":222688,"threads_started":1,"wal-append.queue_time_us":432553}
I20260709 13:02:35.121428  5273 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:35.296983  5054 consensus_meta.cc:287] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.984s	user 0.012s	sys 0.000s
W20260709 13:02:35.280534  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.258858  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2048) took 1028 ms. Trace:
W20260709 13:02:35.278446  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 77770.9us
I20260709 13:02:35.249753  5041 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.233690  5173 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.260708  5259 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.259473  5228 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:35.285285  2370 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
W20260709 13:02:35.236913  5276 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:02:35.293977  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 95047us
I20260709 13:02:35.364775  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:35.293056  1609 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 3.
I20260709 13:02:35.294971  1537 raft_consensus.cc:2376] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11. Re-sending same reply.
I20260709 13:02:35.080744  5184 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:35.298655  5248 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:35.323513  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:35.368063  1684 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.292095  4859 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.329350  1681 rpcz_store.cc:276] 0709 13:02:34.230225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.232597 (+  2372us) service_pool.cc:224] Handling call
0709 13:02:34.232974 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.254642 (+ 21668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.254678 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.967112 (+712434us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b2c00142518. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:02:34.967716 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:02:35.034620 (+ 66904us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:35.034672 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.034756 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.258219 (+223463us) raft_consensus.cc:1685] finished
0709 13:02:35.258261 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.258742 (+   481us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7532,"raft.run_cpu_time_us":13126,"raft.run_wall_time_us":337322,"spinlock_wait_cycles":13315328,"thread_start_us":45631,"threads_started":1,"wal-append.queue_time_us":277146}
I20260709 13:02:35.335214  5230 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.335664  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.330866  5157 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:35.336388  1580 connection.cc:256] RPC call timeout handler was delayed by -1.0829383889999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2519s for a response
W20260709 13:02:35.375340  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.375646  1580 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.861s (SENT)
W20260709 13:02:35.377594  1580 leader_election.cc:336] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.209s (SENT)
W20260709 13:02:35.378858  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.336436  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:35.334022  5273 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.380270  1532 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.382447  5273 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:35.337710  5270 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.373459  2329 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:35.339565  5041 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:35.198078  5089 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.343425  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:35.347045  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:35.347461  5246 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.025s	user 0.005s	sys 0.001s
I20260709 13:02:35.353461  5226 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.355314  5133 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.401391  1686 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:35.327838  5260 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.370668  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:35.386569  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:35.295907  5271 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.374652  1685 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:35.399474  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:35.415072  2367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 478) took 1304 ms. Trace:
I20260709 13:02:35.415197  2365 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:35.416520  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.341992  5054 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.384433  5228 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:35.415535  2367 rpcz_store.cc:276] 0709 13:02:34.110849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.111092 (+   243us) service_pool.cc:224] Handling call
0709 13:02:35.414819 (+1303727us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b54001a5c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:35.415007 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257294720}
I20260709 13:02:35.423735  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.384886  4859 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.419340  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:35.430822  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.427932  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:35.364825  5259 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.376132  5184 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.436450  1684 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:02:35.437199  1532 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:35.437480  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.448432  1681 raft_consensus.cc:2393] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:35.437973  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.449175  1541 raft_consensus.cc:2410] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:35.439553  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.449620  1533 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9. Re-sending same reply.
I20260709 13:02:35.450573  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:35.451133  1533 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.435288  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.419363  5282 raft_consensus.cc:2804] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:35.419413  5273 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.445942  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.424443  5196 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.441635  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 489) took 1186 ms. Trace:
I20260709 13:02:35.453402  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:35.464578  2368 raft_consensus.cc:2368] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12.
I20260709 13:02:35.464677  1607 rpcz_store.cc:276] 0709 13:02:34.248233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.248471 (+   238us) service_pool.cc:224] Handling call
0709 13:02:34.268801 (+ 20330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:34.269281 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:34.269317 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:34.270474 (+  1157us) log.cc:844] Serialized 501 byte log entry
0709 13:02:34.963244 (+692770us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:34.963288 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:34.963361 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.434261 (+470900us) raft_consensus.cc:1685] finished
0709 13:02:35.434288 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.434458 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":692289,"threads_started":1,"wal-append.queue_time_us":699396}
I20260709 13:02:35.364575  5173 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.468518  5157 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.454336  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.481781  1684 raft_consensus.cc:1240] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:02:35.438280  5202 raft_consensus.cc:697] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:35.456574  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.400178  5247 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:02:35.475855  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.419387  5133 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:35.478355  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.424456  5197 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:02:35.450333  5267 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:35.483978  1608 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:02:35.480548  1533 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:35.476101  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:35.503067  1608 raft_consensus.cc:606] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Received request to transfer leadership to TS f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.503674  1608 raft_consensus.cc:614] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:35.456584  5282 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.456655  4894 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:35.493081  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.482041  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.514816  1532 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:35.515831  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.517009  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.500799  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 564) took 1695 ms. Trace:
I20260709 13:02:35.472893  5196 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.501523  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.463984  5273 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:35.498193  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 124792us
W20260709 13:02:35.501976  1616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2080) took 1441 ms (client timeout 1634 ms). Trace:
I20260709 13:02:35.502159  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.505437  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.504354  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.506487  1682 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:02:35.504317  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:35.508596  1579 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:35.521644  1616 rpcz_store.cc:269] 0709 13:02:34.060841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.061215 (+   374us) service_pool.cc:224] Handling call
0709 13:02:35.501791 (+1440576us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54002f0b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:35.501916 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259394944}
I20260709 13:02:35.519676  1537 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:35.500861  5267 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.512944  5282 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:35.524575  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.524796  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.560626  1653 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:35.520269  1541 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:35.517870  1689 rpcz_store.cc:276] 0709 13:02:33.805521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:33.820142 (+ 14621us) service_pool.cc:224] Handling call
0709 13:02:33.841642 (+ 21500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:33.841979 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:33.842003 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:33.842991 (+   988us) log.cc:844] Serialized 501 byte log entry
0709 13:02:33.985565 (+142574us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:33.985624 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:33.985743 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:35.346679 (+1360936us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:35.491828 (+145149us) raft_consensus.cc:1685] finished
0709 13:02:35.491856 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:35.500709 (+  8853us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112743168,"thread_start_us":142161,"threads_started":1,"wal-append.queue_time_us":337611}
I20260709 13:02:35.561887  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:35.562338  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.562594  1541 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.512962  4894 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.564708  1532 raft_consensus.cc:2393] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 3: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:35.560859  1533 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:35.516309  4877 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:35.563843  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.576269  1541 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:02:35.577378  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.523823  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.522337  5273 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.521361  5196 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.573735  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:35.580075  1616 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.573820  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.574393  1607 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:35.581719  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:35.581825  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58075.7us
I20260709 13:02:35.582209  1688 raft_consensus.cc:3060] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:35.582902  1579 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.563903  5255 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:35.586788  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.584533  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.587818  1689 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:35.585034  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:35.588778  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.589092  1684 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.585608  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.590695  1537 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:35.592558  1580 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.589938  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:35.596364  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:35.600601  1614 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:35.574781  4495 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:35.575088  4894 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:35.559283  5267 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:35.616415  4890 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:35.616634  5133 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:35.617031  4890 raft_consensus.cc:697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:35.617516  5133 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:35.618100  4890 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.586957  5270 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.598165  5202 consensus_queue.cc:237] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.478319  5248 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.586869  5255 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.575105  5054 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.612221  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:35.613260  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:35.579465  5170 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.583725  5157 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:35.615897  5292 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:02:35.586449  5155 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:35.587018  5226 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:35.602136  1616 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:02:35.631310  1688 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:02:35.612754  5089 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:35.608363  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 104113us
I20260709 13:02:35.647580  1614 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:35.647377  1684 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:35.611171  4495 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:35.625056  5184 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:35.657652  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:35.649091  5255 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:35.663672  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:35.666719  1609 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:35.660547  1611 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:35.667460  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:35.657716  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:35.665273  1537 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:35.668563  1616 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 2.
I20260709 13:02:35.672220  1613 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:35.644877  5297 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:35.678560  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.624271  5285 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:02:35.680473  1684 raft_consensus.cc:2410] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:02:35.664601  4495 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:02:35.690305  5289 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:02:35.692433  1611 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:02:35.666998  5230 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:35.651607  5170 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.672461  5300 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:35.691247  5290 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:02:35.673413  5089 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:35.657953  5226 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:35.705801  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.683751  4859 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:35.668817  4877 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:35.700048  5260 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.704416  5259 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.717244  5226 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:35.735932  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.739125  1534 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 3.
I20260709 13:02:35.710813  5089 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:35.704715  5271 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.742017  5291 consensus_queue.cc:1059] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:02:35.748631  5287 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:02:35.751147  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.752076  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.792692  1687 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:35.799418  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 209509us
I20260709 13:02:35.804517  5291 raft_consensus.cc:3055] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:35.805207  5291 raft_consensus.cc:740] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:35.806466  5291 consensus_queue.cc:260] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.808710  2329 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:35.812417  5291 raft_consensus.cc:3060] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:35.824841  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 232411us
I20260709 13:02:35.826974  1580 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.825373  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:35.830055  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 233055us
I20260709 13:02:35.760293  5089 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:35.845182  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:35.797278  5285 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:35.846230  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:35.853654  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.856341  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:35.851536  5314 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:02:35.851300  4894 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.864379  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.711699  5300 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.867990  1538 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:35.869235  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.871568  1534 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:35.877948  2328 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:35.879438  1538 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:02:35.880980  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54074.6us
I20260709 13:02:35.881232  1683 raft_consensus.cc:2368] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:35.883545  5262 raft_consensus.cc:2804] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:35.860492  5271 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:35.885442  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:35.887650  1534 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:35.888988  5312 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:35.889462  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2045) took 1660 ms. Trace:
I20260709 13:02:35.889539  5312 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:35.890391  5312 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:35.882104  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:35.890193  1686 rpcz_store.cc:276] 0709 13:02:34.229327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.231913 (+  2586us) service_pool.cc:224] Handling call
0709 13:02:34.232236 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.411687 (+1179451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:35.889228 (+477541us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003a4654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:35.889403 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683086208}
I20260709 13:02:35.896864  1538 raft_consensus.cc:2955] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 4 to 7, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:35.907133  1533 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:35.910876  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.861542  4877 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.863471  5285 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.910557  5271 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:35.922577  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 67726.4us
I20260709 13:02:35.913573  5262 raft_consensus.cc:697] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:35.807485  5311 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:02:35.940775  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 58270.9us
I20260709 13:02:35.940938  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "788938c376a646979b8eee973560dc65"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:02:35.941524  1607 raft_consensus.cc:606] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:35.941872  1607 raft_consensus.cc:614] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:35.942793  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.946261  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.947068  1682 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
W20260709 13:02:35.950237  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:35.933101  5170 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.936257  5054 raft_consensus.cc:2804] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:35.952208  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:35.957755  1682 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9. Re-sending same reply.
I20260709 13:02:35.959733  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:35.961344  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:35.960748  5313 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:02:35.971154  5267 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.973042  4894 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:35.973937  5267 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:35.974972  1686 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:35.977957  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 100137us
I20260709 13:02:35.936172  5271 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.974112  5262 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:35.987300  5271 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:35.994711  5226 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:35.996299  1608 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:35.996858  5316 log.cc:927] Time spent T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:02:35.997658  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.001180  5300 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:35.962365  5170 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.006817  1685 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:36.008585  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:36.012356  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 70806.5us
I20260709 13:02:36.018158  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:36.234201  2370 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
W20260709 13:02:36.263221  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 250868us
I20260709 13:02:36.185039  1681 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:02:36.199604  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1675) took 1935 ms. Trace:
W20260709 13:02:36.264295  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 251037us
W20260709 13:02:36.185477  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 329343us
I20260709 13:02:36.261096  1607 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:02:36.265865  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:35.975720  5041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43382 (request call id 1) took 3028 ms. Trace:
I20260709 13:02:36.264912  1683 rpcz_store.cc:276] 0709 13:02:34.264411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.418830 (+1154419us) service_pool.cc:224] Handling call
0709 13:02:36.199289 (+780459us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54003a4b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:36.199509 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987389696}
I20260709 13:02:36.261583  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:36.266721  1607 raft_consensus.cc:606] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:36.269830  1607 raft_consensus.cc:614] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:36.098261  4495 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.266170  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:35.987936  5271 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:36.143426  5196 consensus_meta.cc:287] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.547s	user 0.012s	sys 0.000s
I20260709 13:02:36.284194  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:36.284870  1532 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:36.013531  5054 raft_consensus.cc:697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:36.076592  5255 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.289403  5170 consensus_queue.cc:1059] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:36.290218  5170 consensus_queue.cc:1243] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer 9d926c10b90f452ba52d80dab6a50351 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:02:36.184883  5089 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.290407  5054 consensus_queue.cc:237] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.286751  4495 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:36.292774  5089 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.293412  5089 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.294031  5089 raft_consensus.cc:3055] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:36.086758  5173 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.294402  5089 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:36.290791  5255 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.295302  5089 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.122048  5133 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:36.269337  5041 rpcz_store.cc:276] 0709 13:02:32.933615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.933779 (+   164us) service_pool.cc:224] Handling call
0709 13:02:33.058324 (+124545us) log.cc:844] Serialized 501 byte log entry
0709 13:02:33.799521 (+741197us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b540090cf20. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7ddbe 00007fd02ea88930 00007fd02ea888d8 00007fd02ea88858 00007fd02ea88813 00007fd02ea87a9c 00007fd034973626 00007fd03496ddd8 00007fd02eac47cb 00007fd02eac72c0
0709 13:02:35.958829 (+2159308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58939,"raft.queue_time_us":57127,"raft.run_cpu_time_us":24173,"raft.run_wall_time_us":422961,"spinlock_wait_cycles":82788608,"thread_start_us":46509,"threads_started":1,"wal-append.queue_time_us":526225,"wal-append.run_cpu_time_us":11198,"wal-append.run_wall_time_us":1235026}
I20260709 13:02:36.296815  5133 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.085243  5285 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.265352  5322 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:36.076141  5324 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.252s
I20260709 13:02:36.039683  5282 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:36.320013  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 46498.4us
W20260709 13:02:36.524545  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.305461  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.540942  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 303932us
W20260709 13:02:36.541983  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.546999  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:36.547345  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:36.549471  1682 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 12. Current term is 13. Ops: []
W20260709 13:02:36.489115  5312 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.005s
W20260709 13:02:36.444468  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49067.5us
W20260709 13:02:36.552752  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 284641us
I20260709 13:02:36.485172  5300 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:36.554946  5312 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.552954  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:36.560240  5312 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.562988  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:36.563969  4877 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:36.564870  4877 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.567377  4877 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:36.567881  1685 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:36.568171  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.483556  4894 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:36.392081  5133 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.444137  5226 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:36.570483  2368 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46612 (request call id 254) took 1639 ms (client timeout 2074 ms). Trace:
I20260709 13:02:36.572666  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:36.573998  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:36.553920  5291 consensus_meta.cc:287] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.005s
W20260709 13:02:36.568861  5273 consensus_meta.cc:287] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.969s	user 0.009s	sys 0.001s
I20260709 13:02:36.574699  5302 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:36.547466  5322 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.578199  5302 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.578998  5329 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:02:36.578107  5273 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.578524  5291 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:36.575738  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:36.576666  2368 rpcz_store.cc:269] 0709 13:02:34.931255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:34.931422 (+   167us) service_pool.cc:224] Handling call
0709 13:02:36.570278 (+1638856us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400511654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:36.570420 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175579392}
I20260709 13:02:36.554448  1689 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:02:36.595423  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 329328us
I20260709 13:02:36.288573  5196 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.605453  1685 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:36.572182  5202 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:36.598739  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:36.601243  2368 raft_consensus.cc:1240] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:36.597666  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:36.288414  5271 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.608069  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:36.608244  1613 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:02:36.611080  1613 raft_consensus.cc:606] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:36.611492  1613 raft_consensus.cc:614] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:36.612986  1685 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:36.613114  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.614481  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.619897  1684 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:36.596767  5269 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:36.622375  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 582) took 1499 ms. Trace:
I20260709 13:02:36.623263  1580 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:36.624837  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.571830  5300 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.573240  4894 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.625815  1616 raft_consensus.cc:2955] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:36.622920  1536 rpcz_store.cc:276] 0709 13:02:35.119668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.122478 (+  2810us) service_pool.cc:224] Handling call
0709 13:02:35.122805 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.475653 (+352848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:35.475690 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:35.475741 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:35.475777 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.618742 (+1142965us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54001fca54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:36.618838 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:36.618959 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":809068928}
W20260709 13:02:36.627847  1540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34908 (request call id 587) took 1489 ms (client timeout 1687 ms). Trace:
I20260709 13:02:36.629146  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:36.634586  1540 rpcz_store.cc:269] 0709 13:02:35.133190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.141564 (+  8374us) service_pool.cc:224] Handling call
0709 13:02:36.621214 (+1479650us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b540006bb54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:36.622289 (+  1075us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284477824}
I20260709 13:02:36.599135  5291 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.637815   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:36.622622  5269 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.641384  1580 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.641739  1685 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:36.650489  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:36.638432  5226 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:36.652900  5226 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.648553  5255 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:36.656150  4894 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:36.658478  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:36.659616  5230 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.659770  5226 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.661947  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:36.626528  5325 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.670145  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.623674  5333 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:36.628270  5324 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:36.623981  5334 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.633155  5285 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:36.694643  1505 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.601s (SENT)
I20260709 13:02:36.709836  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.608086  5202 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:36.696784  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 46238.3us
I20260709 13:02:36.638342  5302 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.649426  5269 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:36.696411  5133 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.715839  5324 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:36.744616  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:36.688501  5261 consensus_queue.cc:1059] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:02:36.746146  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 104816us
I20260709 13:02:36.728750  5302 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.748848  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:36.754364  1683 raft_consensus.cc:2393] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 13: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:36.754995  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.757758  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.762529  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:36.763012  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 68418us
I20260709 13:02:36.763240  5285 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:36.763609  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.764340  5285 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.767422  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:36.768375  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.769340  5312 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.769732  5312 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:36.770080  5312 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.773633  5324 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.775426  4877 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:36.751508  5311 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43382 (request call id 2) took 3817 ms. Trace:
I20260709 13:02:36.793751  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:36.794763  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.760892  5334 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.797124  5226 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:36.797909  4957 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:36.796427  5285 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:36.811107  5285 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:36.802842  5336 log.cc:927] Time spent T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:36.803326  5202 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.775996  4877 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:36.812371  5322 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:36.801749  5255 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:02:36.815258  4877 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:36.765410  5333 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:36.820685  5306 log.cc:927] Time spent T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:36.814445  5285 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:36.824220  5196 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:36.825670  5271 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:36.827339  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.835716  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2088) took 1226 ms. Trace:
W20260709 13:02:36.835915  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 59001.5us
I20260709 13:02:36.837380  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.838084   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:36.840452  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.842114  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:36.836297  1608 rpcz_store.cc:276] 0709 13:02:35.609423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.609614 (+   191us) service_pool.cc:224] Handling call
0709 13:02:35.648861 (+ 39247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.996820 (+347959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.835415 (+838595us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400348ad4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:36.835639 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798358400}
W20260709 13:02:36.803946  5335 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:02:36.914228  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 73847.6us
I20260709 13:02:36.923511  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:36.918437  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 124604us
I20260709 13:02:36.920557  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.921232  5255 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:36.929693  1580 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.930819  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:36.933648  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:36.936465  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.936782  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:36.937398  1612 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:36.939424  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:36.843545  5271 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:36.939042  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:36.964926  1608 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:36.966368  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.967494  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:02:36.968462  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:36.942807  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:36.943984  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:36.943529  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:36.969920  1615 raft_consensus.cc:2368] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:36.944571  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:36.944836  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:36.950227  5226 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:36.950533  5273 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:36.928895  5255 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:36.951711  5345 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:36.952970  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1690) took 1012 ms. Trace:
I20260709 13:02:36.982059  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:36.981873  1686 rpcz_store.cc:276] 0709 13:02:35.941024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.941172 (+   148us) service_pool.cc:224] Handling call
0709 13:02:35.941533 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:35.990536 (+ 49003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:36.952656 (+962120us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b5400412154. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:36.952890 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76058368}
I20260709 13:02:36.988162  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:36.989122  1612 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:36.990477  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:36.953540  5291 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:36.940069  5342 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:36.940155  5261 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:02:36.938005  5322 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:36.955173  5133 raft_consensus.cc:3055] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:36.956806  5089 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.959766  1683 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:37.004472  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:36.960945  5300 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:36.924145  5196 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:36.844115  5333 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:36.971110  1614 raft_consensus.cc:2368] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:36.971134  1609 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.944199  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.026405  1683 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:02:36.999301  5322 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:36.995597  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 110996us
I20260709 13:02:36.975524  5226 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:36.981081  5255 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:36.998267  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:37.002146  5133 raft_consensus.cc:740] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:02:37.037496  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45264.4us
I20260709 13:02:37.039088  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.047852  1654 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:37.050158  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.048038  1607 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:37.052350  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.046129  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:37.053521  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 44140.3us
I20260709 13:02:37.055872  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:37.051635  5174 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:02:37.061110  1609 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:37.035277  5226 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:37.022583  5323 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:02:37.071421  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.025775  5196 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.086247  1653 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:37.069772  4859 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:02:37.035797  5322 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.147521  5196 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:37.088265  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:37.149197  5351 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:37.150244  1615 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:02:37.085104  5133 consensus_queue.cc:260] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.155434  5133 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:37.089231  1579 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:37.156906  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 67788.9us
I20260709 13:02:37.057004  5247 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:02:37.141934  4859 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.168341  4859 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:37.149129  1611 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:37.088068  5333 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.144141  1610 raft_consensus.cc:2368] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:37.160486  1612 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:36.776367  5311 rpcz_store.cc:276] 0709 13:02:32.933987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:32.973686 (+ 39699us) service_pool.cc:224] Handling call
0709 13:02:33.053200 (+ 79514us) log.cc:844] Serialized 501 byte log entry
0709 13:02:33.183813 (+130613us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b180042f6a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02ea61b0b 00007fd02eae6b63 00007fd02eb0e752 00007fd02eb069fa
0709 13:02:33.779668 (+595855us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b5400701fa0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7ddbe 00007fd02ea88930 00007fd02ea888d8 00007fd02ea88858 00007fd02ea88813 00007fd02ea87a9c 00007fd034973626 00007fd03496ddd8 00007fd02eac47cb 00007fd02eac72c0
0709 13:02:36.748720 (+2969052us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73950,"raft.queue_time_us":102792,"raft.run_cpu_time_us":1425,"raft.run_wall_time_us":1432,"spinlock_wait_cycles":269563648,"thread_start_us":10079,"threads_started":1,"wal-append.queue_time_us":233153,"wal-append.run_cpu_time_us":6686,"wal-append.run_wall_time_us":1459839}
I20260709 13:02:37.158926  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:37.271868  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 113021us
I20260709 13:02:37.272719  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.165637  4957 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:37.167675  5196 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:37.283164  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:37.178159  5346 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:02:37.053021  5269 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.195405  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.140091  5248 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:37.175645  5324 raft_consensus.cc:2764] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:02:37.229895  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.290771  1610 raft_consensus.cc:2368] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
W20260709 13:02:37.241465  5325 consensus_meta.cc:287] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:02:37.247359  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:37.292419  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 354828us
I20260709 13:02:37.298357  1612 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:37.249585  1689 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:37.249737  5334 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.268908  1686 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:37.273917  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.273917  1579 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:37.303438  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:37.289024  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.305434  1615 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:37.305235  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:37.306497  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.307112  1615 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:37.307255  5271 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:37.296721  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.307978  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.312323  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.314415  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:37.315891  1614 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:37.175334  5322 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.311517  1615 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:37.320945  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.322978  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:37.343261  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:37.299944  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 212856us
I20260709 13:02:37.325969  5226 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.326994  5270 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.351962  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:37.329690  5334 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:37.332257  5300 consensus_queue.cc:1059] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:37.332733  5342 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:37.279312  5333 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.336277  2370 raft_consensus.cc:1240] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.214275  5312 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.291057  5248 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.319538  5230 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:37.318373  5325 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.319072  5261 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.308498  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a93cfc3bb7634fb1b78c60f120616d9d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:37.319796  5271 raft_consensus.cc:697] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:37.338858  5285 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.335119  5302 consensus_queue.cc:1059] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:02:37.346755  5314 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.363926  1610 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:37.363951  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 277832us
I20260709 13:02:37.361083  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.339687  5090 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:02:37.340687  5272 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 13:02:37.367621  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.373557  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.388307  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:37.388938  1533 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.389678  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:37.390630  1541 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:37.359355  5350 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:37.365175  5248 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.388530  1613 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:37.394465  1609 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:37.401198  1533 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:37.401882  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.359440  5196 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:02:37.381187  5285 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:37.405198  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 90935.2us
I20260709 13:02:37.406626  1538 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:37.413002  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:37.384645  5302 consensus_queue.cc:1243] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:37.378753  5230 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:37.408797  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:37.409133  1615 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
W20260709 13:02:37.383003  1423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 87076.2us
I20260709 13:02:37.384795  5314 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.404345  5350 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.424721  5314 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:37.425387  5089 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.425948  5089 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.426999  5350 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:37.402856  5345 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:37.428550  5345 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.431062  4859 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.433465  4859 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:37.434335  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.435168  5089 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:37.379375  5261 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.436796  5255 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.438351  5261 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:37.415022  5218 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:37.439355  5218 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:37.439656  1612 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:37.441625  5269 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:37.443804  5230 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.440173  5255 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:37.419663  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.458885  1613 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:02:37.459760  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:37.461438  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.468317  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.469069  1613 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.472218  5271 consensus_queue.cc:237] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.477797  1608 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 3.
I20260709 13:02:37.478473  1613 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:37.479591  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.480365  1613 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.483223  5357 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.483884  5357 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.486521  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:37.487361  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.488947  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.490250  1613 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:37.490691  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.492409  1681 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:37.492961  1688 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:02:37.493449  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.494060  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:37.494566  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:37.494712  1688 raft_consensus.cc:2376] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8. Re-sending same reply.
I20260709 13:02:37.472240  1615 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:37.496513  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:37.496878  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.497736  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.498637  1683 raft_consensus.cc:2368] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:37.501132  1611 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:02:37.501369  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.504122  5261 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:37.504501  1538 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:37.504944  1538 pending_rounds.cc:85] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 5
I20260709 13:02:37.505021  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:37.505158  5261 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:37.505796  5261 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:37.506680  5261 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.509605  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.505224  1538 pending_rounds.cc:107] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:37.511606  1538 raft_consensus.cc:2889] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.472918  5270 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.514344  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.516448  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:37.517166  1541 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:37.518185  5349 log.cc:927] Time spent T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.434s	user 0.007s	sys 0.000s
I20260709 13:02:37.519601  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.520331  1607 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
I20260709 13:02:37.521194  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.521859  1607 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:37.515393  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.524796  1535 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:37.508157  5291 consensus_queue.cc:1059] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:02:37.524377  5218 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.526557  5350 raft_consensus.cc:3055] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:37.527952  5350 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:37.528836  5202 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:37.528905  5350 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.530498  5350 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:37.530534  5248 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.508013  5261 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:37.508023  5345 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:37.536689  5218 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:37.538332  5133 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:37.524637  5357 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:37.540551  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.540861  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.541312  1607 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:37.541826  1541 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:37.542444  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.542943  5322 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:37.543376  1607 raft_consensus.cc:2368] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:37.524739  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:37.552179  1613 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:37.553627  1539 raft_consensus.cc:1813] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Handling vote request from an unknown peer f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:37.553224  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.554248  1539 raft_consensus.cc:2410] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:02:37.554527  1607 raft_consensus.cc:2393] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:37.545717  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.555526  1610 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:37.538872  5133 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:37.559424  1607 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.559522  1504 leader_election.cc:400] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:37.568934  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:37.569166  1504 leader_election.cc:403] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:37.560845  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 503) took 1284 ms. Trace:
I20260709 13:02:37.559525  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:37.570047  1616 rpcz_store.cc:276] 0709 13:02:36.276907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.277027 (+   120us) service_pool.cc:224] Handling call
0709 13:02:36.290005 (+ 12978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.625686 (+335681us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:36.693956 (+ 68270us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.740859 (+ 46903us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.740930 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:36.740978 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.560645 (+819667us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54003a2ad4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:37.560687 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.560792 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5090,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"spinlock_wait_cycles":771498368,"thread_start_us":46509,"threads_started":1,"wal-append.queue_time_us":197433}
W20260709 13:02:37.572163  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.573272  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.574097  1685 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:37.552660  5248 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:37.575255  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.582113  1613 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:37.582235  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.588780  1610 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:37.569597  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.590051  1607 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:37.590868  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.593152  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.593752  1614 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:37.595449  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:37.596302  1539 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:37.590477  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:37.597671  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:37.544611  5285 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:37.602710  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.603644  1607 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:37.601370  1682 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:37.604673  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.605340  1607 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:37.606266  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.606832  1607 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.578410  5291 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:37.608599  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:37.611946  1611 raft_consensus.cc:2376] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4. Re-sending same reply.
I20260709 13:02:37.613104  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.609364  1539 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:37.608407  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.622018  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.623095  1610 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 6: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:37.607581  5322 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:37.618708  5133 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:37.645992  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 78235.7us
I20260709 13:02:37.655377  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.622992  5255 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.670001  1607 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:37.628626  5322 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.618515  5285 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:02:37.725821  1615 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:02:37.654826  5247 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:37.747941  1611 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:02:37.753532  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:37.757480  5357 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:37.718274  5322 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.763836  1682 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:37.787211  1613 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.791340  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:37.797271  5325 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:37.797912  5325 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.798707  5089 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:37.791414  5270 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:02:37.799571  5089 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.808624  5350 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:37.809338  5350 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.810490  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:37.811508  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:37.718392  5255 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.816120  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:37.751003  5133 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.837937  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:37.838905  1610 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:37.856428  1614 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:37.799948  5325 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:37.873857  5300 raft_consensus.cc:3055] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:37.874533  5300 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:37.883750  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:37.887050  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:37.817276  5355 raft_consensus.cc:2764] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:02:37.758612  5247 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:37.892714  1612 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:37.836658  5089 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:37.848848  4859 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:37.897478  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:37.898037  1612 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:37.950888  1614 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:37.875514  5300 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:37.863637  5243 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
W20260709 13:02:37.957938  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 367343us
I20260709 13:02:37.922421  5196 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:37.919152  4859 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:37.938638  5285 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:37.993638  5300 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:37.983853  4859 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:37.990842  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 599) took 1329 ms. Trace:
W20260709 13:02:37.998008  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:37.965474  5305 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:37.995409  1536 rpcz_store.cc:276] 0709 13:02:36.661543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.663676 (+  2133us) service_pool.cc:224] Handling call
0709 13:02:36.664063 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:36.698232 (+ 34169us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:36.721205 (+ 22973us) log.cc:844] Serialized 14 byte log entry
0709 13:02:36.727184 (+  5979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:36.727245 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:36.727285 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:37.986638 (+1259353us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b54001e8554. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:37.990528 (+  3890us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:37.990742 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5682,"prepare.queue_time_us":255071,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":24860,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":78018816,"thread_start_us":22304,"threads_started":1}
I20260709 13:02:38.007369  2370 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53388 (request call id 486) took 1008 ms. Trace:
I20260709 13:02:38.007845  2370 rpcz_store.cc:276] 0709 13:02:36.999095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:36.999228 (+   133us) service_pool.cc:224] Handling call
0709 13:02:36.999499 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.363138 (+363639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.007083 (+643945us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400581bd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:38.007299 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774043904}
I20260709 13:02:38.014449  4859 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.017370  4859 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:38.025296  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.029827  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.030476  5291 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.031100  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.032074  5261 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.032569  5261 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:38.033022  5261 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.031234  5291 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.036865  5226 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:38.037948  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:38.039896  5291 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:38.058110  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.062070  5322 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.064997  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 2063) took 2105 ms. Trace:
I20260709 13:02:38.065443  1684 rpcz_store.cc:276] 0709 13:02:35.959700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:35.961057 (+  1357us) service_pool.cc:224] Handling call
0709 13:02:38.064735 (+2103678us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b540015ca54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:38.064899 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1512591744}
I20260709 13:02:38.073357  5322 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:38.077876  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:38.079737  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:38.081725  1684 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:38.087523  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:38.086740  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:38.088856  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:38.089651  1684 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.100445  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:38.056481  5350 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:38.024907  5157 consensus_queue.cc:1059] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:02:38.055395  5352 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:38.107388  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 248604us
I20260709 13:02:38.099912  5133 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:38.123383  1684 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:38.125176  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:38.126349  5271 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:38.126897  5271 raft_consensus.cc:697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:38.127772  5271 consensus_queue.cc:237] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.132344  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:38.136698  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 78713.2us
I20260709 13:02:38.137557  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:38.133141  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:38.139585  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:38.103315  5291 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:02:38.133222  5255 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:38.152910  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:38.159847  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.116189  5352 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:38.160799  4859 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:38.162231  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.153234  1654 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:38.150724  5353 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:38.169770  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.170994  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:38.150708  5350 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:38.178224  5248 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:38.139377  5157 consensus_queue.cc:1059] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:38.182475  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:38.182626  5357 raft_consensus.cc:3055] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:38.188763  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:38.215723  1608 raft_consensus.cc:3060] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:38.189805  5305 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.190148  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:38.221740  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.222790  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.195313  1536 raft_consensus.cc:1275] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:02:38.224329  1536 pending_rounds.cc:85] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 10
I20260709 13:02:38.224588  1536 pending_rounds.cc:107] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:02:38.224854  1536 raft_consensus.cc:2889] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.199258  5353 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.170681  5247 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:38.204485  1613 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:38.180627  5282 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:38.205825  5248 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:38.215274  5357 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.237564  5350 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:38.240968  5355 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:02:38.263132  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 101076us
I20260709 13:02:38.265136  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:38.255863  5248 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:38.272583  5291 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:38.272799  5350 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:38.273401  5291 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.168431  4859 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.274448  4859 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.276336  5357 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:38.201449  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:38.278131  5355 raft_consensus.cc:697] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.279117  5355 consensus_queue.cc:237] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.267977  1536 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:02:38.262673  5300 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:38.261324  5312 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:38.270134  5041 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:38.271066  5353 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:38.234381  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51991.8us
I20260709 13:02:38.277720  5357 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:38.221962  5230 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.014s	sys 0.022s
I20260709 13:02:38.233356  1608 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 5.
I20260709 13:02:38.305843  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.310091  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:38.330932  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 108205us
I20260709 13:02:38.333132  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.336371  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1762) took 1052 ms. Trace:
I20260709 13:02:38.336727  1505 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.338474  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:37.839664   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:38.341329  1612 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:38.336917  1610 rpcz_store.cc:276] 0709 13:02:37.283936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.712453 (+428517us) service_pool.cc:224] Handling call
0709 13:02:37.792784 (+ 80331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:37.839494 (+ 46710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.336126 (+496632us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b5400409cd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:38.336306 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105417088}
W20260709 13:02:38.357223  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.357905  1682 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:38.361769  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.363265  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:38.365744  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.373126  5391 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:38.373562  5247 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:02:38.335129  5230 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.014s	sys 0.022s
I20260709 13:02:38.373989  5391 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:38.324642  5350 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.386926  1616 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:38.372459  5300 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:38.370783  5291 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:38.374629  5388 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:02:38.371014  5157 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:38.376624  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.378659  5391 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:38.370503  5297 consensus_queue.cc:1048] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 13:02:38.447065  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 72821.8us
I20260709 13:02:38.423727  5389 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:38.382614  5322 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:02:38.434274  5291 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:38.459520  5384 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:02:38.446951  5247 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:38.460438  5247 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.461345  5247 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.462868  5247 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.463020  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1761) took 1207 ms. Trace:
I20260709 13:02:38.468988  5291 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.463425  1616 rpcz_store.cc:276] 0709 13:02:37.275392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.571931 (+296539us) service_pool.cc:224] Handling call
0709 13:02:37.595006 (+ 23075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:38.387350 (+792344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.462760 (+ 75410us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b54001b5dd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:38.462955 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1820924672}
W20260709 13:02:38.445775  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 69292.6us
I20260709 13:02:38.390492  5356 consensus_queue.cc:1059] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:02:38.387624  5381 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:02:38.436523  5387 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:38.447281  5300 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:38.391068  5350 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:38.446813  5391 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:38.505383  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 169816us
I20260709 13:02:38.483455  5352 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:38.497364  5387 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:38.532980  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:38.533814  5350 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:38.535954  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:38.536749  1536 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:38.536882  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:38.537580  1612 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:38.539067  5196 consensus_queue.cc:1059] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:38.539834  5196 consensus_queue.cc:1243] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer e8eefefed88a4903b423e9f487c4805a log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:38.540419  5196 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:38.543633  5196 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:38.545147  5396 raft_consensus.cc:3055] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:38.545588  5396 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.546653  5089 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:38.546393  5396 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.547340  5089 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.550263  5089 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:38.551506  5133 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:38.552007  5133 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:38.552224  5243 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.552734  5243 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.552893  5133 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.553532  5243 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.554805  5243 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:38.556150  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.558051  5248 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:38.560343  1536 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:38.573226  1541 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:02:38.573691  1541 pending_rounds.cc:85] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 4
I20260709 13:02:38.573930  1541 pending_rounds.cc:107] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:02:38.574186  1541 raft_consensus.cc:2889] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:38.577422  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:38.578217  1610 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.586035  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:38.589069  1609 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.579389  1608 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:38.583127  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:38.592407  1532 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.594903  1612 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 4.
I20260709 13:02:38.585259  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:38.547840  5396 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.606892  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:38.610666  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:38.611969  1615 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:38.612221  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.602458  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:38.554215  5133 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:38.619199  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:38.620378  1532 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:38.620304  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.621635  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:38.606938  5248 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:38.622792  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:38.630635  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:38.632359  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:38.636332  1682 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:38.568710  5387 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:38.642733  5297 consensus_queue.cc:1059] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:38.643953  5297 raft_consensus.cc:3055] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:38.644482  5297 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:38.646144  5380 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:38.646627  5380 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.647426  5380 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.648499  5380 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.654222  5395 raft_consensus.cc:3055] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:38.645377  5297 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:38.654728  5395 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:38.655740  5395 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.657011  5395 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:38.659220  5297 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:38.513990  5261 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.662230  1610 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:38.662429  5261 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:38.666159  1536 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:38.666419  1609 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:38.667629  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 55510.7us
I20260709 13:02:38.675431  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:38.678190  1686 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:38.693099  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:38.693717  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 72170us
W20260709 13:02:38.694624  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.701048  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:02:38.704264  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.722898  5312 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:38.717387  5397 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:38.724819  5397 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:38.718360  5248 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:38.732674  5248 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.733182  5248 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:38.735095  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.727703  5397 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:38.740728  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:38.676733  5288 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:38.618434  5196 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:38.753650  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.677196  5328 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.800887  5328 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:38.803535  5328 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:38.808287  5399 log.cc:927] Time spent T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:02:38.677925  5291 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.785257  5196 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:38.797623  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 97581.7us
W20260709 13:02:38.822220  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:38.825186  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 459655us
I20260709 13:02:38.826205  2329 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:38.826455  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:38.829241  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.831151  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:38.832944  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.845685  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.700740  5311 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.113s
W20260709 13:02:38.852295  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.856916  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:38.859769  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.851837  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:38.871729  1533 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:02:38.872749  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 46647.9us
W20260709 13:02:38.874374  5377 log.cc:927] Time spent T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:02:38.875097  5352 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.878396  5352 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:38.878798  5352 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.887111  1685 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:38.900882  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:38.901697  1614 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
I20260709 13:02:38.853991  5261 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:38.903424  5261 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:38.903860  5261 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:38.907341  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50553us
I20260709 13:02:38.911796  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.871155  5300 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.915942  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.919209  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:38.873345  5350 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:38.890214  5389 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:38.890853  5328 raft_consensus.cc:2804] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:02:38.833993  5248 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.844367  5397 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:02:38.843845  5157 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:02:38.872526  5391 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:38.933393  1505 leader_election.cc:400] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:38.953933  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:38.936906  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51161.8us
W20260709 13:02:38.930757  1580 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.596s (SENT) [suppressed 39 similar messages]
W20260709 13:02:38.957607  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.921088  5388 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:38.907987  5312 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:02:38.915231  4859 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:02:38.961741  1654 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:38.921948  5393 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:38.924743  5350 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.928220  5389 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:38.935947  5359 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:38.974366  5350 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:38.953150  5328 raft_consensus.cc:697] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:38.994692  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:39.005553  5411 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:39.006165  5411 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:39.006584  5411 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:39.007799  5328 consensus_queue.cc:237] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:38.988185  5247 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:38.983999  5389 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:39.028589  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:38.987092  5305 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:02:39.065402  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 134688us
W20260709 13:02:39.067407  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 113590us
I20260709 13:02:39.018182  5251 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:39.068202  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:39.070053  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:39.121863  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 144362us
I20260709 13:02:38.993291  5359 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:39.062271  5247 raft_consensus.cc:697] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:39.070464  5251 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.162834  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:39.164176  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:39.169310  5420 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:39.169508  5396 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:39.169996  5420 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:39.170334  5402 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:02:39.170521  5420 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.170945  5396 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:39.171523  5396 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:39.172408  5405 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:02:39.173877  5403 log.cc:927] Time spent T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 13:02:39.169332  5407 log.cc:927] Time spent T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 13:02:39.071585  5291 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:39.158296  5401 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
W20260709 13:02:39.178016  5400 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:02:39.222970  5251 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:39.227059  5381 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:02:39.262519  5291 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:39.259724  5248 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:39.303498  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 138556us
I20260709 13:02:39.282980  5419 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:39.354059  5305 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:39.355239  5305 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:39.354936  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:39.355664  5305 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:39.356662  5305 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.298503  5415 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.305032  5391 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.370951  1610 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:39.291766  5325 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:39.306476  5230 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:39.388293  1609 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:02:39.370157  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.369428  5297 consensus_meta.cc:287] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.000s
I20260709 13:02:39.371214  5305 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:39.324386  5291 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.289767  5396 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:39.424634  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:39.452566  1580 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.117s (SENT)
I20260709 13:02:39.513782  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:39.380364  5436 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.521337  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:39.539413  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.539535  1613 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:39.540179  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.542465  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:39.391666  5255 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:39.559473  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.412102  5393 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:39.408847  5322 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:39.599406  1538 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:39.521900  5089 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.589253  2370 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:39.630523  5261 consensus_meta.cc:287] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.003s
I20260709 13:02:39.636454  5251 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:39.597342  1613 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:39.647408  5388 consensus_meta.cc:287] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
I20260709 13:02:39.649217  5291 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.657234  5359 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:39.745062  5359 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:39.745635  5359 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.746152  5431 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.746975  5431 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:39.664479  5423 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:02:39.391157  5247 consensus_queue.cc:237] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.749818  5431 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.750572  5251 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:39.677101  5300 consensus_meta.cc:287] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.000s
I20260709 13:02:39.751518  5300 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:39.551816  5436 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.397270  5325 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.747828  5359 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.752787  5359 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:39.753616  5325 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.753906  5436 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.398985  5230 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.756352  5230 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:39.686138  5133 consensus_meta.cc:287] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.063s	user 0.005s	sys 0.008s
I20260709 13:02:39.564145  5391 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.758215  5391 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.759763  5388 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:39.760757  5391 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.375774  5415 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:39.761377  5387 consensus_meta.cc:287] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.121s	user 0.012s	sys 0.000s
I20260709 13:02:39.762063  5387 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.763209  5415 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.600438  5255 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.753314  5359 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:39.769251  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 470833us
I20260709 13:02:39.590994  5430 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.773836  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:39.776081  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:39.765878  5155 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:39.738065  5322 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.741894  5089 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.765581  5261 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:39.800782  5410 log.cc:927] Time spent T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.660s	user 0.004s	sys 0.009s
I20260709 13:02:39.801657  5255 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:39.791951  5350 consensus_meta.cc:287] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.796s	user 0.012s	sys 0.000s
I20260709 13:02:39.773706  5430 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.812132  5387 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.814857  5350 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.550307  1428 maintenance_manager.cc:419] P bd598697ff644162909af62351a1ef0b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033385
W20260709 13:02:39.934755  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:39.935771  1534 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:02:39.937503  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.002s	sys 0.002s
I20260709 13:02:39.938298  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 615) took 1199 ms. Trace:
I20260709 13:02:39.733901  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:39.984838  1533 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:02:39.948328  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 328738us
I20260709 13:02:39.986526  1538 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:39.984925  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:39.993557  1615 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:39.997413  5352 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 1.118s	user 0.015s	sys 0.000s
I20260709 13:02:39.997639  5355 raft_consensus.cc:3055] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:02:40.004000  5413 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.768s	user 0.011s	sys 0.011s
W20260709 13:02:40.006335  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.007860  5412 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.778s	user 0.017s	sys 0.018s
I20260709 13:02:40.011338  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2128) took 1408 ms. Trace:
I20260709 13:02:40.011893  1611 rpcz_store.cc:276] 0709 13:02:38.602879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.603062 (+   183us) service_pool.cc:224] Handling call
0709 13:02:38.622777 (+ 19715us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.665421 (+ 42644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:38.665451 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.766402 (+100951us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b2c0000e5c8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:02:38.828139 (+ 61737us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.995574 (+167435us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:38.995742 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.998771 (+  3029us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.006491 (+1007720us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:40.010742 (+  4251us) raft_consensus.cc:1685] finished
0709 13:02:40.010771 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.011054 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42246,"raft.queue_time_us":42897,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":22963,"spinlock_wait_cycles":34804992,"thread_start_us":87649,"threads_started":1,"wal-append.queue_time_us":190247}
I20260709 13:02:40.014043  5322 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.016770  5445 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:40.018250  5445 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:39.859695  5404 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.854s	user 0.003s	sys 0.014s
W20260709 13:02:40.021741  1580 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.246s (SENT)
W20260709 13:02:39.885835  5420 consensus_meta.cc:287] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.715s	user 0.014s	sys 0.000s
I20260709 13:02:39.879175  5430 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:39.864975  5433 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:02:40.023239  5420 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:39.973470  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.026185  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 614) took 1328 ms. Trace:
I20260709 13:02:40.017082  4859 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:39.869114  5411 consensus_meta.cc:287] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.862s	user 0.005s	sys 0.008s
I20260709 13:02:40.037856  5411 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:39.885296  5419 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.000s
I20260709 13:02:40.039816  5419 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:40.040899  1540 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:02:40.041334  1540 pending_rounds.cc:85] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 5
I20260709 13:02:40.041611  1540 pending_rounds.cc:107] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:02:40.041963  1540 raft_consensus.cc:2889] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:40.042665  5359 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:40.026419  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2101) took 1138 ms. Trace:
I20260709 13:02:40.041939  5445 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:39.985070  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.002s	sys 0.002s
I20260709 13:02:40.029644  4859 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:40.046003  4859 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:39.981832  1535 rpcz_store.cc:276] 0709 13:02:38.738602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.738786 (+   184us) service_pool.cc:224] Handling call
0709 13:02:38.770590 (+ 31804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.771053 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:02:38.888577 (+117524us) log.cc:844] Serialized 14 byte log entry
0709 13:02:39.295504 (+406927us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.296096 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:02:39.296269 (+   173us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:02:39.296665 (+   396us) log.cc:844] Serialized 14 byte log entry
0709 13:02:39.297004 (+   339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.297075 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.799901 (+502826us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:39.937500 (+137599us) raft_consensus.cc:1685] finished
0709 13:02:39.937572 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:39.938002 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101156,"prepare.queue_time_us":154914,"prepare.run_cpu_time_us":131,"prepare.run_wall_time_us":3465,"raft.queue_time_us":374594,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":14274,"spinlock_wait_cycles":10600704,"thread_start_us":467901,"threads_started":3,"wal-append.queue_time_us":149605}
I20260709 13:02:39.940949  1539 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:40.043422  1685 rpcz_store.cc:276] 0709 13:02:38.888602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.888798 (+   196us) service_pool.cc:224] Handling call
0709 13:02:38.889191 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:39.248641 (+359450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:39.248691 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:39.249347 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:02:39.553422 (+304075us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:39.553468 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:39.553549 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:40.025887 (+472338us) raft_consensus.cc:1685] finished
0709 13:02:40.025930 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.026218 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28648,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":7308,"thread_start_us":631731,"threads_started":2,"wal-append.queue_time_us":522261}
I20260709 13:02:40.057046  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.058751  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.059630  1615 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 14.
I20260709 13:02:40.026757  1532 rpcz_store.cc:276] 0709 13:02:38.697912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.698066 (+   154us) service_pool.cc:224] Handling call
0709 13:02:38.698369 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:38.698595 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:38.698618 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:38.699088 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:02:38.829142 (+130054us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:38.829189 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:38.829262 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:39.808894 (+979632us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:40.025501 (+216607us) raft_consensus.cc:1685] finished
0709 13:02:40.025553 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:40.025983 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59675008,"thread_start_us":129723,"threads_started":1,"wal-append.queue_time_us":220093}
I20260709 13:02:40.059756  5419 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.998451  5352 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.060837  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.066395  1537 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:40.067215  5411 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.067734  5350 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:39.998505  5355 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:40.047942  4859 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:40.090340  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44401.8us
I20260709 13:02:40.093364  1538 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:40.094426  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.102332  1541 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:40.108296  5419 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.114400  1532 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:40.111542  5419 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:40.130230  5305 consensus_meta.cc:287] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.009s
I20260709 13:02:40.138361  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2156) took 1554 ms. Trace:
I20260709 13:02:40.138578  5196 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.138887  1537 rpcz_store.cc:276] 0709 13:02:38.584286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.584681 (+   395us) service_pool.cc:224] Handling call
0709 13:02:40.138151 (+1553470us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400067054. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:40.138288 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3049195904}
I20260709 13:02:40.139282  5196 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.140748  5355 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.142967  5355 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:40.144194  5430 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:40.145031  5430 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.146631  5196 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:40.148231  1682 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:40.152083  1614 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:02:40.154989  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.158812  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:40.143611  5352 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:40.147758  5430 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.179559  5322 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.180826  5322 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.184602  5311 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:40.185601  5311 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 14 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:40.189570  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.192214  5305 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:40.192250  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:40.192502  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.192967  5305 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.171768  1685 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:40.201591  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.213704  5420 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.200968  5305 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:40.218330  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.218833  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.219022  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.187503  5311 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.222414  1690 raft_consensus.cc:2410] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:40.222820  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:40.205456  5421 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:02:40.235008  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:40.235951  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:40.236629  2367 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:40.237874  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:40.241711  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.221098  5305 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.246569  5305 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:40.248909  1505 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.009s	sys 0.020s
I20260709 13:02:40.254979  5436 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:40.259404  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.258090  1653 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:40.271792  1505 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.203s	user 0.010s	sys 0.021s
I20260709 13:02:40.238649  5322 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.263676  5436 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.304576  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:40.306790  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:40.307545  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.311400  5426 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:40.316874  5426 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.317459  5426 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.282167  4859 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:02:40.324476  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:40.325826  5436 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:40.327549  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 99358us
I20260709 13:02:40.328652  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:40.323822  2370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53388 (request call id 494) took 1630 ms (client timeout 2028 ms). Trace:
W20260709 13:02:40.330773  2370 rpcz_store.cc:269] 0709 13:02:38.693295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:38.693415 (+   120us) service_pool.cc:224] Handling call
0709 13:02:40.323374 (+1629959us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54006d0bd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:40.323593 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659521280}
I20260709 13:02:40.331489  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:40.331908  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.335637  1653 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:40.336872  5389 consensus_meta.cc:287] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.246s	user 0.013s	sys 0.012s
I20260709 13:02:40.337952  5389 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.339982  5155 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:40.340494  5155 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:40.340610  5389 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.340929  5155 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:40.341979  5409 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:40.343050  5355 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.343779  5355 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.346797  5355 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:40.347887  5196 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.342751  5409 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:40.348750  5196 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.349378  5409 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.350301  5422 consensus_queue.cc:1059] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:40.351109  5196 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:40.351591  5422 raft_consensus.cc:3055] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:40.352346  5380 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:40.352730  5445 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:40.347709  4859 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:40.354221  4859 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:40.354727  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 1.28662e+06us
I20260709 13:02:40.352994  5380 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.358125  5380 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:40.342193  5261 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:40.360443  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.361292  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.355755  5089 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.363387  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:40.364459  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:40.364918  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.365862  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.365962  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.363343  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:40.364485  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:40.369011  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 55040us
I20260709 13:02:40.372262  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:40.384305  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:40.384694  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:40.392014  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.359529  5422 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:40.393828  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:40.386484  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:40.396651  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.413201  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:40.421234  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:40.412631  5261 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:40.434675  4859 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:40.440701  5355 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:40.455958  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:40.448135  5255 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:40.448702  5230 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.433035  5089 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:40.466172  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:40.474510  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 65184.1us
I20260709 13:02:40.449506  5322 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:40.472787  5230 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.486227  1533 raft_consensus.cc:1275] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:02:40.486713  1533 pending_rounds.cc:85] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 5
I20260709 13:02:40.486974  1533 pending_rounds.cc:107] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:02:40.487195  1533 raft_consensus.cc:2889] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:02:40.492988  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 137049us
W20260709 13:02:40.499017  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 69977us
I20260709 13:02:40.499912  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:40.506166  5389 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.511842  5409 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:40.515040  5389 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.492967  5230 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.509788  5305 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:40.468303  5422 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.550859  5322 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.596606  2362 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 14 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:40.601188  1684 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:40.574174  4859 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 13:02:40.606259  5455 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.204s	user 0.004s	sys 0.000s
W20260709 13:02:40.609620  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.599453  5297 consensus_queue.cc:1048] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:02:40.613579  5389 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.616524  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:40.611490  5322 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.616559  5380 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.618160  5380 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.620810  5380 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:40.625108  5380 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.625865  5380 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.628965  5380 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:40.629546  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:40.630373  5426 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.637446  5261 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:40.619586  5155 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.644412  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:40.645061  2370 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:40.642834  5426 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:40.665419  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 84417.4us
I20260709 13:02:40.667130  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:40.668401  5426 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:40.668718  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:40.669341  5426 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:40.670852  2370 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:40.671447  5409 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:40.672425  1653 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:40.673421  5409 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:40.673460  5155 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.674217  5409 raft_consensus.cc:697] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:40.675410  5409 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.683086  5380 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:02:40.684134  5380 consensus_queue.cc:1243] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer 9d926c10b90f452ba52d80dab6a50351 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:40.684751  4859 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:40.685312  4859 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:40.686224  5426 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.686551  4859 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:40.687851  5380 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.694747  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:40.695009  5380 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.697757  5380 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:40.697940  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.698719  5322 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.699712  4859 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:40.699414  5322 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.704588  5322 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:40.709935  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:40.721688  1685 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:40.722932  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:40.723999  5155 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:40.722909  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 54432.7us
I20260709 13:02:40.725284  5155 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:40.761471  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.860608  5322 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:40.861757  5322 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:40.879287  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.898581  5439 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:40.899650  5439 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:40.903028  5230 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:40.903863  5230 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:41.083168  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.170903  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 173845us
W20260709 13:02:41.120126  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.081547  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:40.908001  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:40.906394  5439 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:41.263954  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:41.265725  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.217741  5322 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:41.279225  5467 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:02:41.174202  5155 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:41.270005  2362 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:41.283480  5409 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:41.284252  5230 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:41.286824  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:41.292290  4859 consensus_meta.cc:287] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.001s
I20260709 13:02:41.297528  1687 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:02:41.298029  1687 pending_rounds.cc:85] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 11
I20260709 13:02:41.299666  1687 pending_rounds.cc:107] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:02:41.299922  1687 raft_consensus.cc:2889] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:41.296679  4859 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 13:02:41.308907  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.326045  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 818398us
W20260709 13:02:41.329783  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.006s	sys 0.009s
W20260709 13:02:41.340677  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.007s	sys 0.010s
I20260709 13:02:41.346750  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:41.347631  5422 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:41.354370  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:41.356638  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.359965  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:41.368345  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 89018.2us
W20260709 13:02:41.371814  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.372584  4859 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:41.373075  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:41.374317  5468 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:41.374897  5468 raft_consensus.cc:697] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:41.377406  5468 consensus_queue.cc:237] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:41.385399  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.432263  5475 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.433177  5475 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:41.436728  5475 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:41.479606  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:41.493230  1439 catalog_manager.cc:5697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 8 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.495723  1439 catalog_manager.cc:5697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 4 to 5, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:41.744819  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.836148  5475 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:41.837055  5475 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:41.872525  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:41.839809  5475 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:42.263199  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.317516  5475 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.318521  5475 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.344812  5475 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:42.348532  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.357890  5481 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:42.358702  5481 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:42.361294  5481 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:42.363437  5475 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:42.364149  5475 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.366613  5475 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:42.366808  1686 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:42.367390  5482 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.370945  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:42.370966  5484 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:42.372211  5475 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:42.368167  5482 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.375612  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:42.375979  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.384353  5483 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:42.380465  5469 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:42.384908  5481 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:42.385277  5469 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.385180  5483 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.385661  5481 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:42.388058  5483 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:42.388190  5469 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:42.384419  5484 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:42.388794  1610 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:42.388984  5484 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.391304  5484 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:42.398769  1616 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:42.399375  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:42.400911  1609 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:42.402540  1610 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:42.405124  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:42.414355  5481 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:42.374396  5475 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.379724  5482 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:42.435984  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.600338  5262 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.608538  5475 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:42.608656  5262 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:42.611752  5262 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:42.614310  5262 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:42.615824  5262 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:42.620371  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 645) took 1904 ms. Trace:
I20260709 13:02:42.620769  1687 rpcz_store.cc:276] 0709 13:02:40.715952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.716166 (+   214us) service_pool.cc:224] Handling call
0709 13:02:40.716532 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:41.300930 (+584398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:42.620121 (+1319191us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54002d6c54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:42.620312 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334432512}
I20260709 13:02:42.622344  5262 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:42.665251  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 2.13709e+06us
W20260709 13:02:42.670799  1580 connection.cc:256] RPC call timeout handler was delayed by -2.3229234869999686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3345s for a response
W20260709 13:02:42.698917  1580 connection.cc:256] RPC call timeout handler was delayed by -2.305823486999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33640000000000003s for a response
W20260709 13:02:42.700206  1580 connection.cc:256] RPC call timeout handler was delayed by -2.3022234869999352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3368s for a response
I20260709 13:02:42.677412  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.703843  1607 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:42.705487  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.678671  1612 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:42.715221  1580 leader_election.cc:336] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 3.061s (SENT)
I20260709 13:02:42.718262  5255 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.719266  5255 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.722513  5255 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:42.682029  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.685186  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.723984  1615 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:42.685874  5426 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:42.726285  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:42.686772  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.728173  1610 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:42.687745  5041 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:42.732414  5041 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:42.736409  5041 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:42.737521  1616 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
W20260709 13:02:42.689560  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 315667us
I20260709 13:02:42.690187  1613 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:42.675379  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.740471  1614 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:42.741531  5355 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:42.742841  5355 consensus_queue.cc:1059] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:42.744220  5469 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:42.744295  5475 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:42.744699  5469 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:42.744865  5475 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:42.717209  1580 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:42.745854  5475 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.747562  5475 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:42.745832  5469 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.750697  5469 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:42.752684  5230 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:42.753665  5230 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:42.754151  5230 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:42.756268  5230 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:42.757335  5355 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.758033  5355 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:42.763486  1580 connection.cc:256] RPC call timeout handler was delayed by -1.8864723099999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 13:02:42.763973  1580 connection.cc:256] RPC call timeout handler was delayed by -1.8759215989999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:02:42.764351  1580 connection.cc:256] RPC call timeout handler was delayed by -1.8496150479999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.309s for a response
W20260709 13:02:42.764693  1580 connection.cc:256] RPC call timeout handler was delayed by -1.8417215989999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1645s for a response
I20260709 13:02:42.773299  1609 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:02:42.772260  5426 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 13:02:42.786815  1580 connection.cc:256] RPC call timeout handler was delayed by -1.6960536329999627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 13:02:42.787953  5312 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.788439  5312 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.790551  5312 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:42.791121  1580 connection.cc:256] RPC call timeout handler was delayed by -1.6696150479999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.329s for a response
W20260709 13:02:42.791558  1580 connection.cc:256] RPC call timeout handler was delayed by -1.5141290290000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2879s for a response
I20260709 13:02:42.796247  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:42.798298  5230 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:42.799090  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.800005  1611 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:42.798915  5230 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:42.807381  5230 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:42.820634  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9ae0 after lost signal to thread 434
W20260709 13:02:42.822160  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080025a120 after lost signal to thread 1473
W20260709 13:02:42.823294  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002b9dc0 after lost signal to thread 1540
W20260709 13:02:42.827533  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 178) took 25700 ms (client timeout 15000 ms). Trace:
I20260709 13:02:42.827349  5041 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:02:42.830215  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba040 after lost signal to thread 1565
W20260709 13:02:42.831842  1637 debug-util.cc:398] Leaking SignalData structure 0x7b0800293220 after lost signal to thread 1640
W20260709 13:02:42.832257  1637 debug-util.cc:398] Leaking SignalData structure 0x7b0800293320 after lost signal to thread 1641
I20260709 13:02:42.835938  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:42.836453  1439 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 4 to 5, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:42.845377  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.846977  1580 leader_election.cc:336] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.508s (SENT)
W20260709 13:02:42.849182  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.854375  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.857074  1612 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:42.860143  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:42.864938  1580 leader_election.cc:336] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.558s (SENT)
I20260709 13:02:42.865449  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:42.869784  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:42.871214  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:42.872381  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:42.875150  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:42.871426  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:42.845045  5355 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:42.886206  4859 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:02:42.872298  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:42.880368  2362 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
W20260709 13:02:42.883739  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 2.2544e+06us
I20260709 13:02:42.878810  1439 catalog_manager.cc:5697] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.903976  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:42.922577  5500 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:42.923187  5500 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:42.925158  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:42.929193  5501 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:42.929747  5501 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.930107  5501 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:42.944942  5500 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:42.946357  5500 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:42.886879  5475 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:02:42.901477  5255 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.895743  5311 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:42.888302  5409 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:02:42.964109  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 102202us
I20260709 13:02:42.954595  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:42.960968  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3a40 after lost signal to thread 1714
W20260709 13:02:42.964910  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9e60 after lost signal to thread 1715
W20260709 13:02:42.966122  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 104903us
I20260709 13:02:42.966470  1611 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:42.952442  5439 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:42.905421  5355 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:02:42.963547  1439 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 4 to 5, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:42.973671  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5020 after lost signal to thread 2395
W20260709 13:02:42.974032  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4740 after lost signal to thread 2396
W20260709 13:02:42.974403  1637 debug-util.cc:398] Leaking SignalData structure 0x7b0800366c00 after lost signal to thread 5261
W20260709 13:02:42.974804  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080033c080 after lost signal to thread 5389
W20260709 13:02:42.969729  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:42.976943  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:42.980607  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.972363  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.986434  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.987689  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:42.988233  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:42.988832  5494 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:02:43.011304  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:42.969419  5311 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:42.847576  1436 rpcz_store.cc:269] 0709 13:02:17.127001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:17.138904 (+ 11903us) service_pool.cc:224] Handling call
0709 13:02:42.827283 (+25688379us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:34.871223 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:34.990378 (+119155us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:34.990415 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:02:34.990434 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:34.991503 (+  1069us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:34.991588 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:34.991615 (+    27us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:02:34.992618 (+  1003us) tablet.cc:701] Row locks acquired
0709 13:02:34.992644 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:02:34.992862 (+   218us) write_op.cc:270] Start()
0709 13:02:34.992985 (+   123us) write_op.cc:276] Timestamp: P: 1783602154992775 usec, L: 0
0709 13:02:34.993011 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:02:34.993663 (+   652us) log.cc:844] Serialized 4091 byte log entry
0709 13:02:35.559781 (+566118us) op_driver.cc:464] REPLICATION: finished
0709 13:02:35.800330 (+240549us) write_op.cc:301] APPLY: starting
0709 13:02:35.800424 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:35.800700 (+   276us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:35.800846 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:35.802339 (+  1493us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:35.802682 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:02:35.802756 (+    74us) write_op.cc:312] APPLY: finished
0709 13:02:35.803204 (+   448us) log.cc:844] Serialized 76 byte log entry
0709 13:02:35.803478 (+   274us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.803653 (+   175us) write_op.cc:454] Released schema lock
0709 13:02:35.803733 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:35.813735 (+ 10002us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:35.813764 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":303896,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":235162,"apply.run_cpu_time_us":3936,"apply.run_wall_time_us":13362,"num_ops":10,"prepare.queue_time_us":710252,"prepare.run_cpu_time_us":72328,"prepare.run_wall_time_us":281620,"raft.queue_time_us":161692,"raft.run_cpu_time_us":76567,"raft.run_wall_time_us":280087,"replication_time_us":527137,"thread_start_us":653946,"threads_started":4,"wal-append.queue_time_us":321421,"wal-append.run_cpu_time_us":47193,"wal-append.run_wall_time_us":1481995}]]}
I20260709 13:02:43.001698   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:42.984637  1439 catalog_manager.cc:5697] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 5 to 6, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:43.006812  1580 leader_election.cc:336] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.596s (SENT)
I20260709 13:02:43.009372  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:43.024432  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.036353  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 1.67651e+06us
I20260709 13:02:43.038543  1580 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:43.037770  5439 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:43.032941  5469 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:43.046597  5475 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:43.059815  5475 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.061978  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:43.062667  1684 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:43.064216  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:43.064117  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:43.055269  5409 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:43.077032  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:43.058766  5230 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:43.069818  5475 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:43.088424  1439 catalog_manager.cc:5697] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.083200  5409 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.096612  5261 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:43.096801  5409 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:43.097507  5261 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.098067  5261 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.070814  5297 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 13:02:43.100152  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 93419.7us
I20260709 13:02:43.069571  5469 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.100224  5420 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:43.107023  1580 leader_election.cc:336] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.607s (SENT)
I20260709 13:02:43.107635  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:43.108961  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 164431us
I20260709 13:02:43.110172  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 634) took 2628 ms. Trace:
I20260709 13:02:43.107313  5420 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.110610  1535 rpcz_store.cc:276] 0709 13:02:40.477442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.477567 (+   125us) service_pool.cc:224] Handling call
0709 13:02:40.481088 (+  3521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.485101 (+  4013us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:40.485525 (+   424us) log.cc:844] Serialized 14 byte log entry
0709 13:02:42.802911 (+2317386us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b180020e000. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287 00007fd02eb23208
0709 13:02:42.811113 (+  8202us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.105026 (+293913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.105078 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:43.105125 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.105196 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.105310 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":306064,"prepare.queue_time_us":17520,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":81,"raft.queue_time_us":2610523,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":92,"spinlock_wait_cycles":9090304,"thread_start_us":11828,"threads_started":2,"wal-append.queue_time_us":87312}
I20260709 13:02:43.109406  5311 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:43.103420  5350 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.103521  5411 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.112092  5255 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:43.104290  5501 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.119129  5389 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:43.118109  5261 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:43.129976  2362 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:43.130244  5469 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:43.131925  5389 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:43.124948  5350 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:43.117949  5436 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:43.135016  5504 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:43.146829  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:43.167703  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:43.167681  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:43.180888  1612 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:43.170238  5420 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:43.171814  5501 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:43.123597  5411 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.196432  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:02:43.170274  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 56070.3us
I20260709 13:02:43.173898  1683 raft_consensus.cc:2368] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10.
I20260709 13:02:43.175820  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:43.176800  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:43.178589  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 71674.3us
I20260709 13:02:43.167599  5389 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.181454  5436 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.183710  5515 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.183672  5420 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.184803  5512 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:43.207617  5512 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.179497  5409 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:02:43.208148  5475 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:43.208259  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:43.208803  5475 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.178380  5514 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.209267  5475 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:43.179615  5469 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:02:43.181450  5355 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:02:43.181598  5426 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:02:43.181648  5504 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:43.172629  2328 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:43.225353  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 87967.5us
I20260709 13:02:43.197551  2368 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.200779  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 631) took 2756 ms. Trace:
I20260709 13:02:43.205706  5515 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.206700  5420 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.192119  5261 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:43.226069  2328 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:43.228008  1580 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.645s (SENT)
I20260709 13:02:43.234386  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:43.237392  1535 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:43.182363  5350 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.247584  1539 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:43.245999  5297 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:43.251037  1535 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:43.252301  5513 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:43.226553  1540 rpcz_store.cc:276] 0709 13:02:40.444501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:40.457137 (+ 12636us) service_pool.cc:224] Handling call
0709 13:02:40.475987 (+ 18850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:40.481111 (+  5124us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:02:40.485164 (+  4053us) log.cc:844] Serialized 14 byte log entry
0709 13:02:40.502297 (+ 17133us) log.cc:844] Serialized 14 byte log entry
0709 13:02:43.199680 (+2697383us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:43.199731 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:43.199781 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:43.199846 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:43.200631 (+   785us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2601669,"prepare.queue_time_us":14017,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":91,"raft.queue_time_us":5186706,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":8425,"thread_start_us":121846,"threads_started":1}
I20260709 13:02:43.234505  5499 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:43.239604  5230 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:43.209604  5514 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:43.269802  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.275051  2368 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:43.236662  5261 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:43.278262  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 56513.3us
W20260709 13:02:43.272580  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 95864.8us
I20260709 13:02:43.269972  5499 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.284260  5499 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.289427  5420 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:43.291357  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.292291  1539 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:43.296967  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:43.297662  5411 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:43.297812  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.298563  1535 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:43.299664  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.300787  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:43.301249  5350 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:43.301313  5514 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:43.297678  1541 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:43.304399  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.304905  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.263671  5513 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:43.305456  1540 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:43.307675  2328 leader_election.cc:400] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10.
I20260709 13:02:43.308094  2328 leader_election.cc:403] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:43.311488  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:43.312546  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:43.317337  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:43.329838  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.331734  1533 raft_consensus.cc:2393] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:43.332584  1580 leader_election.cc:336] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.806s (SENT)
I20260709 13:02:43.326200  4859 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:43.333758  4859 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.334460  4859 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.329859  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:43.342648  1540 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:43.324563  5041 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:43.309748  5513 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.325093  5409 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.335436  5422 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10.
I20260709 13:02:43.302125  5504 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.351485  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.351468  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:43.354010  5509 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.355304  5261 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:43.357256  1540 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:43.346894  5519 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:43.345681  5041 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:43.393054  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.393972  1540 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:43.348204  5409 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.341344  5426 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:02:43.390591  5328 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.398175  5328 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.400553  5328 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:43.422226  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2500 after lost signal to thread 434
W20260709 13:02:43.392993  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 89809.7us
W20260709 13:02:43.433705  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08001e22a0 after lost signal to thread 1473
W20260709 13:02:43.436407  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:43.435269  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7720 after lost signal to thread 1540
W20260709 13:02:43.438304  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7ba0 after lost signal to thread 1565
I20260709 13:02:43.440600  1541 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:43.361150  5509 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.431917  5409 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.444983  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.391616  5519 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:43.456278  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 248236us
W20260709 13:02:43.446480  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7b80 after lost signal to thread 1566
I20260709 13:02:43.447005  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:43.458483  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080036bae0 after lost signal to thread 1640
W20260709 13:02:43.448678  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 83204.8us
I20260709 13:02:43.404291  5041 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.371236  5522 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:43.454486  1540 raft_consensus.cc:2410] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:02:43.384344  5469 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:02:43.462306  1580 leader_election.cc:336] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.251s (SENT)
W20260709 13:02:43.468220  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.473803  5426 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:43.462246  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080036b780 after lost signal to thread 1641
W20260709 13:02:43.363830  5355 consensus_queue.cc:1175] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e8eefefed88a4903b423e9f487c4805a" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 7 index: 5 } }
I20260709 13:02:43.404505  5515 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:43.484619  1562 debug-util.cc:398] Leaking SignalData structure 0x7b0800323d00 after lost signal to thread 1714
I20260709 13:02:43.449316  5509 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.494069  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:43.496735  1580 leader_election.cc:336] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.314s (SENT)
I20260709 13:02:43.497437  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:43.498468  5482 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.480876  1541 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:43.500254  5515 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:43.500710  5515 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:43.501068  5515 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.504153  5501 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:43.504609  5501 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:43.505551  5501 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.506891  5501 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:43.508832  5512 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:43.489596  1562 debug-util.cc:398] Leaking SignalData structure 0x7b080037ef20 after lost signal to thread 1715
W20260709 13:02:43.513978  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9300 after lost signal to thread 2395
W20260709 13:02:43.514283  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3300 after lost signal to thread 2396
W20260709 13:02:43.514601  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8d00 after lost signal to thread 5261
W20260709 13:02:43.514963  1562 debug-util.cc:398] Leaking SignalData structure 0x7b08002bfbc0 after lost signal to thread 5389
W20260709 13:02:43.517520  5521 log.cc:927] Time spent T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:02:43.520612  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.521068  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:43.521379  1533 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:43.521595  1537 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.522279  5509 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.524493  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.525084  5389 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.525688  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.524600  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.526527  1535 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 5.
I20260709 13:02:43.526859  1539 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:43.527508  5389 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:43.527604  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.530555  1535 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:43.525511  1534 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:43.528254  1532 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:43.522277  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.532053  1533 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:43.527897  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.532958  4859 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.534777  1537 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:43.461988  5519 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.561159  1539 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:43.562229  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.562862  1537 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:43.478672  5522 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.562143  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.597885  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:43.599633  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45812.6us
I20260709 13:02:43.603542  4859 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:43.608212  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.608799  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.519704  5515 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:43.655491  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.695238  1536 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:43.697001  5504 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:43.601500  5522 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:43.802827  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 321219us
I20260709 13:02:43.811043  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:43.811815  5515 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:43.606416  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:43.806054  1533 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:43.811939  5426 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:43.805655  1534 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:02:43.805341  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 196756us
I20260709 13:02:43.819237  1532 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:02:43.839687  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 233403us
W20260709 13:02:43.827782  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.845381  5522 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.848652  5530 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:43.849525  5509 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:43.868211  5041 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.871024  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:43.872712  2367 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:43.851408  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 250360us
I20260709 13:02:43.878611  5041 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:43.860716  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.879240  5530 raft_consensus.cc:697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:43.862898  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:43.887917  1687 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:43.825449  5499 consensus_meta.cc:287] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.006s
I20260709 13:02:43.865034  5522 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:43.859308  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 249732us
I20260709 13:02:43.884434  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:43.885716  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.883114  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:43.851495  5475 consensus_meta.cc:287] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.003s
I20260709 13:02:43.897260  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:43.897271  5530 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:43.898025  5475 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:43.899076  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:43.900084  5524 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:43.900395  5475 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:43.900954  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:43.901814  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:43.903302  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63540.6us
I20260709 13:02:43.904326  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:43.911813  1689 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:43.916126  1610 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:43.924319  1540 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:43.926640  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:43.928412  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:43.929627  1533 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:43.928764  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:43.930166  1540 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:43.932565  1614 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:02:43.934238  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:43.934871  1532 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:43.935567  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:43.936709  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:43.938586  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:43.939332  1684 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:43.939878  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:43.940601  1538 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:43.947017  1534 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:43.944706  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:43.948673  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:43.952628  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:43.953661  2370 raft_consensus.cc:2393] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:43.933211  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:43.963573  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:43.901612  5499 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:43.976512  1580 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 3.364s (SENT) [suppressed 27 similar messages]
W20260709 13:02:43.987371  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 88435.9us
I20260709 13:02:43.993289  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:43.994143  1607 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:44.001760  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.005686  1539 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:02:44.006609  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:44.007474  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:43.950520  5475 consensus_queue.cc:1059] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:02:44.015884  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:44.025033  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:44.070727  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51398.6us
W20260709 13:02:44.071425  5513 consensus_meta.cc:287] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.715s	user 0.004s	sys 0.008s
W20260709 13:02:44.081990  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 112105us
I20260709 13:02:44.078526  5261 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:44.091558  5499 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:44.097416  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:44.080708  5501 consensus_meta.cc:287] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.573s	user 0.015s	sys 0.000s
I20260709 13:02:44.105233  1532 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:44.107264  1538 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:44.107990  1504 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:44.096299  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.112630  1539 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:44.114153  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 109864us
I20260709 13:02:44.138206  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.084616  5513 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.114344  5512 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:44.140417  5409 consensus_meta.cc:287] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.005s
I20260709 13:02:44.108163  5519 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:44.181339  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.146225  5524 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.162009  5297 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:44.185469  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 283202us
W20260709 13:02:44.188403  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.204006  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.175495  5255 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:44.218816  1607 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:44.223372  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.224097  1538 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.228367  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.229236  1607 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.177266  5409 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:44.253255  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.260057  5522 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:44.260735  5522 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:44.262668  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.263338  1613 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.244407  5501 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.273063  4859 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:44.276908  5469 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:02:44.278425  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.279074  5439 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:44.279634  5439 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:44.222713  5255 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:44.284564  5548 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:02:44.275205  1654 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.312392  5513 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:44.323035  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.326067  4859 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:44.326145  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51026us
W20260709 13:02:44.326716  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 180637us
I20260709 13:02:44.314961  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:44.327322  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.328450  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.331470  1607 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:44.305775  5501 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.339355  5261 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:44.340134  1534 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:44.340261  5501 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:44.342618  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.344614  1613 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:44.346539  5409 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:44.350733  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.351447  1611 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:44.350801  1534 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:44.357857  1538 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:02:44.354055  5545 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:02:44.359172  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:44.360589  5509 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.361707  5509 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.363353  5522 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:44.364926  5255 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:44.366106  5519 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:44.358794  5541 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:02:44.366938  1539 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:44.333027  5469 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.333200  5537 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:44.369834  5436 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:44.376484  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:44.377684  1684 raft_consensus.cc:1813] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Handling vote request from an unknown peer e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.378384  1684 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:44.383977  2368 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:44.385625  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:44.386323  2370 raft_consensus.cc:1813] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Handling vote request from an unknown peer e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.386754  2370 raft_consensus.cc:2368] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:44.392620  1540 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:44.394356  1579 leader_election.cc:400] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:44.394932  1611 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:44.396190  1580 leader_election.cc:336] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.719s (SENT)
I20260709 13:02:44.397183  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:44.397569  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:44.394953  1579 leader_election.cc:403] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:44.395788  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:44.399360  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47027.5us
I20260709 13:02:44.359670  5439 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:44.404500  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.402123  5255 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.402336  5533 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:44.400816  5500 consensus_queue.cc:1059] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:02:44.404021  5564 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:44.425148  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:44.428995  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:44.431049  5500 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:44.432631  5519 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:44.433199  5519 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:44.434379  5519 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.435503  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:44.435685  5519 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.436219  1683 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.445374  2362 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:02:44.440907  5469 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:44.449652  5469 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:44.450150  5469 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:44.451184  5469 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.455056  5500 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:02:44.441651  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.468478  5512 raft_consensus.cc:2764] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:02:44.442560  5475 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:44.469014  5469 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:44.468657  5500 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:44.476333  5500 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:44.476887  5500 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.477667  5506 raft_consensus.cc:3055] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:44.478330  5506 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:44.441876  5409 consensus_queue.cc:1059] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:44.486286  5527 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:44.487222  5409 raft_consensus.cc:3055] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:44.487727  5409 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:44.486167  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57272.9us
W20260709 13:02:44.491093  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49572.6us
I20260709 13:02:44.492420  1654 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.493479  1683 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
W20260709 13:02:44.494890  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 67906.6us
W20260709 13:02:44.494148  1580 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.764s (SENT)
I20260709 13:02:44.499974  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.503417  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:44.511691  4859 consensus_queue.cc:1059] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:44.511739  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.429550  5509 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:02:44.518237  4859 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:44.518736  4859 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:44.519131  4859 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.511078  5530 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:44.502784  5533 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:44.520761  5533 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:44.479470  5506 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:44.524195  5475 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:44.524636  5475 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:44.524873  5506 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:44.525580  5475 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.526937  5475 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:44.504614  5537 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:44.528618  5537 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:44.529070  5537 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:44.518755  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:44.519958  5530 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:44.543836  5530 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.548852  4859 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.556600  5522 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.557228  5522 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.559419  5522 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:44.488920  5409 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.549291  5501 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:44.626331  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 132379us
W20260709 13:02:44.627068  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.573220  5509 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:02:44.572995  5439 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:44.635529  4859 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:44.621397  5501 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:44.605033  5426 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:02:44.647516  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.657259  5500 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.659639  5500 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:44.657662  1614 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:02:44.660557  1614 raft_consensus.cc:606] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:44.660935  1614 raft_consensus.cc:614] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:44.672981  5530 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.674983  5255 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:44.675377  5530 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:44.677497  1687 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:44.650660  5501 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.680694  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.681491  1538 raft_consensus.cc:2368] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 9.
W20260709 13:02:44.641269  1580 leader_election.cc:336] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.906s (SENT)
I20260709 13:02:44.685575  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.686424  1540 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:44.607254  5522 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:02:44.649832  5409 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:44.692462  1539 raft_consensus.cc:1217] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.7->[6.8-6.8]   Dedup: 6.8->[]
I20260709 13:02:44.693012  1539 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:02:44.693773  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.694015  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.694711  1541 raft_consensus.cc:2410] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:44.694860  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.695336  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.694504  1533 raft_consensus.cc:2368] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:44.691606  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.699437  1534 raft_consensus.cc:2368] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:44.700057  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.700542  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.700811  1539 raft_consensus.cc:2368] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
W20260709 13:02:44.702044  5574 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:44.722288  5501 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.723583  1683 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:44.723866  1684 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:44.727923  5553 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:44.729547  5553 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:44.729475  5255 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:44.730043  5553 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:44.730415  5255 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:44.730787  5255 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:44.731114  5553 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.731673  5255 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.694468  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:44.730170  5573 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:02:44.739971  5255 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:44.740101  1535 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
W20260709 13:02:44.739770  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 98550.1us
I20260709 13:02:44.741391  5564 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:44.742408  5564 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:44.742780  5564 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:44.743758  5564 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.745013  5564 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.746542  1437 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 10 to 12, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.748857  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:44.756279  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 132754us
I20260709 13:02:44.757299  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.771428  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.772154  1540 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:44.772430  1534 raft_consensus.cc:2368] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:44.739666  5553 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:44.768538  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 133210us
I20260709 13:02:44.769351  1539 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:44.770591  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.778439  1538 raft_consensus.cc:2368] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:44.771343  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.783689  1535 raft_consensus.cc:2410] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:02:44.728408  5501 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:44.784185  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 162724us
I20260709 13:02:44.789235  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:44.801437  2362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
 from {username='slave'} at 127.0.0.1:43384
W20260709 13:02:44.803956  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.802047  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:44.794121  1437 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 10 to 12, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.805538  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:44.802105  2362 raft_consensus.cc:606] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Received request to transfer leadership to TS f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:44.808928  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:44.811137  4859 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:44.811697  4859 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:44.814236  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.816026  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.816720  1539 raft_consensus.cc:2376] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7. Re-sending same reply.
I20260709 13:02:44.816807  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.817525  1534 raft_consensus.cc:2376] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10. Re-sending same reply.
I20260709 13:02:44.817813  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.818539  1540 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:44.793020  5506 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:44.823647  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.824105  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.824304  1534 raft_consensus.cc:2376] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10. Re-sending same reply.
I20260709 13:02:44.821027  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.825261  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.825419  1540 raft_consensus.cc:2376] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11. Re-sending same reply.
I20260709 13:02:44.827464  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:44.829655  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.830636  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:44.828913  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.830781  1540 raft_consensus.cc:2376] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9. Re-sending same reply.
I20260709 13:02:44.831321  1615 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:44.831986  4859 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.832561  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.809020  5475 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:44.828142  1616 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:44.837634  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.834173  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.838864  1612 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:44.835335  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.835246  1539 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:44.835903  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.839655  1541 raft_consensus.cc:2368] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9.
I20260709 13:02:44.822569  5501 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:44.831297  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:44.841245  1580 leader_election.cc:336] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.057s (SENT)
I20260709 13:02:44.845551  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:44.846517  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.847051  1537 raft_consensus.cc:2376] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11. Re-sending same reply.
I20260709 13:02:44.838244  1536 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:44.843268  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:44.843901  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.834563  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.848537  1609 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.848577  1534 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.851143  5537 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.853675  5537 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:44.856449  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.858762  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:44.859687  1608 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:44.865432  1687 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:44.872061  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.872398  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.873787  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.878471  1539 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.873836  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.880568  1536 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:44.874943  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.883190  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.884732  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:44.889592  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:44.890761  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 186) took 34165 ms (client timeout 15000 ms). Trace:
I20260709 13:02:44.891607  5519 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.892268  5519 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.894479  5519 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:44.895319  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:44.870090  5501 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:44.899796  5475 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:44.900568  5501 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.901213  5475 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:44.904548  5439 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:44.905021  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.905652  1541 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:44.802871  1427 maintenance_manager.cc:643] P bd598697ff644162909af62351a1ef0b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.560s	user 0.161s	sys 0.075s Metrics: {"bytes_written":29548,"cfile_init":1,"dirs.queue_time_us":147144,"dirs.run_cpu_time_us":605,"dirs.run_wall_time_us":36753,"drs_written":1,"lbm_read_time_us":508,"lbm_reads_lt_1ms":4,"lbm_write_time_us":16869,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":28,"peak_mem_usage":0,"rows_written":63,"thread_start_us":36017,"threads_started":1}
I20260709 13:02:44.913259  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:44.914058  1538 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:44.914961  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 73729.5us
I20260709 13:02:44.921099  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.922147  1537 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:44.932200  1616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:02:44.933131  1616 raft_consensus.cc:606] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:44.940119  1612 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:44.945238  1537 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:44.955267  1537 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:02:44.956507  1580 leader_election.cc:336] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.072s (SENT)
I20260709 13:02:44.956956  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:44.959370  1537 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:44.949365  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:44.870422  5558 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:44.951642  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:44.952936  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:45.013481  1612 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:44.986663  5578 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.022476  5558 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:45.035640  5578 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:45.087492  5578 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:45.154284  5506 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:45.357008  5581 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:02:45.476532  5506 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.084759  5499 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:46.085425  5499 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.087613  5499 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:46.191746  1613 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:46.198078  5506 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.010s
W20260709 13:02:46.199676  5506 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.010s
I20260709 13:02:46.207700  5597 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:46.208557  5597 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.218394  5597 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:46.226305  1539 consensus_meta.cc:287] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.347s	user 0.020s	sys 0.009s
I20260709 13:02:46.227304  1539 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:46.228077  1539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2242) took 1389 ms (client timeout 1625 ms). Trace:
W20260709 13:02:46.228499  1539 rpcz_store.cc:269] 0709 13:02:44.838530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.873300 (+ 34770us) service_pool.cc:224] Handling call
0709 13:02:46.227962 (+1354662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3840}
W20260709 13:02:46.233054  1610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.354s	user 0.025s	sys 0.021s
W20260709 13:02:46.234818  1610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.026s	sys 0.022s
I20260709 13:02:46.235936  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2209) took 1422 ms. Trace:
I20260709 13:02:46.236876  1610 rpcz_store.cc:276] 0709 13:02:44.813647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.813857 (+   210us) service_pool.cc:224] Handling call
0709 13:02:44.814176 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.833337 (+ 19161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.833365 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.839779 (+  6414us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.235458 (+1395679us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:46.235515 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.235608 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.235670 (+    62us) raft_consensus.cc:1685] finished
0709 13:02:46.235682 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.235863 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":467,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5357,"thread_start_us":1358427,"threads_started":1,"wal-append.queue_time_us":297662,"wal-append.run_cpu_time_us":2570,"wal-append.run_wall_time_us":1034819}
I20260709 13:02:46.259220  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2243) took 1420 ms. Trace:
I20260709 13:02:46.259966  1539 rpcz_store.cc:276] 0709 13:02:44.838780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.229706 (+1390926us) service_pool.cc:224] Handling call
0709 13:02:46.230117 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.238420 (+  8303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.238469 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.239169 (+   700us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.256865 (+ 17696us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:46.256921 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.257020 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.258897 (+  1877us) raft_consensus.cc:1685] finished
0709 13:02:46.258926 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.259139 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7366,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":190,"thread_start_us":22596,"threads_started":2,"wal-append.queue_time_us":15329}
I20260709 13:02:46.263777  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 588) took 1311 ms. Trace:
I20260709 13:02:46.264369  1610 rpcz_store.cc:276] 0709 13:02:46.258771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.263072 (+  4301us) service_pool.cc:224] Handling call
0709 13:02:46.263408 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.263551 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.263566 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.263593 (+    27us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:46.263613 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.263648 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.263723 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:46.265244  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.265026  5600 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.265810  5600 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.267623  5600 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:46.269126  5602 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:46.269856  5602 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.272517  5602 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:46.273129  5602 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:46.273729  5602 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:44.824265  1437 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 8, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:46.275996  5602 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:46.279395  1437 catalog_manager.cc:5697] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.281930  1437 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.284009  1437 catalog_manager.cc:5697] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.285917  1437 catalog_manager.cc:5697] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 4 to 6, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.288122  1437 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 4 to 6, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:02:46.290716  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 1.33422e+06us
I20260709 13:02:46.290534  1437 catalog_manager.cc:5697] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:02:46.292061  1580 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.093s (SENT)
I20260709 13:02:46.292477  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.294736  1437 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 6, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:02:46.295914  1580 connection.cc:256] RPC call timeout handler was delayed by -1.327670266000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2413s for a response
I20260709 13:02:46.296429  5604 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.301895  1428 maintenance_manager.cc:419] P bd598697ff644162909af62351a1ef0b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7732 bytes on disk
W20260709 13:02:46.316349  1580 connection.cc:256] RPC call timeout handler was delayed by -1.0792380650000268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2828s for a response
I20260709 13:02:46.307067  1615 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:46.317253  5604 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:46.317795  5604 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.319945  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2240) took 1482 ms. Trace:
I20260709 13:02:46.320374  1537 rpcz_store.cc:276] 0709 13:02:44.837970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.983570 (+145600us) service_pool.cc:224] Handling call
0709 13:02:44.983977 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.287964 (+1303987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.288007 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.288644 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.314936 (+ 26292us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:02:46.314986 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.315088 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.319686 (+  4598us) raft_consensus.cc:1685] finished
0709 13:02:46.319707 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.319878 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2191,"raft.queue_time_us":1295765,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"thread_start_us":25829,"threads_started":1,"wal-append.queue_time_us":25645}
I20260709 13:02:46.321411  5604 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:46.322381  5604 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:46.322962  5604 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.330389  5604 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:46.332785  5602 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:46.334427  5602 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.337088  5602 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:46.337832  5602 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:46.338634  1541 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.433s	user 0.018s	sys 0.007s
I20260709 13:02:46.338477  5602 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.339066  1541 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:46.339802  1541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2244) took 1500 ms (client timeout 1571 ms). Trace:
W20260709 13:02:46.343230  1541 rpcz_store.cc:269] 0709 13:02:44.839016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.873962 (+ 34946us) service_pool.cc:224] Handling call
0709 13:02:46.339737 (+1465775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.342197  5602 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:46.347205  5608 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:46.347961  5608 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.350538  5608 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:46.351002  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2247) took 1500 ms. Trace:
I20260709 13:02:46.351435  1537 rpcz_store.cc:276] 0709 13:02:44.850899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.322091 (+1471192us) service_pool.cc:224] Handling call
0709 13:02:46.322474 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.323394 (+   920us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:02:46.331574 (+  8180us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.340367 (+  8793us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.343855 (+  3488us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.344704 (+   849us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.344908 (+   204us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:46.345223 (+   315us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.345782 (+   559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.345860 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.350782 (+  4922us) raft_consensus.cc:1685] finished
0709 13:02:46.350804 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.350936 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2939,"prepare.queue_time_us":23065,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":98,"raft.queue_time_us":3953,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":383,"thread_start_us":15539,"threads_started":2,"wal-append.queue_time_us":16131}
I20260709 13:02:46.354821  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2250) took 1502 ms. Trace:
W20260709 13:02:46.355650  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.605s	user 0.020s	sys 0.026s
W20260709 13:02:46.360775  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.610s	user 0.021s	sys 0.026s
I20260709 13:02:46.360394  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2246) took 1509 ms. Trace:
I20260709 13:02:46.361470  1539 rpcz_store.cc:276] 0709 13:02:44.850547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.261938 (+1411391us) service_pool.cc:224] Handling call
0709 13:02:46.262335 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.262596 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.262627 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.267949 (+  5322us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.350783 (+ 82834us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:46.350829 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.351011 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.360120 (+  9109us) raft_consensus.cc:1685] finished
0709 13:02:46.360141 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.360301 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":82162,"threads_started":1,"wal-append.queue_time_us":81917}
I20260709 13:02:46.363509  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 664) took 1487 ms. Trace:
I20260709 13:02:46.363828  1539 rpcz_store.cc:276] 0709 13:02:44.875747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.362684 (+1486937us) service_pool.cc:224] Handling call
0709 13:02:46.363005 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.363174 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.363200 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.363242 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:46.363273 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.363326 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.363458 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.369096  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.370216  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.370844  1539 raft_consensus.cc:2368] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7.
I20260709 13:02:46.371548  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.355295  1537 rpcz_store.cc:276] 0709 13:02:44.851913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.353695 (+1501782us) service_pool.cc:224] Handling call
0709 13:02:46.354163 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.354397 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.354436 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.354503 (+    67us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:46.354548 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.354625 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.354765 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.373665  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.374893  1537 raft_consensus.cc:2410] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:02:46.380359  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:46.380919  1539 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.383669  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.384407  1539 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:44.891165  1439 rpcz_store.cc:269] 0709 13:02:10.724994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:10.725244 (+   250us) service_pool.cc:224] Handling call
0709 13:02:44.890669 (+34165425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:43.428268 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:43.495759 (+ 67491us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:43.495823 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:02:43.495842 (+    19us) tablet.cc:662] Decoding operations
0709 13:02:43.848406 (+352564us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:43.848519 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:43.848552 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:02:43.849255 (+   703us) tablet.cc:701] Row locks acquired
0709 13:02:43.849312 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:02:43.849530 (+   218us) write_op.cc:270] Start()
0709 13:02:43.849676 (+   146us) write_op.cc:276] Timestamp: P: 1783602163849452 usec, L: 0
0709 13:02:43.849707 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:02:43.862048 (+ 12341us) log.cc:844] Serialized 2865 byte log entry
0709 13:02:44.286126 (+424078us) op_driver.cc:464] REPLICATION: finished
0709 13:02:44.508443 (+222317us) write_op.cc:301] APPLY: starting
0709 13:02:44.508548 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:44.509248 (+   700us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:44.509373 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:44.654211 (+144838us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:44.654519 (+   308us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=7,key_file_lookups=7,delta_file_lookups=0,mrs_lookups=14
0709 13:02:44.656247 (+  1728us) write_op.cc:312] APPLY: finished
0709 13:02:44.656675 (+   428us) log.cc:844] Serialized 100 byte log entry
0709 13:02:44.663851 (+  7176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:44.663983 (+   132us) write_op.cc:454] Released schema lock
0709 13:02:44.664073 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:44.664608 (+   535us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:44.664638 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4088444,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":221977,"apply.run_cpu_time_us":14944,"apply.run_wall_time_us":156141,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":1,"lbm_read_time_us":5262,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":7,"num_ops":7,"prepare.queue_time_us":169081,"prepare.run_cpu_time_us":74849,"prepare.run_wall_time_us":689546,"raft.queue_time_us":72662,"raft.run_cpu_time_us":77935,"raft.run_wall_time_us":116462,"replication_time_us":436239,"spinlock_wait_cycles":2304,"thread_start_us":382260,"threads_started":4,"wal-append.queue_time_us":238551}]]}
I20260709 13:02:44.984262  1535 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.386708  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.387830  1539 raft_consensus.cc:2410] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:46.375883  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.400053  1537 raft_consensus.cc:2410] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:46.401044  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.403524  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:46.404347  1655 connection.cc:256] RPC call timeout handler was delayed by -1.2700913600000376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:02:46.407311  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2004) took 1657 ms. Trace:
I20260709 13:02:46.404335  1537 raft_consensus.cc:2368] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:46.411682  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.412719  1537 raft_consensus.cc:2368] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:46.413992  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.414793  1537 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.393138  5612 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.407827  1533 rpcz_store.cc:276] 0709 13:02:44.749828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.749986 (+   158us) service_pool.cc:224] Handling call
0709 13:02:44.750474 (+   488us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:44.751113 (+   639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.751169 (+    56us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:44.752021 (+   852us) log.cc:844] Serialized 52 byte log entry
0709 13:02:44.944733 (+192712us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:44.944791 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:44.944887 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.406990 (+1462103us) raft_consensus.cc:1685] finished
0709 13:02:46.407017 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.407236 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"thread_start_us":192110,"threads_started":1,"wal-append.queue_time_us":309672}
W20260709 13:02:46.417099  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.505s	user 0.011s	sys 0.034s
I20260709 13:02:46.416877  5612 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:46.417681  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.506s	user 0.011s	sys 0.034s
I20260709 13:02:46.420140  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.421569  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.421976  5615 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:46.422504  5615 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.422887  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:46.423552  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.423681  1539 raft_consensus.cc:2410] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:02:46.424223  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 43975.8us
I20260709 13:02:46.424968  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2248) took 1573 ms. Trace:
I20260709 13:02:46.425065  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:46.425321  5610 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.426221  5610 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.425415  1541 rpcz_store.cc:276] 0709 13:02:44.851245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.344111 (+1492866us) service_pool.cc:224] Handling call
0709 13:02:46.344483 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:46.345221 (+   738us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:46.382796 (+ 37575us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.391185 (+  8389us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:46.391638 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.391782 (+   144us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:46.391818 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.391889 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.424777 (+ 32888us) raft_consensus.cc:1685] finished
0709 13:02:46.424796 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.424903 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1979,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":257,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"thread_start_us":44628,"threads_started":2,"wal-append.queue_time_us":6731}
I20260709 13:02:46.428123  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.428956  1541 raft_consensus.cc:2410] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:46.429620  5610 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:46.429785  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.430636  1541 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.424180  1536 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:46.421759  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:46.432250  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 2011) took 1561 ms (client timeout 1906 ms). Trace:
I20260709 13:02:46.395913  1535 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
W20260709 13:02:46.433657  1535 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2249) took 1582 ms (client timeout 1970 ms). Trace:
W20260709 13:02:46.434208  1609 consensus_meta.cc:287] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.568s	user 0.020s	sys 0.004s
W20260709 13:02:46.434134  1535 rpcz_store.cc:269] 0709 13:02:44.851576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.949019 (+ 97443us) service_pool.cc:224] Handling call
0709 13:02:46.433580 (+1484561us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.434625  1609 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:46.435410  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:46.432914  1536 rpcz_store.cc:269] 0709 13:02:44.870863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.947168 (+ 76305us) service_pool.cc:224] Handling call
0709 13:02:46.432169 (+1485001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.415724  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.432799  1533 raft_consensus.cc:2376] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7. Re-sending same reply.
I20260709 13:02:46.439457  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.439551  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2002) took 1690 ms. Trace:
I20260709 13:02:46.440184  1533 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:02:46.441566  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.440208  1532 rpcz_store.cc:276] 0709 13:02:44.748887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.749030 (+   143us) service_pool.cc:224] Handling call
0709 13:02:44.749433 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:44.749800 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:44.749826 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:44.750280 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 13:02:46.361207 (+1610927us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:46.361523 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.439200 (+ 77677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.439275 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:46.439313 (+    38us) raft_consensus.cc:1685] finished
0709 13:02:46.439324 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.439480 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7485,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":201,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":165,"thread_start_us":1687835,"threads_started":2,"wal-append.queue_time_us":324500,"wal-append.run_cpu_time_us":2273,"wal-append.run_wall_time_us":1065715}
I20260709 13:02:46.438366  5619 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:46.437037  1609 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2214) took 1605 ms (client timeout 1618 ms). Trace:
I20260709 13:02:46.441744  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.438285  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.426265  5620 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:46.443483  1580 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.510s (SENT)
I20260709 13:02:46.444124  1536 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.443877  1537 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:46.445604  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.446604  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.446902  1536 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.447299  1537 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
W20260709 13:02:46.443646  1609 rpcz_store.cc:269] 0709 13:02:44.830000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.830122 (+   122us) service_pool.cc:224] Handling call
0709 13:02:46.435098 (+1604976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.448086  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.448930  1536 raft_consensus.cc:1813] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Handling vote request from an unknown peer e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:46.449507  1536 raft_consensus.cc:2368] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:46.450414  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.443603  1535 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:46.451092  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.443147  1533 raft_consensus.cc:2410] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:02:46.452174  5620 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.452239  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.452996  5620 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.453495  1535 raft_consensus.cc:2393] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.453338  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.454141  1537 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.451336  5559 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:46.454594  5559 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:46.454947  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.455626  5559 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.456881  5615 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:46.454273  1533 raft_consensus.cc:2368] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:46.458494  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.458549  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.459610  1533 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.459695  1537 raft_consensus.cc:2368] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12.
I20260709 13:02:46.460719  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.462078  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.462966  1533 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.457053  5559 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.460805  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.451203  1536 raft_consensus.cc:2368] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:46.464805  1537 raft_consensus.cc:2410] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:46.465438  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.467797  1536 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
W20260709 13:02:46.469149  1580 leader_election.cc:336] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.551s (SENT)
I20260709 13:02:46.465677  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.469956  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.442898  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.469659  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.470440  1537 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.458788  5615 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:46.476734  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:46.477818  1580 leader_election.cc:336] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.680s (SENT)
I20260709 13:02:46.467096  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.478322  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.477659  1539 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.479557  1533 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:46.479600  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:46.481694  1580 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.729s (SENT)
I20260709 13:02:46.480316  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 667) took 1544 ms. Trace:
I20260709 13:02:46.482268  1533 rpcz_store.cc:276] 0709 13:02:44.935479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.478923 (+1543444us) service_pool.cc:224] Handling call
0709 13:02:46.479217 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.479991 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.480242 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.482231  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.483824  1533 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:46.483750  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.484525  1539 raft_consensus.cc:1813] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Handling vote request from an unknown peer e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:46.485097  1539 raft_consensus.cc:2368] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
W20260709 13:02:46.484923  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 59942.7us
I20260709 13:02:46.485265  5623 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:46.485801  5623 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.482046  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.487447  1539 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:46.480479  1689 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:46.489135  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.491281  1532 raft_consensus.cc:2393] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:46.489681  1580 leader_election.cc:336] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.807s (SENT)
I20260709 13:02:46.492285  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.489550  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.494639  1541 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.495743  5624 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:46.496315  1541 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:46.496528  5624 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.488700  5610 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.488492  1536 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:02:46.499327  1536 pending_rounds.cc:85] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 3
I20260709 13:02:46.489801  5623 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.499809  1536 pending_rounds.cc:107] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:46.500447  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.502729  1532 raft_consensus.cc:2368] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:46.503551  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.504262  1532 raft_consensus.cc:2368] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:46.505002  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.506031  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.506687  1532 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.507453  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.488909  5602 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:46.509272  5602 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.488480  1539 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:46.510218  5612 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:46.508395  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.478070  5619 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.510849  5612 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.501164  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.513736  5619 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:46.515839  5612 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:46.503754  1613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2220) took 1639 ms (client timeout 1625 ms). Trace:
W20260709 13:02:46.519457  1613 rpcz_store.cc:269] 0709 13:02:44.864418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.864676 (+   258us) service_pool.cc:224] Handling call
0709 13:02:46.503571 (+1638895us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54003a39d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:46.503681 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022557952}
I20260709 13:02:46.520700  5612 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:46.484542  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2014) took 1500 ms. Trace:
I20260709 13:02:46.512634  1532 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:46.521575  5620 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.515734  1541 raft_consensus.cc:2410] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:02:46.522505  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.523759  1532 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.490139  5615 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.521783  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.524821  1538 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
W20260709 13:02:46.525295  1538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 2013) took 1608 ms (client timeout 2072 ms). Trace:
W20260709 13:02:46.525666  1538 rpcz_store.cc:269] 0709 13:02:44.917350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.954944 (+ 37594us) service_pool.cc:224] Handling call
0709 13:02:46.525235 (+1570291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.526695  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.526983  5615 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:46.527331  1538 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:02:46.490196  5604 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.521437  1533 rpcz_store.cc:276] 0709 13:02:44.984614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.483219 (+1498605us) service_pool.cc:224] Handling call
0709 13:02:46.483502 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.484303 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.484488 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.523532  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.529986  1541 raft_consensus.cc:1813] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Handling vote request from an unknown peer e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:46.531662  1541 raft_consensus.cc:2368] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:46.517884  1536 raft_consensus.cc:2889] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:46.534197  5620 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:46.536279  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.537364  1536 raft_consensus.cc:2368] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:46.538789  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.540547  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.541347  1541 raft_consensus.cc:2393] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.541807  1536 raft_consensus.cc:2393] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:46.543092  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.543802  1541 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:46.543176  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.546293  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 666) took 1636 ms. Trace:
I20260709 13:02:46.547008  1537 rpcz_store.cc:276] 0709 13:02:44.909697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.545062 (+1635365us) service_pool.cc:224] Handling call
0709 13:02:46.545548 (+   486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.545818 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.545861 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.545927 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:46.545976 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.546054 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.546211 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.547727  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.549243  1541 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.550159  1539 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:46.551177  1538 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.564723  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.565927  1536 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
W20260709 13:02:46.567060  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 77407.8us
I20260709 13:02:46.567271  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.567809  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.569747  1541 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
W20260709 13:02:46.568270  1580 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.908s (SENT)
I20260709 13:02:46.570930  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.572554  5604 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.574247  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.575743  1539 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:46.576704  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.575052  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.568753  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.577346  1539 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
W20260709 13:02:46.578356  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 82676.1us
I20260709 13:02:46.578898  1537 raft_consensus.cc:2468] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
W20260709 13:02:46.572834  1580 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.081s (SENT)
I20260709 13:02:46.509222  5623 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.579777  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.581384  5604 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:46.581703  1580 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.099s (SENT)
I20260709 13:02:46.582231  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.582559  5623 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:02:46.583828  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.584841  1538 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:46.579811  1654 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:46.585654  1580 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.129s (SENT)
I20260709 13:02:46.585098  5604 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:46.587405  1580 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.169s (SENT)
W20260709 13:02:46.588425  1580 leader_election.cc:336] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.413s (SENT)
W20260709 13:02:46.589411  1580 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.812s (SENT)
I20260709 13:02:46.589871  1580 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.591218  5623 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:46.590425  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:46.592979  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.593282  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.593768  1613 raft_consensus.cc:2368] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
I20260709 13:02:46.593986  1609 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 7: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:46.595299  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.595877  1609 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:46.597172  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.597806  1609 raft_consensus.cc:2368] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:46.599080  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.600793  5559 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.601257  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.602205  1609 raft_consensus.cc:2368] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:46.604274  5623 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:46.604801  5623 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.605001  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.605266  5623 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.605898  1609 raft_consensus.cc:2368] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 12.
W20260709 13:02:46.607860  1615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2222) took 1725 ms (client timeout 1514 ms). Trace:
W20260709 13:02:46.608624  1615 rpcz_store.cc:269] 0709 13:02:44.882677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.882878 (+   201us) service_pool.cc:224] Handling call
0709 13:02:46.607674 (+1724796us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540030e154. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:46.607793 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3212846848}
I20260709 13:02:46.610802  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:46.611410  1540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.765s	user 0.016s	sys 0.010s
W20260709 13:02:46.608011  1534 consensus_meta.cc:287] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.759s	user 0.026s	sys 0.002s
I20260709 13:02:46.612185  1534 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:46.612674  1534 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2235) took 1784 ms (client timeout 1618 ms). Trace:
W20260709 13:02:46.612905  1534 rpcz_store.cc:269] 0709 13:02:44.828425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.834356 (+  5931us) service_pool.cc:224] Handling call
0709 13:02:46.612594 (+1778238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:02:46.613195  1580 leader_election.cc:336] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.470s (SENT)
I20260709 13:02:46.577399  5624 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:46.613721  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.611922  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:46.614110  5625 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:46.616281  5625 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:46.616170  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:46.617437  5625 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.619514  5612 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.615545  5620 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:46.620853  5620 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:46.621259  1540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.775s	user 0.016s	sys 0.010s
I20260709 13:02:46.621820  5620 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:46.614795  1580 leader_election.cc:336] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.850s (SENT)
I20260709 13:02:46.623286  5612 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:46.623818  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.624661  5604 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.624692  5612 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.619313  1427 maintenance_manager.cc:643] P bd598697ff644162909af62351a1ef0b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":351,"lbm_reads_lt_1ms":4}
I20260709 13:02:46.615338  5559 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:46.638833  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2236) took 1804 ms. Trace:
I20260709 13:02:46.639884  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:46.642163  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.643183  1615 raft_consensus.cc:2410] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:46.641047  1540 rpcz_store.cc:276] 0709 13:02:44.834670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:44.836023 (+  1353us) service_pool.cc:224] Handling call
0709 13:02:44.836353 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:44.836572 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:02:46.621766 (+1785194us) log.cc:844] Serialized 14 byte log entry
0709 13:02:46.638298 (+ 16532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.638360 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:46.638572 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.638654 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.638780 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":317982,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":594,"raft.queue_time_us":303,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"thread_start_us":1791405,"threads_started":2}
I20260709 13:02:46.660698  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:46.665241  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.665830  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.666069  1615 raft_consensus.cc:2368] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 11.
I20260709 13:02:46.666438  1609 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:46.670933  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.671676  1540 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.672601  5624 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.673269  5624 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:46.673867  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.674207  5624 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.675343  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.676131  1614 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:46.676595  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.677255  1538 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:46.684584  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:46.685209  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.685355  1613 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:46.685636  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.685710  1536 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:02:46.686100  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.687978  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.689080  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.689550  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.689751  1539 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:46.690219  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.690908  1536 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
W20260709 13:02:46.693694  1580 leader_election.cc:336] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.928s (SENT)
I20260709 13:02:46.694456  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.693708  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.695308  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.695426  1607 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:02:46.696069  1538 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:46.696442  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.698939  1608 raft_consensus.cc:2410] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:02:46.678220  5627 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:46.702584  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.708647  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.711577  1607 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:46.712837  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.692222  5559 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.713308  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.712659  1540 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:46.713272  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.713518  1538 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:46.714704  1608 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:46.714737  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.737149  1611 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.737591  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.722798  1607 raft_consensus.cc:2368] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:46.722635  1536 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:46.698031  5604 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.738623  1608 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:46.740324  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.744194  5559 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.766569  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.767467  1608 raft_consensus.cc:2368] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:46.769460  5559 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:46.770416  1611 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
W20260709 13:02:46.771047  1580 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.984s (SENT)
I20260709 13:02:46.771536  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:46.765170  1616 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:46.761444  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.774511  1607 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.697921  5626 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.761442  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.780071  1536 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:46.782083  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.699520  5610 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:46.699420  5602 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:46.763991  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:46.778429  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:46.783557  1540 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:46.784251  1616 raft_consensus.cc:2368] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12.
I20260709 13:02:46.756603  5604 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.792133  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.793009  1616 raft_consensus.cc:2410] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:46.793788  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.794612  1616 raft_consensus.cc:2410] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:46.795676  5637 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.796289  5637 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.798578  5637 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:46.779718  5608 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:46.807340  5608 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.776782  5559 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.815300  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:46.825444  5635 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:02:46.826647  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 665) took 1928 ms. Trace:
I20260709 13:02:46.827222  1535 rpcz_store.cc:276] 0709 13:02:44.898110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:46.825635 (+1927525us) service_pool.cc:224] Handling call
0709 13:02:46.826010 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:46.826247 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:46.826285 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:46.826338 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:46.826375 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:46.826437 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:46.826578 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:02:46.810357  5602 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:46.834677  5602 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:46.837095  5604 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:46.841444  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:46.843042  1616 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:46.846076  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.848433  1540 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
W20260709 13:02:46.849138  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:46.878381  1607 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:02:46.886521  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.887655  1615 raft_consensus.cc:2410] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:02:46.890286  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.891429  1615 raft_consensus.cc:2410] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:02:46.893260  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51898.7us
I20260709 13:02:46.895149  1654 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:46.897330  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.898669  1616 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.902786  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:46.868292  5612 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:46.904096  5620 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:46.904302  5506 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.904624  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.868927  5626 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.905599  1615 raft_consensus.cc:2368] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:02:46.909189  1654 leader_election.cc:400] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9.
I20260709 13:02:46.909710  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.910423  1615 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:46.907227  5626 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:46.909595  1654 leader_election.cc:403] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:46.912604  5506 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:46.904178  5612 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:46.964085  1615 raft_consensus.cc:2410] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:46.965256  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.965905  1615 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:46.985126  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:46.986178  1607 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.000445  1536 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:47.004585  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.937482  5620 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9.
I20260709 13:02:46.928665  5627 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:47.005771  1613 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:47.010962  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:47.012439  1613 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.023527  1607 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:47.024335  1615 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:47.025027  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.031476  1607 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:46.941536  5637 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:02:47.033607  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.035753  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.034204  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:46.946431  5615 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:02:47.037314  1611 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:47.041455  1613 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:47.041628  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.043337  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.013631  5608 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:47.042645  1615 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
W20260709 13:02:47.109159  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.102475  5623 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.172288  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.172740  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.198987  1614 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:47.174177  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.174454  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:47.199517  1580 leader_election.cc:336] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.934s (SENT)
I20260709 13:02:47.199762  1611 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:47.200881  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:47.201709  1611 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.175073  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:47.204138  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:47.204497  1613 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.205464  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.205729  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.175175  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:47.177013  5612 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:47.103631  5627 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.177281  1687 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:47.180533  2328 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.207330  1609 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:47.016943  5600 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:47.189911  1616 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:47.191226  1607 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:47.193835  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:47.192646  5641 log.cc:927] Time spent T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.124s	user 0.001s	sys 0.004s
I20260709 13:02:47.206807  1608 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.208338  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.225775  1609 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:47.221269  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.226881  2370 raft_consensus.cc:2393] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:47.216741  1611 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:47.194373  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.228343  1615 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
W20260709 13:02:47.216976  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 276799us
W20260709 13:02:47.223141  1580 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.879s (SENT)
I20260709 13:02:47.215745  1613 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:47.236110  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.236236  1580 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.223903  5612 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:47.255357  1505 leader_election.cc:400] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 7. Current term is 8.
W20260709 13:02:47.255695  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47481.8us
I20260709 13:02:47.224378  5600 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.220147  5626 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:47.223723  5597 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:47.276927  5597 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:47.277401  5597 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:47.258400  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:47.262650  5623 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:47.271287  1580 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.932s (SENT)
I20260709 13:02:47.279012  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.257630  5559 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:02:47.274951  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 43834.7us
I20260709 13:02:47.275707  5600 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:47.288295  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.291560  5608 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.292325  5608 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:47.294788  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:47.295982  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.283649  5612 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.299088  5612 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:47.300233  5608 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:47.315909  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 57581.3us
W20260709 13:02:47.318641  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa440 after lost signal to thread 434
W20260709 13:02:47.318717  5632 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.560s	user 0.002s	sys 0.002s
I20260709 13:02:47.320510  1580 leader_election.cc:400] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:47.320504  5559 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:47.320842  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080029abc0 after lost signal to thread 1473
I20260709 13:02:47.321105  1580 leader_election.cc:403] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.322016  5559 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:47.323127  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08002aa320 after lost signal to thread 1565
W20260709 13:02:47.323472  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2900 after lost signal to thread 1566
I20260709 13:02:47.323737  5559 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:47.325562  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.328444  5600 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:47.329496  5600 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:47.329945  5600 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:47.330417  5600 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.336493  5615 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:47.346777  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:47.347982  1532 raft_consensus.cc:2410] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:47.348245  5615 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:47.349853  5615 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.351024  5624 raft_consensus.cc:3055] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:47.351684  5624 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:47.358404  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2300 after lost signal to thread 1640
W20260709 13:02:47.360417  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080034ea00 after lost signal to thread 1714
W20260709 13:02:47.360837  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4fa0 after lost signal to thread 1715
I20260709 13:02:47.362484  5624 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.369431  5624 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.374130  1608 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:47.376804  5626 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:47.384464  5649 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:02:47.386250  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:47.387481  1533 raft_consensus.cc:2410] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:47.405503  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.407227  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.408319  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:47.415293  5651 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:02:47.425477  5523 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.426242  5523 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.431546  5523 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:47.436316  5650 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.436718  5523 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:47.436928  5650 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.437897  1437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 96) took 9552 ms. Trace:
I20260709 13:02:47.438104  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.438310  5644 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:47.439420  5650 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.440266  5644 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:47.403514  5597 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.438329  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.445899  2370 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:47.440943  2368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:02:47.446866  5653 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:47.447292  5653 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:47.447652  5653 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:47.446360  5644 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:47.449069  5626 consensus_queue.cc:1059] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:47.449816  5597 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:47.450361  5626 raft_consensus.cc:3055] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:47.450814  5626 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:47.449187  5328 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:47.451675  5626 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.453248  5626 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:47.440415  5523 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.454262  2368 raft_consensus.cc:606] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:47.454658  2368 raft_consensus.cc:614] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:47.457717  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.457971  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.458520  2370 raft_consensus.cc:2393] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 7: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:47.460067  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:47.460937  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800087dc0 after lost signal to thread 2395
I20260709 13:02:47.461102  1654 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:47.461385  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800087e20 after lost signal to thread 2396
I20260709 13:02:47.464418  5506 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:47.473722  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.469729  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:47.471702  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 245848us
I20260709 13:02:47.473176  5506 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.494454  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.465575  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.495080  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.497504  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.505095  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.504379  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.510075  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.517553  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.521610  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.439450  1437 rpcz_store.cc:276] 0709 13:02:37.885408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:37.886452 (+  1044us) service_pool.cc:224] Handling call
0709 13:02:38.344590 (+458138us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b5400002210. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e40b2 00007fd03495da89 00007fd0348f5da6 00007fd0348c7088 00007fd0349c537e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc
0709 13:02:38.421934 (+ 77344us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b5400002210. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3e9c 00007fd02b9e40f6 00007fd03495da89 00007fd0348f5da6 00007fd0348c7088 00007fd0349c537e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc
0709 13:02:47.437803 (+9015869us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:46.374569 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:46.375106 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:46.375136 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:02:46.375152 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:46.377996 (+  2844us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:46.378095 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:46.378133 (+    38us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:02:46.378958 (+   825us) tablet.cc:701] Row locks acquired
0709 13:02:46.378978 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:02:46.379125 (+   147us) write_op.cc:270] Start()
0709 13:02:46.379236 (+   111us) write_op.cc:276] Timestamp: P: 1783602166379074 usec, L: 0
0709 13:02:46.379256 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:02:46.379945 (+   689us) log.cc:844] Serialized 4046 byte log entry
0709 13:02:46.441529 (+ 61584us) op_driver.cc:464] REPLICATION: finished
0709 13:02:46.621723 (+180194us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b18003dca80. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:46.621875 (+   152us) write_op.cc:301] APPLY: starting
0709 13:02:46.621958 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:46.717822 (+ 95864us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:46.717880 (+    58us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:47.097772 (+379892us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:47.182363 (+ 84591us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 13:02:47.182417 (+    54us) write_op.cc:312] APPLY: finished
0709 13:02:47.187313 (+  4896us) log.cc:844] Serialized 96 byte log entry
0709 13:02:47.191826 (+  4513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.192071 (+   245us) write_op.cc:454] Released schema lock
0709 13:02:47.192138 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:47.232277 (+ 40139us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:47.235993 (+  3716us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":305912,"reported_tablets":12,"spinlock_wait_cycles":25089920,"child_traces":[["op",{"apply.queue_time_us":110675,"apply.run_cpu_time_us":27009,"apply.run_wall_time_us":594505,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45887,"num_ops":10,"prepare.queue_time_us":1719,"prepare.run_cpu_time_us":4915,"prepare.run_wall_time_us":22139,"raft.queue_time_us":42099,"raft.run_cpu_time_us":22083,"raft.run_wall_time_us":108325,"replication_time_us":62020,"spinlock_wait_cycles":62737792,"thread_start_us":153265,"threads_started":4,"wal-append.queue_time_us":12513}]]}
I20260709 13:02:47.523859  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.526388  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.522536  1689 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:47.533013  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.492745  5506 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.540905  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.493053  5612 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:47.541834  1687 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:02:47.464264  5654 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:47.542711  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.536798  5608 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:02:47.543304  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 222950us
I20260709 13:02:47.515416  5422 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:02:47.544430  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:47.520392  5621 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.516243  5637 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:47.545629  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 220209us
I20260709 13:02:47.575337  2362 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:47.577243  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.581300  1505 leader_election.cc:400] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:47.582633  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.564105  5394 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:47.560977  5654 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.544955  5619 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:47.588747  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.580003  5637 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.560164  5612 raft_consensus.cc:697] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:47.576896  5621 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.568928  5608 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:47.558421  5523 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:47.592111  5637 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.581295  5602 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:47.594501  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.599885  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.590173  5654 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.603729  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.613924  5650 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.614336  5652 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:47.594930  5621 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.615999  1505 leader_election.cc:400] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:47.616490  5650 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:47.616539  1505 leader_election.cc:403] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.617590  5652 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:47.604920  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.621415  5602 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:47.594563  1438 catalog_manager.cc:5697] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 6, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.623659  1579 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.604599  1653 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:47.623832  1438 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.624954  5602 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.625044  5658 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:47.625707  1438 catalog_manager.cc:5697] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.619809  1505 leader_election.cc:400] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 12.
W20260709 13:02:47.620375  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48380.6us
I20260709 13:02:47.628654  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.626483  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:47.546238  5644 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.597060  5619 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:47.629647  5602 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.632673  5619 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.633476  5644 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.629484  1653 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.630800  5608 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.632680  5602 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:47.637501  5658 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.638013  5658 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.637974  5602 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.638847  5658 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.640121  5600 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.641306  5604 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:47.641952  5604 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:47.642431  5604 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.651376  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:47.628846  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.665231  5652 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:47.667168  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.668365  5652 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:47.668906  5652 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:47.669351  5652 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.613369  5612 consensus_queue.cc:237] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.681038  5559 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:47.681478  5559 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:47.681854  5559 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.688663  5600 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:47.692564  5559 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.695559  5559 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:47.696472  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 45231us
I20260709 13:02:47.700225  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:47.701040  1682 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:47.710067  1682 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
W20260709 13:02:47.711277  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44245.3us
I20260709 13:02:47.630172  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.663625  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:47.658668  5658 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.718093  5604 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.734845  5654 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.722122  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:47.722461  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:47.762804  2365 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.723136  1505 leader_election.cc:400] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 11.
I20260709 13:02:47.720959  5658 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:47.726579  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:47.763825  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:47.736368  5604 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:47.771502  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:47.680541  5652 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.738996  5637 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.740367  5559 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:02:47.740585  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 110512us
I20260709 13:02:47.784061  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:47.778635  5659 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:47.746129  1438 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 7 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.757014  5602 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.785544  1438 catalog_manager.cc:5697] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.711143  5653 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.770156  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:02:47.787726  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 71168.7us
I20260709 13:02:47.789081  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:47.770413  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 244131us
I20260709 13:02:47.777200  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.780818  1686 raft_consensus.cc:2368] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:47.782285  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.804657  1438 catalog_manager.cc:5697] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.806042  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:47.807031  1534 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:47.808269  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.808871  1608 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:47.810199  1540 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:47.812197  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.817298  1579 leader_election.cc:400] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:47.817795  1579 leader_election.cc:403] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.819031  1612 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:47.820749  1613 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:47.805166  1609 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:47.823510  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:47.824347  1611 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.826947  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:47.827739  1534 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:47.787286  5659 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:47.830560  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:47.831243  1541 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:47.831866  5653 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:47.832942  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:47.833566  1540 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:47.778752  5660 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:47.836522  5660 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.837904  5621 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.838861  5660 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:47.840698  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51705.8us
I20260709 13:02:47.841640  1505 leader_election.cc:400] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:47.841949  1505 leader_election.cc:403] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.843315  1505 leader_election.cc:400] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:47.843652  1505 leader_election.cc:403] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.844136  5506 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:47.846132  1689 raft_consensus.cc:2368] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:47.846413  1687 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:47.847352  1684 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:47.848532  1540 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:47.832441  1438 catalog_manager.cc:5697] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.849606  1607 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:47.850389  1533 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:47.852154  1609 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:47.856058  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:47.856659  1540 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.858017  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:47.782925  5559 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:47.862488  1613 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:47.870144  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:47.870162  1438 catalog_manager.cc:5697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.872215  1541 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:47.877339  1611 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:47.877564  1540 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:47.815971  5600 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:47.901909  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.880054  1613 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:47.832942  5652 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:47.881238  1438 catalog_manager.cc:5697] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.861223  5621 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:47.787322  5604 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 13:02:47.918098  1613 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:47.911835  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:47.915797  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.862016  5660 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9.
I20260709 13:02:47.921221  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:47.916850  1534 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:47.919530  1683 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:47.919198  1611 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:47.919154  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:47.913041  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 349443us
I20260709 13:02:47.925595  1609 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:47.859416  5626 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:47.879148  5559 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:47.930823  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 87667.3us
I20260709 13:02:47.939360  1438 catalog_manager.cc:5697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.942750  1505 leader_election.cc:400] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12.
I20260709 13:02:47.943043  1505 leader_election.cc:403] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:02:47.943320  1438 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 6, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.944082  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.945214  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.944861  1438 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 6, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.946112  5652 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12.
I20260709 13:02:47.946938  5652 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:47.946174  1438 catalog_manager.cc:5697] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.959323  1609 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:47.936992  5626 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.831383  5659 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:47.996376  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.997516  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:47.998603  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:48.007287  1609 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
W20260709 13:02:48.007521  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 62382.6us
I20260709 13:02:48.009431  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.000859  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:48.004117  1541 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:47.994469  1438 catalog_manager.cc:5697] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 5, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:48.022532  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:47.973241  5506 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:48.026813  1438 catalog_manager.cc:5697] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 6, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:47.995114  5626 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.040686  1611 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:48.008962  5660 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.021474  5600 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:48.065434  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.064440  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:48.077639  2365 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:48.085282  1438 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:48.078662  5394 raft_consensus.cc:2764] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:02:48.113265  5667 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:02:48.081451  5602 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:48.124574  5668 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:02:48.127061  5661 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
W20260709 13:02:48.128151  5669 log.cc:927] Time spent T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:02:48.128901  5604 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.119725  5602 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:48.142154  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 58622.6us
I20260709 13:02:48.074194  5654 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:48.130863  5627 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:02:48.182865  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 398923us
I20260709 13:02:48.168365  1653 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:48.178956  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:48.129846  5637 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:48.192087  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:48.193924  1579 leader_election.cc:400] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:48.194685  1579 leader_election.cc:403] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:02:48.185899  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 163576us
W20260709 13:02:48.197654  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 201342us
I20260709 13:02:48.195205  1438 catalog_manager.cc:5697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 8, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
W20260709 13:02:48.198637  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 142219us
I20260709 13:02:48.199472  1505 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.199717  1438 catalog_manager.cc:5697] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 8 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:48.201234  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:48.201630  1438 catalog_manager.cc:5697] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:48.207904  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.185169  5602 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:48.219230  5602 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:48.219848  5602 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.220502  5602 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.221215  5674 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:48.210709  5328 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:48.197376  5650 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:48.221930  5674 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.207937  5654 raft_consensus.cc:2764] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:02:48.222855  5602 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.223506  5602 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:48.224385  5677 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.224961  5688 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:48.226810  5674 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.228731  5692 consensus_queue.cc:1059] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:48.223919  5602 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:48.231082  5602 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.230820  5674 raft_consensus.cc:3055] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:48.211907  1438 catalog_manager.cc:5697] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 3 to 5, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:48.235288  1438 catalog_manager.cc:5697] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:48.244273  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.247663  5650 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:48.248864  5650 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:48.249644  5559 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.272382  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:48.238179  5674 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:48.296602  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 87956.7us
I20260709 13:02:48.269840  5690 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:02:48.300330  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 104018us
I20260709 13:02:48.306413  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:48.313745  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.318123  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.319339  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:48.321117  1580 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 3.090s (SENT)
I20260709 13:02:48.321833  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.329180  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:48.289505  5626 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.322465  5659 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.344578  1611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8464531709643ab8a8fd947089037ef"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:45544
I20260709 13:02:48.346334  1611 raft_consensus.cc:606] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:48.316860  5690 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:48.344974  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.346864  1611 raft_consensus.cc:614] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:48.304548  5623 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:48.316727  5637 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:02:48.358903  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46087.8us
W20260709 13:02:48.359676  1580 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 3.290s (SENT)
I20260709 13:02:48.360249  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.329344  5654 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:02:48.340689  5694 consensus_queue.cc:1059] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:02:48.353156  5559 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.341316  5674 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.397939  5559 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:48.406819  5559 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.354727  5659 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.363076  5621 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 13:02:48.427457  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 67813.7us
I20260709 13:02:48.412905  5604 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:48.430029  5626 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.412638  5689 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:48.437772  5602 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:48.424957  5680 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:48.424083  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 99693.6us
I20260709 13:02:48.459137  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:48.392874  5690 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:48.463923  5694 consensus_queue.cc:1243] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:02:48.454561  5706 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.460482  5680 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.459896  5604 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:48.468125  5625 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:48.491830  5625 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:48.492805  5625 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.486763  5700 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:48.495805  5620 raft_consensus.cc:3055] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:48.496518  5679 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:02:48.487668  5695 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:02:48.497496  5679 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:48.478729  5680 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.498931  5679 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:48.479677  5621 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:02:48.500718  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 301332us
I20260709 13:02:48.478006  5650 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:02:48.491278  5602 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:48.509687  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.496466  5620 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:48.496254  5700 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.489569  5604 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:48.501713  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 229550us
I20260709 13:02:48.532398  5660 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.478807  5706 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.502960  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:48.533113  5660 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.535221  5706 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.535506  5660 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.537254  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:48.539572  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:48.539745  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:48.540217  1612 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:48.540524  1534 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.540762  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:48.541558  1613 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:48.543123  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:48.543673  1536 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.547079  5677 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 8. Current term is 9.
I20260709 13:02:48.519515  5600 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:48.548429  1610 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:48.548707  5615 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:48.549325  5615 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:48.550155  1534 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:48.550093  5615 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.552460  1685 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:48.553161  5659 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.553449  5700 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.562808  5627 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:48.563526  5559 raft_consensus.cc:3055] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:48.564074  5559 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:48.565081  5559 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.566376  5559 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.568817  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:48.540256  1541 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:48.512109  1505 leader_election.cc:400] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:02:48.578765  1505 leader_election.cc:403] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:02:48.478746  5708 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.510804  5686 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:48.580518  5686 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:02:48.580114  5708 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:48.526224  5604 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.588789  5620 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.590343  5620 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:48.608793  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 96926.4us
I20260709 13:02:48.609640  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.610509  1537 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:48.612970  1536 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:48.617497  1611 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:48.618439  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:48.621701  1539 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.621789  1540 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:48.622236  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:48.623261  1609 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:48.623548  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:48.624208  1540 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.626710  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:48.627543  1613 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:48.627920  1615 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:48.630353  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.631492  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:48.632404  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.647681  1540 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:48.657043  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.662614  1539 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
W20260709 13:02:48.667984  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 323079us
I20260709 13:02:48.669659  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:48.670320  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:48.671168  1683 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:48.671231  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:48.671679  1609 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:48.672506  1536 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:48.672724  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.673254  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.674722  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.680233  1534 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:48.683856  1541 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:48.687482  1534 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:48.633150  5652 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:48.691896  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 54819.4us
I20260709 13:02:48.685963  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:48.694265  1611 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:48.636507  5686 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:48.690237   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:48.698482  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:48.700496  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:48.702955  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 46057.6us
I20260709 13:02:48.703855  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:48.705219  1532 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:02:48.705209  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 68094.3us
I20260709 13:02:48.705714  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:48.712349  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 81533.6us
I20260709 13:02:48.698232   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:48.678951  5604 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.679489  5600 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:48.719729  1610 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:02:48.690014  5608 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.730875  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.721186  1535 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:48.734310  1538 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:48.740450  1613 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:48.696702  5686 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:48.738188  5654 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:02:48.714641  5619 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:48.769186  5619 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:48.769878  5619 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:48.771059  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.741586  5608 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.725554  5658 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.775102  5658 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:48.776780  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:48.778261  5658 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:48.716248  5659 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:48.779474  5659 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.724427  5625 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:48.784380  5625 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:48.785022  5625 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.730196  5604 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.742067  5600 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:48.799085  5604 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.799829  5659 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.799691  5600 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:48.802243  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 71510.7us
I20260709 13:02:48.802739  1610 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:48.803526  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.696367  5624 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:02:48.696036  5597 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:02:48.807916  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:48.732736  5652 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:48.753083  5686 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:48.816064  5693 raft_consensus.cc:2764] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:02:48.816510  5685 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:48.815173  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
W20260709 13:02:48.820324  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 62882.4us
I20260709 13:02:48.828526  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:48.821122  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.821674  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.821902  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.822911  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 752aab0c230943e5a7d35d3d2ff9e555 with delete_type TABLET_DATA_TOMBSTONED (TS f6eecf73c1c24b5eb268b5088a3030d4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:51746
I20260709 13:02:48.825659  1683 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:48.840833  1610 raft_consensus.cc:1240] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:48.847072  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 129532us
I20260709 13:02:48.851622  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:48.856968  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:48.859706  2365 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:48.827812  5685 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:48.885152  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:48.890638  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:48.854451  5674 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.842680  5506 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:48.863510  5621 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:48.859998  5679 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:02:48.919307  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:48.902524  5691 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:48.923130  5671 raft_consensus.cc:2764] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:02:48.925470  5715 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:02:48.934532  5704 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:02:48.917935  5652 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:48.936786  5652 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:48.937147  5652 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:48.937685  5619 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.940099  5654 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:48.942027  5608 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:48.947060  5625 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:48.948732  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 49794.3us
I20260709 13:02:48.925892  5687 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:48.897346  5644 consensus_queue.cc:1059] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:02:48.885200  5685 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:48.949024  5702 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:48.926316  5705 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:02:48.923990  5679 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:48.962713  5679 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:02:48.968412  5714 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:02:48.976513  5721 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:02:48.979282  5625 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:48.984607  5705 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.985256  5705 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.988430  5705 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:48.939802  5619 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:48.990829  5680 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:48.993625  5680 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:49.001360  5686 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.012831  1608 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:49.015426  1607 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
W20260709 13:02:49.016175  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 96976.7us
I20260709 13:02:49.030580  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:48.900672  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:49.036100  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 135567us
I20260709 13:02:49.039656  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.043332  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.033185  5627 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:49.052846  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 239035us
I20260709 13:02:49.055001  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.037855  5687 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.046785  5702 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:49.045691  5671 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:49.045470  5621 raft_consensus.cc:697] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:49.064818  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.054816  5691 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.076452  5608 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:49.061018  5555 consensus_queue.cc:1059] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:02:49.065348  5713 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.094884  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.096184  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:49.076741  5660 raft_consensus.cc:2764] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:02:49.076736  5627 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:49.091852  5608 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:49.103930  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.106328  5297 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:02:49.093295  5685 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:49.129443  5725 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.002s
I20260709 13:02:49.112577  5654 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:49.136294  1541 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:49.102840  5619 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:02:49.137658  5652 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:49.103163  5724 tablet_replica.cc:333] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:02:49.142959  1613 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:49.144491  1534 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:49.102222  5702 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.139214  5621 consensus_queue.cc:237] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.155592  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:49.131053  5713 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:02:49.132161  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.160990  5608 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.177325  5652 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:49.179949  5713 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:49.181021  5713 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.130642  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.188459  5597 raft_consensus.cc:3055] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.188858  5597 raft_consensus.cc:740] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:49.189157  5660 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:49.189668  5597 consensus_queue.cc:260] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:49.191099  5597 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:49.192780  5703 raft_consensus.cc:3055] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:49.193158  5703 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:49.193327  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 62816.2us
I20260709 13:02:49.132083  5679 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:49.189668  5660 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:49.196297  5679 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:49.133128  5686 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:49.095635  5650 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:02:49.106148  5600 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:49.099653  5615 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:02:49.134523  5627 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.113642  5704 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:49.101488  5623 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:49.104285  5644 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:02:49.138891  5685 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:49.139271  5297 consensus_queue.cc:1243] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer e8eefefed88a4903b423e9f487c4805a log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:02:49.141284  1538 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:02:49.193948  5703 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.198144  1535 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 5. Current term is 6. Ops: []
I20260709 13:02:49.203965  1685 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:49.187743  5708 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:49.209362  1608 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:02:49.213387  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.194039  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.224869  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:49.196993  5660 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.220351  5600 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.230038  5720 consensus_queue.cc:1059] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:02:49.232093  1580 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.387s (SENT)
I20260709 13:02:49.234604  1689 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:49.236104  1539 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:49.239068  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:49.228209  1541 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.256181  2370 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:02:49.258018  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 64073.1us
I20260709 13:02:49.271910  2370 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:49.274916  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.275727  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.275909  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.276391  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.277060  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:49.277701  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.277899  1608 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:49.276482  1540 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:02:49.279349  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:49.268410  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.279897  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:49.282642  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.283432  1539 raft_consensus.cc:2368] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13.
I20260709 13:02:49.283499  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.288180  1612 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:49.287706  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:49.289429  1616 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:49.289681  2370 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:49.291654  2370 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:49.231319  5665 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:02:49.293398  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:49.246665  5623 raft_consensus.cc:697] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:49.304841  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:49.305518  1613 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:49.305405  5623 consensus_queue.cc:237] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.308622  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.299305  1614 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:49.304636  5666 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 13:02:49.266255  5600 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.261631  5685 raft_consensus.cc:2764] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:02:49.322526  1541 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:49.278358  1533 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:49.328608  1616 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:02:49.338418  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 75110.9us
I20260709 13:02:49.340492  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:49.340595  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:49.308151  5703 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:49.356114  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:49.362495  1541 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:49.394584  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.399163  2370 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:02:49.376731  5394 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:49.395648  5685 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:49.410104  5523 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:02:49.423777  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:49.402786  5708 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.429209  1538 raft_consensus.cc:2393] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:49.405982  5394 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:49.359427  5710 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:02:49.396649  5620 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:02:49.444105  1536 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:02:49.446285  1580 leader_election.cc:336] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 2.828s (SENT)
I20260709 13:02:49.448081  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.418581  5724 raft_consensus.cc:2243] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:49.416097  5690 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:02:49.427400  5685 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.413741  5674 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:02:49.480396  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.482508  1538 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:49.455354  5708 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:49.497499  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.498258  1538 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
W20260709 13:02:49.500156  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 134961us
I20260709 13:02:49.512934  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:49.530303  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:49.531518  1535 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:49.540266  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:49.540863  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.545444  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.546165  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.546239  1538 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:49.546975  1539 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:49.545229  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.548513  1535 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:49.530411  5724 raft_consensus.cc:2272] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:49.541824  1536 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:49.558032  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.538662  5555 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:02:49.577394  5041 raft_consensus.cc:3055] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:02:49.577913  5041 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:49.578853  5041 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:49.567790  5623 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:02:49.580129  5704 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:49.580763  5704 consensus_queue.cc:1243] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer e8eefefed88a4903b423e9f487c4805a log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:02:49.583205  5665 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:49.595160  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:49.597280  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.538429  5644 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:02:49.588582  5733 log.cc:927] Time spent T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:02:49.615012  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.616163  1536 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:49.544634  5615 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:02:49.619916  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:49.624174  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:49.590303  5041 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:49.629151  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.627000  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.630661  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:49.641212  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:49.642380  1611 raft_consensus.cc:2393] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:49.642500  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:49.642879  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.643364  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:49.643738  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:49.644330  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:49.644371  5674 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.645229  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:49.645624  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:49.647172  5735 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:02:49.648166  5665 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:49.648638  5665 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:49.648970  5739 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:02:49.649017  5665 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:49.653208  5621 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:49.628957  5652 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.654633  5652 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.643970  1580 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.666863  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.667647  1539 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:02:49.668684  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:49.669497  1611 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:49.670130  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.670511  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.671416  1539 raft_consensus.cc:2393] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:49.672366  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.625770  5685 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:49.676661  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:49.674192  5732 log.cc:927] Time spent T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:02:49.683605  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:49.675751  5748 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.004s
I20260709 13:02:49.692121  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:49.669364  5674 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:49.669085  5691 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:49.696949  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 49215.9us
I20260709 13:02:49.675938  5708 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:49.712545  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:49.714165   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:49.682121  5559 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:49.726328  5674 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:49.728493  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:49.686820  5679 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:49.734959  1539 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
W20260709 13:02:49.736457  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 52971.2us
I20260709 13:02:49.737357  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.735230  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:49.751683  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:49.758695  1615 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:49.714936  5686 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:49.774966  1611 pending_rounds.cc:85] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 3
I20260709 13:02:49.775338  1611 pending_rounds.cc:107] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:02:49.775557  1611 raft_consensus.cc:2889] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:49.733285  5559 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:49.802053  1687 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:02:49.802802  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 65516.3us
I20260709 13:02:49.774603  5703 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:49.717690  5691 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:49.768188  5654 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:49.799857  5559 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:49.803778  5597 consensus_meta.cc:287] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.612s	user 0.016s	sys 0.000s
I20260709 13:02:49.767056  5702 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:02:49.833678  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:49.827966  5724 ts_tablet_manager.cc:1916] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:49.828857  5703 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:49.831018  5691 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:49.780323  5686 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:49.761948  5679 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:49.821732  5654 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:49.852718  5728 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:02:49.881353  5654 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:49.913873  5746 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:02:49.915433  5749 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:02:49.914467  5760 log.cc:927] Time spent T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 13:02:49.914958  5761 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:02:49.932734  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 57588us
I20260709 13:02:49.949924  1534 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:50.004261  5764 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:02:50.006919  5762 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:02:49.924386  5703 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.016496  5394 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:50.017144  5747 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:02:49.915771  5679 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:50.106062  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 272460us
W20260709 13:02:50.107167  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 87062.9us
I20260709 13:02:49.913240  5759 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:49.916539  5765 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.127266  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.144977  5394 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.130645  5765 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.168713  5771 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:02:50.174115  5600 consensus_meta.cc:287] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.830s	user 0.012s	sys 0.001s
W20260709 13:02:50.181087  5753 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.287s	user 0.002s	sys 0.001s
I20260709 13:02:50.137949  5759 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:50.201007  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 73829.3us
I20260709 13:02:50.201941  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.175091  5600 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.186676  5765 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:50.243125  5717 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 13:02:50.143574  5297 consensus_queue.cc:1175] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c98c328741aa493d87abafbf08f04944" responder_term: 10 status { last_received { term: 9 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:50.266242  5759 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.275758  5600 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.286500  5686 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.351778  1540 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:50.354466  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 152472us
I20260709 13:02:50.357544  1580 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:50.364058  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.295879  5654 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.375036  5394 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.375667  5654 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:50.376283  5394 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:50.298285  5665 consensus_meta.cc:287] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.649s	user 0.013s	sys 0.001s
I20260709 13:02:50.378554  5665 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.380683  5394 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.381768  5665 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:50.367070  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.390939  5394 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.412662  5770 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:50.416379  5779 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.416644  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:50.426625  5766 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.427296  5766 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.427783  5766 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.433106  5759 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:50.431841  1536 raft_consensus.cc:1240] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:50.440739  1536 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:50.418061  5394 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:50.448518  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:50.451160  1535 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:02:50.452692  5759 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.453744  5759 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.457599  5394 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:50.435330  5779 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.464165  5779 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.431759   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:50.474881  5785 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.476552  5785 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:50.476668  5776 consensus_queue.cc:1059] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.477002  5785 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:50.464478  5759 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.500730  5422 raft_consensus.cc:3055] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:50.501525  5422 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:50.506765  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 2097) took 1231 ms. Trace:
I20260709 13:02:50.508520  1540 rpcz_store.cc:276] 0709 13:02:49.275063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.279119 (+  4056us) service_pool.cc:224] Handling call
0709 13:02:50.506212 (+1227093us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54001fb8d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:50.506519 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2462373760}
I20260709 13:02:50.508019  1532 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:02:50.510958  5674 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.518903  5765 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.529549  5652 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.521028  5785 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.531908  5608 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:50.532538  5608 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:50.532925  5785 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.533739  5608 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:50.530752  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 163985us
I20260709 13:02:50.535669  5608 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:50.511902  5559 consensus_meta.cc:287] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.011s
I20260709 13:02:50.541066  5559 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.542799  1612 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:50.535543  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.549484  5759 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:50.503575  5422 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:50.553256  5422 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:50.557087  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:50.559283  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:50.561942  5506 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.562875  5506 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.547724  5765 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.574880  5770 raft_consensus.cc:3055] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:50.579083  5770 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:50.596593  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 61260.4us
I20260709 13:02:50.597872  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.597584  5770 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.599253  5776 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.599723  5776 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.600121  5776 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.608208  5625 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:50.609395  5625 consensus_queue.cc:1243] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer c98c328741aa493d87abafbf08f04944 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:02:50.579071  5559 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.611460  5708 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.617607  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:50.619896  1684 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:50.620707  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:50.633488  5621 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:02:50.621605  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:50.647758  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:50.608295  5654 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:02:50.654592  5770 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:50.649065  5674 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.678860  5666 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:50.679431  5731 log.cc:927] Time spent T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 1.165s	user 0.006s	sys 0.007s
I20260709 13:02:50.682112  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2286) took 1541 ms. Trace:
I20260709 13:02:50.682639  1609 rpcz_store.cc:276] 0709 13:02:49.140490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.140731 (+   241us) service_pool.cc:224] Handling call
0709 13:02:49.141255 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:49.141698 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:49.141741 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:49.142398 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:02:49.252697 (+110299us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:49.252740 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:49.252826 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.618267 (+1365441us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:50.681467 (+ 63200us) raft_consensus.cc:1685] finished
0709 13:02:50.681498 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.681861 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51467648,"thread_start_us":109878,"threads_started":1,"wal-append.queue_time_us":272738}
I20260709 13:02:50.686683  5775 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.687661  5775 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.660853  5600 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.691080  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:50.675036  5674 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.684018  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.716729  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:50.717758  1611 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
I20260709 13:02:50.720906  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2099) took 1412 ms. Trace:
I20260709 13:02:50.721215  5600 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.656581  5708 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:50.679735  5666 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:50.709290  5765 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.710788  5506 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:50.737011  5757 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.767288  5559 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.773801  5775 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.808763  1540 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:02:50.785008  5600 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.808434  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:50.834896  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 142193us
W20260709 13:02:50.839901  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 156174us
I20260709 13:02:50.792470  5765 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.846549  5758 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.852309  5780 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:50.812458  5685 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:50.863955  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:50.865231  5708 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:50.865728  5803 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.867183  1608 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:02:50.865686  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:50.868978  5741 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.886837  1610 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:50.854262  5757 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.904683  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:50.923987  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:50.947621  1614 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:50.948097  5708 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.838604  5775 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.964164  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:50.969139  1616 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.973820  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:50.977064  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2329) took 1208 ms. Trace:
I20260709 13:02:50.977820  1536 rpcz_store.cc:276] 0709 13:02:49.768402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.449497 (+681095us) service_pool.cc:224] Handling call
0709 13:02:50.451225 (+  1728us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:50.707821 (+256596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.707870 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:50.715266 (+  7396us) log.cc:844] Serialized 52 byte log entry
0709 13:02:50.912749 (+197483us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:02:50.912833 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.912948 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.976620 (+ 63672us) raft_consensus.cc:1685] finished
0709 13:02:50.976656 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.976928 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":273541,"raft.queue_time_us":252248,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":30498,"thread_start_us":196927,"threads_started":1,"wal-append.queue_time_us":257450}
I20260709 13:02:50.980207  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.981777  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.982007  5785 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:50.982386  5785 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.982801  5785 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:50.983330  1580 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:50.984359  5775 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.986657  5775 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:50.987298  5775 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:50.987664  5775 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:50.988101  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.988415  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:50.989231  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 225099us
I20260709 13:02:50.989157  5600 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:50.990392  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:50.991334  5600 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:50.996439  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 90508.4us
I20260709 13:02:50.992023  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:50.995782  5779 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.530s	user 0.015s	sys 0.003s
I20260709 13:02:50.949219  5708 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.987996  5775 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:50.913617  5776 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.024379  5810 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:02:50.922379  5658 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260709 13:02:51.030946  5804 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:02:51.033363  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 50129.2us
I20260709 13:02:51.035948  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.016371  5802 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.027021  5779 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.039116  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:51.039237  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44068.4us
I20260709 13:02:51.048918  1611 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:02:51.041472  5798 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.301s	user 0.002s	sys 0.000s
I20260709 13:02:51.052733  1610 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:51.002542  5741 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.970019  5803 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.001024  5758 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.065773  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.022655  5685 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:51.070581  5600 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:51.091710  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.091535  5770 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:51.092540  5770 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:51.094843  1615 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:51.095005  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.095160  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.096159  1613 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:51.096715  5600 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.097747  5770 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:51.099061  5724 ts_tablet_manager.cc:1929] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:02:51.099476  5600 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.099848  5724 log.cc:1199] T 752aab0c230943e5a7d35d3d2ff9e555 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/wals/752aab0c230943e5a7d35d3d2ff9e555
I20260709 13:02:51.101483  5724 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51746 (request call id 0) took 2416 ms. Trace:
I20260709 13:02:51.101887  5685 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:51.102206  5765 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.102540  1532 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:02:51.106237  5814 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:51.106774  5814 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.107199  5814 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.110934  5803 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.113467  5758 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:51.113821  5808 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:02:51.070991  5804 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.115511  1533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2327) took 1349 ms. Trace:
I20260709 13:02:51.115979  1533 rpcz_store.cc:276] 0709 13:02:49.766395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.446458 (+680063us) service_pool.cc:224] Handling call
0709 13:02:50.447080 (+   622us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.745622 (+298542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.745656 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.746283 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:02:50.774530 (+ 28247us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:50.774587 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.774976 (+   389us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.115058 (+340082us) raft_consensus.cc:1685] finished
0709 13:02:51.115104 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.115283 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":291656,"raft.queue_time_us":300240,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"thread_start_us":27730,"threads_started":1,"wal-append.queue_time_us":247552}
I20260709 13:02:51.120609  1580 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:51.121927  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54452.8us
I20260709 13:02:51.126890  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:51.089279  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.129194  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2331) took 1352 ms. Trace:
I20260709 13:02:51.170663  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2311) took 1501 ms. Trace:
W20260709 13:02:51.202210  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 205746us
W20260709 13:02:51.207504  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 90002.2us
I20260709 13:02:51.110980  5779 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.218847  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.071144  5802 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.221304  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.221345  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:51.221570  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 182609us
I20260709 13:02:51.190167  1541 rpcz_store.cc:276] 0709 13:02:49.627519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.713748 (+ 86229us) service_pool.cc:224] Handling call
0709 13:02:49.714065 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:50.749728 (+1035663us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:02:50.800723 (+ 50995us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.000450 (+199727us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.000737 (+   287us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:51.024096 (+ 23359us) log.cc:844] Serialized 52 byte log entry
0709 13:02:51.025260 (+  1164us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:51.025307 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.038399 (+ 13092us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.126840 (+ 88441us) raft_consensus.cc:1685] finished
0709 13:02:51.126865 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.128668 (+  1803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":910449,"prepare.queue_time_us":20158,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":88,"raft.queue_time_us":966279,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":27588,"thread_start_us":160803,"threads_started":2,"wal-append.queue_time_us":226218}
I20260709 13:02:51.204798  5666 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.129825  1535 rpcz_store.cc:276] 0709 13:02:49.776588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.461216 (+684628us) service_pool.cc:224] Handling call
0709 13:02:50.461854 (+   638us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:50.722945 (+261091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.722975 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:50.738696 (+ 15721us) log.cc:844] Serialized 52 byte log entry
0709 13:02:50.965246 (+226550us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:50.968610 (+  3364us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.969167 (+   557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.969279 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.127170 (+157891us) raft_consensus.cc:1685] finished
0709 13:02:51.127202 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.129109 (+  1907us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250203,"prepare.queue_time_us":2234,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":284523,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":278,"thread_start_us":162331,"threads_started":1,"wal-append.queue_time_us":331238}
I20260709 13:02:51.243024  1683 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:51.213958  5765 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:51.241403  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:51.244354  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:51.247512  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2318) took 1483 ms. Trace:
I20260709 13:02:51.248476  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:51.249454  1612 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2308) took 1455 ms. Trace:
I20260709 13:02:51.225409  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:51.219033  5770 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.258952  1534 rpcz_store.cc:276] 0709 13:02:49.763595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.125761 (+362166us) service_pool.cc:224] Handling call
0709 13:02:50.128744 (+  2983us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:50.921611 (+792867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.947315 (+ 25704us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:50.948145 (+   830us) log.cc:844] Serialized 52 byte log entry
0709 13:02:51.063504 (+115359us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:51.063546 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.072395 (+  8849us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.247134 (+174739us) raft_consensus.cc:1685] finished
0709 13:02:51.247153 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.247341 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":501206,"raft.queue_time_us":549310,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":225,"thread_start_us":274137,"threads_started":2,"wal-append.queue_time_us":296720}
I20260709 13:02:51.229635  5804 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.259145  1612 rpcz_store.cc:276] 0709 13:02:49.794132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.799183 (+  5051us) service_pool.cc:224] Handling call
0709 13:02:49.799594 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:50.543284 (+743690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.249154 (+705870us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54002acbd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:51.249383 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708382592}
W20260709 13:02:51.276825  5798 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:02:51.298133  5779 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.298214  5559 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:51.299793  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:51.311443  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:51.312218  5656 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:51.315651  5674 consensus_meta.cc:287] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.005s
I20260709 13:02:51.317651  5802 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.320204  5804 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:51.328470  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 109394us
I20260709 13:02:51.346195  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2313) took 1696 ms. Trace:
I20260709 13:02:51.302860  5757 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.326782  5656 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.289443  5785 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:50.721450  1537 rpcz_store.cc:276] 0709 13:02:49.308500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.310143 (+  1643us) service_pool.cc:224] Handling call
0709 13:02:49.323357 (+ 13214us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:49.324021 (+   664us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:49.528929 (+204908us) log.cc:844] Serialized 14 byte log entry
0709 13:02:49.687408 (+158479us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:49.701748 (+ 14340us) log.cc:844] Serialized 52 byte log entry
0709 13:02:49.701969 (+   221us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:49.702242 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.498416 (+796174us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b18003d1260. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b3f3 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:02:50.611762 (+113346us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b18003d1260. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287 00007fd02eb23208
0709 13:02:50.634657 (+ 22895us) log.cc:844] Serialized 14 byte log entry
0709 13:02:50.720244 (+ 85587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:50.720375 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:50.720425 (+    50us) raft_consensus.cc:1685] finished
0709 13:02:50.720443 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:50.720664 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1037438,"prepare.queue_time_us":253629,"prepare.run_cpu_time_us":178,"prepare.run_wall_time_us":3256,"raft.queue_time_us":1042908,"raft.run_cpu_time_us":690,"raft.run_wall_time_us":17513,"spinlock_wait_cycles":27161600,"thread_start_us":272012,"threads_started":2,"wal-append.queue_time_us":184533}
I20260709 13:02:51.299389  5779 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.299424  5559 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:51.101902  5724 rpcz_store.cc:276] 0709 13:02:48.724166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:48.822559 (+ 98393us) service_pool.cc:224] Handling call
0709 13:02:49.076676 (+254117us) ts_tablet_manager.cc:1151] Deleting tablet 752aab0c230943e5a7d35d3d2ff9e555
0709 13:02:49.093741 (+ 17065us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:02:50.606785 (+1513044us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:51.098793 (+492008us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:51.101353 (+  2560us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89093,"tablet-delete.queue_time_us":218789,"thread_start_us":173536,"threads_started":1}
I20260709 13:02:51.351855  5804 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.372823  1681 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:51.407887  1683 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: []
W20260709 13:02:51.376758  5813 log.cc:927] Time spent T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:02:51.391669  5719 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.388382  5757 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:51.391778  5741 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:51.396842  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 113930us
I20260709 13:02:51.355319  5758 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:02:51.346848  1539 rpcz_store.cc:276] 0709 13:02:49.628557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:49.749319 (+120762us) service_pool.cc:224] Handling call
0709 13:02:49.781510 (+ 32191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.710101 (+928591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.713286 (+  3185us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:50.835769 (+122483us) log.cc:844] Serialized 26 byte log entry
0709 13:02:51.054783 (+219014us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:51.054831 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.070410 (+ 15579us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.323946 (+253536us) raft_consensus.cc:1685] finished
0709 13:02:51.323981 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.324243 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":861067,"raft.queue_time_us":898936,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":191,"thread_start_us":119185,"threads_started":2,"wal-append.queue_time_us":296385}
I20260709 13:02:51.348358  5674 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.369954  5656 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.366231  5776 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.412079  1614 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:51.415863  1616 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:51.418521  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:51.430490  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 206251us
I20260709 13:02:51.440215  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:51.435696  5759 consensus_meta.cc:287] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.881s	user 0.015s	sys 0.001s
I20260709 13:02:51.445273  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:51.435961  5766 consensus_meta.cc:287] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 1.003s	user 0.016s	sys 0.006s
I20260709 13:02:51.486481  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.486156  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.485532  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.489130  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.490155  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:51.485275  5759 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:51.493119  5759 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.493855  5759 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.499037  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.499368  5775 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.501662  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.501778  5814 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.502398  1686 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:02:51.504266  5703 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:51.505117  1534 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:51.505796  5770 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:51.506085  1540 pending_rounds.cc:85] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 6
I20260709 13:02:51.427227  5719 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:51.504878  5703 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:51.506517  1540 pending_rounds.cc:107] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:02:51.517069  1540 raft_consensus.cc:2889] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:51.519187  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.521195  5758 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:51.522171  5758 consensus_queue.cc:1243] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:02:51.522699  5758 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:51.523015  5758 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:51.484629  5776 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.488994  5766 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.524624  5776 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.526639  5766 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.527410  5766 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:51.527797  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 89774.7us
I20260709 13:02:51.528663  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:51.529425  5719 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:51.529552  5802 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.530395  5802 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:02:51.532442  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.534008  5804 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:51.526603  5776 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.536906  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.506529  5770 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:51.557283  5759 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.558140  5776 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:51.480753  5757 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.574461  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2319) took 1804 ms. Trace:
I20260709 13:02:51.576388  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.575063  1538 rpcz_store.cc:276] 0709 13:02:49.763964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.182843 (+418879us) service_pool.cc:224] Handling call
0709 13:02:50.183227 (+   384us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:50.701265 (+518038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.707378 (+  6113us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:50.792938 (+ 85560us) log.cc:844] Serialized 52 byte log entry
0709 13:02:51.042887 (+249949us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:02:51.059827 (+ 16940us) log.cc:844] Serialized 14 byte log entry
0709 13:02:51.062741 (+  2914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.069352 (+  6611us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.567926 (+498574us) raft_consensus.cc:1685] finished
0709 13:02:51.567950 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.568201 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":435276,"prepare.queue_time_us":16361,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":497311,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":5056,"thread_start_us":262229,"threads_started":2,"wal-append.queue_time_us":269099}
I20260709 13:02:51.576620  5703 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:51.527921  5766 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:51.582741  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 77806.2us
I20260709 13:02:51.523975  5758 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.598709  5041 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.599208  5831 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.599485  5041 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:51.599749  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.600270  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.600471  5802 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.601013  1536 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:51.601054  5802 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.601701  5041 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:51.599767  5831 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.604290  5600 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:51.604887  5831 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.605077  5600 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:51.605573  5831 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:51.605949  5797 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 1.023s	user 0.003s	sys 0.003s
I20260709 13:02:51.596920  5804 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:51.606433  5831 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.607352  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.607556  5804 raft_consensus.cc:3055] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:51.607913  5804 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:51.608058  1538 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:51.600298  5685 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.609045  5804 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.609529  5831 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.609757  5685 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.612450  5803 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:51.612494  5831 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.613535  5831 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.614526  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:51.615175  2362 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:51.617656  5766 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.618192  5814 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.618645  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.619252  5775 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.620369  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.621028  1539 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:51.618259  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.620916  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.606843  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:51.623661  5758 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.624477  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.625082  1539 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.625737  5559 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:51.628777  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.629225  5757 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.629341  5708 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.632682  5685 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.633384  5802 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.629448  1538 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:51.637333  5835 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:02:51.639449  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.640326  1608 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:51.637893  1536 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.647483  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.602144  5809 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.649305  5809 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.649639  1437 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.652410  1534 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:51.656451  5757 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.657200  5757 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.657691  5708 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.658432  5708 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.660585  5559 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.661170  5559 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.661682  5765 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:51.662339  5803 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.663189  5559 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.662921  5803 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.665810  5770 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:51.668532  1611 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:51.670047  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.672078  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:51.672514  5802 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.673302  5802 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.673552  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.674302  1609 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:02:51.675807  5674 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.676436  1609 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:51.677664  5779 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.678067  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.678722  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34908 (request call id 716) took 1087 ms. Trace:
I20260709 13:02:51.679669  1532 rpcz_store.cc:276] 0709 13:02:50.591383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.663192 (+ 71809us) service_pool.cc:224] Handling call
0709 13:02:51.678539 (+1015347us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54001e8554. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:51.678639 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929626368}
I20260709 13:02:51.686309  1539 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:51.687517  1541 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:51.687671  1536 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:51.678687  5802 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.678743  1609 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:51.699187  1579 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:51.707877  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.680871  5809 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.675859  5708 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.708571  1611 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:51.704197  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.709906  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.713234  1608 raft_consensus.cc:2393] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:51.721907  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 170154us
I20260709 13:02:51.723282  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:51.718915  5817 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.236s	user 0.001s	sys 0.002s
I20260709 13:02:51.721149  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.725571  1613 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:51.721231  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.725561  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.728134  1614 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:51.727993  1538 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:02:51.719048  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.731339  1615 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:51.734951  1609 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:51.754276  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.754976  1532 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:51.712280  5831 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.756575  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.761251  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.761861  1611 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:51.759461  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.760398  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.766722  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.769217  1612 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:51.773031  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.775904  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.773522  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.777648  1533 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.780283  1537 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:51.780555  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.780341  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:51.788350  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.792726  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:51.793776  5703 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:51.794116  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.795264  2328 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.795768  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:51.796310  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 108631us
I20260709 13:02:51.797088  5665 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:51.796867  5625 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:51.798753  5625 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:51.799352  5625 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:51.799659  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.800213  5741 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:51.800592  5741 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:51.800941  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.801625  1535 raft_consensus.cc:2393] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:51.801497  5741 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.801242  5625 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.802398  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.802829  5741 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.803463  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.796933  5737 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:51.804438  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:51.805231  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:51.806452  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.807615  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.808629  1608 raft_consensus.cc:2410] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:51.812196  5831 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.812317  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.812814  5831 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.815521  5831 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.817373  5757 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.819252  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.820588  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.821532  5834 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:51.821969  5834 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:51.822358  5834 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:51.825349  1616 raft_consensus.cc:2410] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:02:51.774899  5506 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:02:51.838192  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.838604  1539 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.839840  1533 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:51.841002  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.843850  1687 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:51.841002  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.841694  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:51.841910  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.842443  1534 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:51.842373  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.849269  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.851598  1505 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:51.850075  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 55403.1us
I20260709 13:02:51.858170  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.862744  5840 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:51.864524  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2317) took 1066 ms. Trace:
W20260709 13:02:51.865856  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.865020  1607 rpcz_store.cc:276] 0709 13:02:50.798615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:50.798838 (+   223us) service_pool.cc:224] Handling call
0709 13:02:50.825212 (+ 26374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:50.915792 (+ 90580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:50.915840 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:51.008878 (+ 93038us) log.cc:844] Serialized 26 byte log entry
0709 13:02:51.195021 (+186143us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:51.195370 (+   349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:51.195566 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:51.718039 (+522473us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:51.852112 (+134073us) raft_consensus.cc:1685] finished
0709 13:02:51.852132 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:51.864289 (+ 12157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59393,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":44802,"spinlock_wait_cycles":18918272,"thread_start_us":157192,"threads_started":1,"wal-append.queue_time_us":346184}
W20260709 13:02:51.866429  5810 consensus_meta.cc:287] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.817s	user 0.014s	sys 0.000s
I20260709 13:02:51.866914  5810 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:51.869486  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.869567  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.870111  5833 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.871739  1689 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:02:51.871816  5833 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.875075  1537 raft_consensus.cc:2410] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:51.876353  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.795285  5703 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:02:51.884814  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.886024  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.886854  5831 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:51.887229  5831 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.887568  5831 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:51.889611  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.890440  1609 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
I20260709 13:02:51.893632  2329 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:51.870870  5757 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:02:51.899360  5780 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:51.899411  5625 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.899845  5658 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:51.901597  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.877974  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:51.905601  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.907495  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:51.909593  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:51.895565  5831 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:51.911223  5741 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:51.914829  5831 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.920591  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:51.922138  5810 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:51.922763  5810 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.923170  5810 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:51.899897  5780 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.925088  5780 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:51.927755  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:51.928890  1689 raft_consensus.cc:606] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:51.929790  5833 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.932430  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:51.932869  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.934556  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.935415  5809 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:51.935811  5758 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:51.936280  5758 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:51.936776  5758 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:51.929960  5757 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.927971  1535 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
I20260709 13:02:51.941624  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:51.836333  5656 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:51.959583  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:51.943127  5809 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:51.945708  5621 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:51.965303  5621 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:51.960493  5741 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:51.965022  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:51.950852  5832 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:02:51.959355  1539 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:51.910588  1534 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 6.
W20260709 13:02:51.961809  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 75856.8us
W20260709 13:02:51.956696  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 49299.2us
I20260709 13:02:51.964453  5506 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:51.964831  2370 raft_consensus.cc:2368] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:51.948989  5803 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.960227  5685 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:51.966804  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:51.949739  5802 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:51.970683  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.994629  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:51.996392  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.985913  5656 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:51.996450  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:51.991566  5765 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:52.021986  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.992012  5803 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:52.013911  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:52.000735  1579 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:52.013502  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:52.035964  1610 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:51.969086  5621 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.033092  5654 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:52.031812  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:51.988149  5685 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:52.017428  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 415740us
I20260709 13:02:52.043226  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:52.013949  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:51.998454  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.005672  5708 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.039726  1532 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:52.042106  1534 raft_consensus.cc:3060] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.043916  1683 raft_consensus.cc:606] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
W20260709 13:02:52.042049  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45709us
I20260709 13:02:51.996295  5833 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.059423  1613 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:51.641633  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 752aab0c230943e5a7d35d3d2ff9e555 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:02:52.000802  5785 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:51.964078  5810 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:52.048949  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 50600.7us
I20260709 13:02:52.064726  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.044345  1535 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:52.050704  5828 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.051568  5621 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.052583  5728 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.054628  5845 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.056353  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.056795  5840 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.050103  5708 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.970747  5757 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.037142  5803 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.049347  5685 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.038930  5765 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.088208  5803 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:52.088469  5765 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.089648  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.090847  1616 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:52.058337  1684 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:02:52.092186  1616 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:52.066671  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.043960  5779 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:52.096184  5779 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.096606  5779 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.098277  5757 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.095777  5765 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.067034  1615 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:02:52.101343  1615 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.087646  5708 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.103474  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:52.073190  1614 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:52.103978  5765 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.106981  5685 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:52.073782  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:52.073606  1423 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 432157us
I20260709 13:02:52.109989  5685 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.113248  5843 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:52.113896  5843 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:52.115052  5843 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:52.066195  1654 connection.cc:256] RPC call timeout handler was delayed by -1.1489304909999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 13:02:52.075598  5600 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:52.056833  5741 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.066545  5828 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.079712  1613 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:52.118259  5828 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.060707  5809 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:52.120289  5809 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:02:52.120904  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0436304909999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20600000000000002s for a response
W20260709 13:02:52.121325  1654 connection.cc:256] RPC call timeout handler was delayed by -1.0427304909999862s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
W20260709 13:02:52.121912  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:51.997083  5802 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.123101  5708 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.123862  5802 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.121331  5809 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.082337  5804 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:52.126327  5708 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.126330  1613 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:52.082481  5810 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.084717  1609 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:52.131250  5779 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.086189  1608 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:52.086709  5844 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.087667  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:52.095768  5803 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.099922  1612 raft_consensus.cc:2393] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:52.117637  5785 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:52.069657  5831 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:52.127197  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:52.000892  5506 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:52.074898  1611 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.104184  1689 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.137338  1613 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.146071  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:52.117992  5843 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:52.150254  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 84056.8us
I20260709 13:02:52.152293  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.070106  5728 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.154474  5810 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:52.135020  5845 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:52.157490  1437 catalog_manager.cc:5697] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.159168  1437 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:52.160437  5831 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:52.161465  5831 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.163054  1437 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 6 to 7, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.165050  1437 catalog_manager.cc:5697] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 10, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:02:52.166482  5810 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:52.166435  1437 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 4 to 7, term changed from 7 to 9, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.155303  5785 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:52.168584  5506 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.167725  5810 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.170295  5785 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:52.168804  1437 catalog_manager.cc:5697] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.179569  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.181723  5839 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.145085  5844 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.185637  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:52.187094  5844 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.187723  5758 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.189962  5758 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.159813  5845 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:52.194743  1580 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.173537  5728 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.202298  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:52.206784  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.206269  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.191910  5765 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.225150  2365 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:02:52.201155  5785 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:02:52.236932  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 90966.3us
I20260709 13:02:52.205775  5845 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.220191  5833 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.213934  5803 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.190989  5834 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:52.250370  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 206632us
I20260709 13:02:52.193624  5780 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:52.226073  5758 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.251925  1437 catalog_manager.cc:5697] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 4 to 6, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 6 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:52.283885  5844 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.304991  1504 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:52.246133  5765 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:52.313521  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:52.226553  5828 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.321171  2365 raft_consensus.cc:606] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:52.291350  5785 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:52.321797  2365 raft_consensus.cc:614] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:02:52.283491  5802 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.294958  5757 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.305698  5840 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.319207  5708 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:52.294911  5845 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.324294  5685 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:52.317008  5758 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.352502  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:52.353461  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.359925  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.360577  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:52.361403  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.338517  5665 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.364920  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.365403  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.366170  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.372730  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:52.368417  1685 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:52.380686  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:52.381274  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.382264  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.324503  5844 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.347409  5840 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.373128  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.384882  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.385973  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.349556  5685 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.392588  1688 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:02:52.396445  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 100219us
I20260709 13:02:52.335143  5802 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:52.399168  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 192969us
I20260709 13:02:52.402228  1534 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:02:52.362967  5779 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.407387  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:52.348692  5757 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.412853  1689 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:52.413362  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.415164  2329 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:52.416145  5707 raft_consensus.cc:2804] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:52.420589  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.400696  5685 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.432102  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:52.432853  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 63839.3us
I20260709 13:02:52.437532  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:52.410648  5847 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:52.446875  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.449755  1504 leader_election.cc:400] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:52.450172  1504 leader_election.cc:403] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:52.430877  5833 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:52.481776  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.486102  1535 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [6.5-9.7]
I20260709 13:02:52.485215  1532 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:02:52.485169  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:52.489431  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.434657  5707 raft_consensus.cc:697] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
W20260709 13:02:52.492404  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 72582.3us
I20260709 13:02:52.452252  5810 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:52.498028  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.497850  1539 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:02:52.479916  5803 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:52.503042  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:52.503157  5707 consensus_queue.cc:237] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:52.504354  1535 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:52.420706  5785 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.486377  5779 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.509994  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:52.499617  1539 pending_rounds.cc:85] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 5
I20260709 13:02:52.525585  1539 pending_rounds.cc:107] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:02:52.525979  1539 raft_consensus.cc:2889] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:52.506124  1610 raft_consensus.cc:2468] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:02:52.509083  1538 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:02:52.510278  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:52.513398  5844 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.499449  5834 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:52.515872  1535 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:52.539875  5839 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:52.542145  5839 consensus_queue.cc:1059] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:52.542714  5857 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:02:52.544062  5608 raft_consensus.cc:993] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:52.516263  5810 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.521042  5658 consensus_queue.cc:1059] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:52.521925  5703 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:52.522686  5833 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:52.524926  1534 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:02:52.490626  5809 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.498507  5780 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:52.551028  2367 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:52.552977  1540 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:52.534166  1541 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:52.525264  5779 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.549230  5625 raft_consensus.cc:1081] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:52.564419  1579 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:52.545835  5828 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.549012  5608 raft_consensus.cc:3055] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:02:52.570940  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 73010us
I20260709 13:02:52.567268  5779 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.565815  5833 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:52.569897  5840 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.569882  5608 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:52.556170  5810 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:52.591336  5855 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:02:52.591490  5810 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.592170  5802 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.595201  5757 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:52.596403  5865 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
I20260709 13:02:52.585088  5765 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:52.598083  5708 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.598429  5708 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.588640  5845 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.578279  5828 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:52.580951  5758 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:52.618054  5728 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:52.619877  2370 raft_consensus.cc:2368] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:52.584396  5658 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:52.620433  5658 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:52.622686  5658 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:52.625649  5828 raft_consensus.cc:697] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:52.629071  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.629338  5728 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:52.634140  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.637398  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:52.633358  5621 consensus_meta.cc:287] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.560s	user 0.004s	sys 0.008s
I20260709 13:02:52.643491  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.633652  5834 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.646028  5867 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:52.645215  1580 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.648736  5867 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:52.649149  5867 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.649636  5867 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.650936  1687 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:52.654543  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:52.657456  5856 log.cc:927] Time spent T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 13:02:52.663038  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:52.663594  1541 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:52.664407  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:52.664942  1609 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:52.646611  5810 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:52.669806  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:52.670825  1534 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.670975  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:52.671690  1610 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:02:52.672370  5833 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.674041  1609 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:02:52.641856  5858 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.676797  5858 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:52.677281  5858 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.677686  5858 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:52.680730  5608 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.682435  5608 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:52.688418  2362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:43384
W20260709 13:02:52.688426  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 74392.1us
I20260709 13:02:52.690914  2362 raft_consensus.cc:606] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:52.691951  2362 raft_consensus.cc:630] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Rejecting request to transfer leadership because tablet server c98c328741aa493d87abafbf08f04944 is not a voter in the active config
I20260709 13:02:52.693428  5869 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:02:52.693785  5860 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:02:52.695603  1541 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
W20260709 13:02:52.693789  5850 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.177s	user 0.000s	sys 0.003s
I20260709 13:02:52.697561  1534 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:02:52.701610  5869 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:52.702724  5869 consensus_queue.cc:1059] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:52.703367  5828 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:52.704586  5869 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:52.703871  5621 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:52.705433  5869 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:52.706844  5869 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.709021  5869 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.714323  5859 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:52.715265  5741 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:52.717461  5741 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:02:52.719333  5827 raft_consensus.cc:3055] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:02:52.719560  5741 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:52.719862  5827 raft_consensus.cc:740] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:52.722338  5868 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.132s	user 0.000s	sys 0.002s
I20260709 13:02:52.722435  5621 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:52.722257  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.762280  1684 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:52.723522  1534 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:02:52.736511  1609 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:52.737689  1535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
W20260709 13:02:52.738207  5852 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.216s	user 0.000s	sys 0.002s
W20260709 13:02:52.739543  5849 log.cc:927] Time spent T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
W20260709 13:02:52.741096  5854 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:02:52.739585  1613 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.775180  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:52.742671  1615 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:52.742591  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:52.745083  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:52.747241  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.748728  1607 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:52.750170  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:52.751027  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 47339.9us
I20260709 13:02:52.751737  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.751959  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.777345  1686 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
W20260709 13:02:52.777948  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 123517us
I20260709 13:02:52.753538  1536 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:52.695029  1610 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
W20260709 13:02:52.744566  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:52.758235  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.779230  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:52.653997  5804 consensus_meta.cc:287] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.000s
I20260709 13:02:52.783006  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.763532  1535 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:52.784191  1535 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:52.763568  2329 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:52.765945  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.721194  5827 consensus_queue.cc:260] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.775725  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:52.752537  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:52.794884  1681 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:52.789283  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:52.790297  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.792565  1579 leader_election.cc:400] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:52.799103  1579 leader_election.cc:403] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:52.793450  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:52.802167  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.804529  1533 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:02:52.804967  1533 pending_rounds.cc:85] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 5
I20260709 13:02:52.805191  1533 pending_rounds.cc:107] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:02:52.805410  1533 raft_consensus.cc:2889] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:52.809576  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.761742  5741 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:52.822504  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.810925  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:52.815477  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:52.813020  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:52.817013  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.825300  1610 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:52.825827  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:52.826551  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.829792  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:52.830472  1534 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.795557  5869 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:02:52.832262  5523 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:02:52.832834  5523 raft_consensus.cc:697] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:52.833142  5859 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:52.833702  5869 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:52.833829  5523 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:52.835546  5869 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:52.810810  1653 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5853661a3b2948fbb9b9483e9e4176a3. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:52.836331  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 70491.8us
I20260709 13:02:52.836862  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:52.840467  1537 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:52.821337  1504 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:52.818490  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.845603  1607 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:52.841702  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.849016  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:52.848902  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:52.852177  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:52.852838  1611 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:52.795882  5765 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:52.878821  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:52.858749  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.860611  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:52.880201  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58957.1us
I20260709 13:02:52.877770  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.883798  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.835961  5869 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.886309  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.889088  5802 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.857657  5834 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:02:52.893540  5802 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:52.894232  1504 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:52.894465  5741 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.895720  5741 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:52.896237  5840 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.896687  5840 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:52.897037  5840 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.824186  5810 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:52.908677  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:02:52.903424  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.846118  5846 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.904757  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.857826  5804 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:52.887693  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.821465  5625 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:02:52.909360  1690 raft_consensus.cc:606] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:02:52.891562  5845 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:52.914686  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:52.885900  5757 raft_consensus.cc:2764] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:52.900213  5869 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:52.941416  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 53943.6us
I20260709 13:02:52.913322  5846 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:52.889413  5719 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:52.820701  5506 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
W20260709 13:02:52.949728  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 125053us
I20260709 13:02:52.907095  5827 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:52.907732  5765 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:52.972808  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:52.943493  1534 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:52.903688  5621 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:52.953715  5845 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:52.957877  5802 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.990607  5809 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:52.989324  5844 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:52.988970  5846 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:52.992760  5758 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:53.000000  5880 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:53.058547  5870 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:02:53.021555  5802 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.006140  5845 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.068682  5802 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.007947  5757 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.021894  5600 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:53.051148  5685 consensus_meta.cc:287] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.000s
I20260709 13:02:53.006889  5719 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:53.040148  5621 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.076004  1681 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:02:53.076123  1611 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:53.081683  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.083338  5765 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.083798  5685 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.086337  5685 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.087541  5719 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:53.089038  5875 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:02:53.051003  5803 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:53.089931  5803 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.081817  1579 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:53.129830  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 157218us
I20260709 13:02:53.137080  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.064848  5867 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.142108  5879 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.143s
I20260709 13:02:53.142459  5831 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:53.051247  5880 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:53.155833  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:53.098052  1535 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.161006  1687 raft_consensus.cc:2368] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:02:53.046262  5844 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:53.166330  1535 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.151211  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.046064  5810 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.153386  5685 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:53.204607  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:53.259300  1681 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:53.259771  1681 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:53.201128  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50037.9us
I20260709 13:02:53.261157  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.242100  5757 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:53.281041  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:53.288146  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 294005us
W20260709 13:02:53.287523  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 404230us
I20260709 13:02:53.243906  5802 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.283097  1681 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.316069  1607 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:53.318336  1613 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:02:53.318606  1681 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.196019  5858 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.275207  5828 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.311376  5708 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.005s
W20260709 13:02:53.325925  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 45007.3us
I20260709 13:02:53.332557  1681 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:53.333432  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.294064  5888 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.334620  5888 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:53.335386  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:53.322674  5779 consensus_meta.cc:287] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 13:02:53.321776  5831 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:53.343637  1614 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:53.368769  1505 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.385545  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.386804  5888 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:53.387620  5887 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:02:53.388402  5523 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:53.392235  5894 consensus_queue.cc:1059] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:02:53.337918  5654 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:02:53.401237  5844 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:53.404801  5886 log.cc:927] Time spent T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:02:53.409386  5741 consensus_meta.cc:287] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
I20260709 13:02:53.333005  5658 consensus_queue.cc:1059] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:02:53.413064  5882 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:02:53.413744  1504 leader_election.cc:400] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:02:53.429488  1504 leader_election.cc:403] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:02:53.429387  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 43922.6us
I20260709 13:02:53.430542  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.326470  5802 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.426098  5844 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:53.337625  5708 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:53.412961  5883 log.cc:927] Time spent T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:02:53.336241  5828 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.370947  5685 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.427809  5869 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.365206  5803 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.430634  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:53.432080  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.433926  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.449486  5802 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.431720  5758 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.450121  5802 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:53.450377  1505 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.451478  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.452473  5844 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:53.453974  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.450627  5802 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.454815  1689 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:53.436110   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:53.437750  5900 ts_tablet_manager.cc:933] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.458474  5685 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:53.342835  5779 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.429764  5765 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.432703  5804 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:53.449415  5803 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:53.426405  5831 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.442237  1687 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:02:53.462779  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 123464us
I20260709 13:02:53.476923  5803 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:53.489241  5844 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:53.493324  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:53.494403  1608 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:53.461010  5685 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:53.494313  2365 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
W20260709 13:02:53.496098  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44712.1us
I20260709 13:02:53.496126  1533 raft_consensus.cc:1275] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:02:53.494055  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 128278us
W20260709 13:02:53.507615  5840 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.002s
I20260709 13:02:53.482362  5765 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.509359  5892 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.510320  5765 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.510053  5892 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.511881  5600 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:53.512393  1682 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:53.513993  5708 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.514146  5802 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.461512  5845 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:53.512513  5608 consensus_meta.cc:287] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.830s	user 0.013s	sys 0.003s
I20260709 13:02:53.518090  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:53.519218  1504 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:53.519562  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:53.519933  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:53.525691  1535 raft_consensus.cc:2393] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:53.520162  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:53.526448  1541 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:53.533766  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.535385  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:53.536484  1533 raft_consensus.cc:2368] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:53.538403  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:53.541807  1532 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:53.512446  5600 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:53.530380  5703 consensus_queue.cc:1059] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:02:53.552397  5909 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.552671  5328 consensus_queue.cc:1048] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:02:53.563675  1533 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:53.572145  5896 raft_consensus.cc:3055] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:53.575423  5839 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:53.576026  5839 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:53.558053  5802 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:53.553221  5909 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.572638  5703 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:53.573055  5896 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:53.541260  5888 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:53.586068  5909 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.594416  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.587430  5845 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.588230  5685 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.555285  5880 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.616070  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:53.553481  5741 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:02:53.590263  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.590480  5844 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.590806  5828 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.572350  5892 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:53.590950  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:53.577229  5839 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.598769  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:53.598933  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.599677  5858 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.601650  1683 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:53.651144  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:53.607414  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:53.629951  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:53.656668  1613 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:53.607897  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:53.609028  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:53.658070  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49155.9us
I20260709 13:02:53.658257  1535 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.658874  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.660423  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.526983  5840 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.611209  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:53.662221  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:53.662930  1533 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:53.620182  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:53.620488  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:53.620532  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:53.623708  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:53.652412  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:53.654352  1681 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:53.654465  1687 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:53.606245  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:53.658242  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:53.615011  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:53.541541  5608 consensus_queue.cc:1059] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:02:53.677850  1541 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:02:53.679834  1539 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:53.662253  1538 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:02:53.620082  5785 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:53.694761  5869 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:53.694568  5785 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:53.628554  5779 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.680536  1608 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
W20260709 13:02:53.663532  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57656.6us
I20260709 13:02:53.683861  1532 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:53.677979  5828 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:53.688408  5872 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:53.690749  5758 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:02:53.628650  5834 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:53.652762  5880 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:53.692294  5900 tablet_copy_client.cc:323] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:02:53.693073  5896 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.557343  5803 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.683599  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.651747  5757 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.706524  1535 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:53.712698   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:53.725433  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:53.662240  5845 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:53.725230  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 343885us
I20260709 13:02:53.678413  5899 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:53.727728  2365 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:02:53.755147  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:53.684207  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.640s (SENT) [suppressed 30 similar messages]
I20260709 13:02:53.683547  5858 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.681721  5765 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.726045  5872 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.779641  5765 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.782192  5765 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.763232  1539 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:02:53.783412  5872 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.779940  5828 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:53.788177  1535 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:53.776081  5840 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:53.808504  1580 leader_election.cc:400] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:02:53.756687  5869 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.764317  5810 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:53.765614  5915 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:53.793258  1534 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:02:53.786351  1612 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 6.
I20260709 13:02:53.795282  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.795662  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:53.796490  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.839094  1686 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
W20260709 13:02:53.839741  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:53.840194  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:53.840809  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:53.783681  5839 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:53.844882  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49311.3us
I20260709 13:02:53.846239  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:53.787014  5785 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:53.788681  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:53.755191  5834 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:53.909322  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 61794.3us
I20260709 13:02:53.841080  5765 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:53.760200  5779 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:53.933863  1615 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:53.909617  5846 consensus_meta.cc:287] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.004s
I20260709 13:02:53.906509  5879 raft_consensus.cc:2764] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:02:53.830269  5905 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:02:53.725669  5703 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:02:53.835974  1532 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:53.838274  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:53.838492  5869 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.848958  1685 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:53.857854  1541 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:53.763803  5845 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.822144  5896 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:53.838912  5810 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:54.026477  5810 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:54.029000  5912 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:53.934649  5894 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:02:53.908444  5741 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:53.928900  5871 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:02:53.911441  5685 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:53.949364  1611 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:02:53.841719  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:53.962060  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 136091us
I20260709 13:02:53.983255  5506 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:53.985929  5600 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:53.948221  5827 consensus_queue.cc:1059] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:02:53.992314  1540 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
W20260709 13:02:53.996284  5914 log.cc:927] Time spent T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:53.846427  5915 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:53.827889  5910 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
W20260709 13:02:54.013724  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 329554us
I20260709 13:02:53.909514  5608 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:02:53.829631  5872 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:02:54.027745  5757 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:54.048656  1615 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:54.052493  1614 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:54.055874  1685 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:53.809285  5899 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 13:02:54.075057  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:54.054670  5828 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.092010  5600 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.061424  5506 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:53.939230  5846 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.124459  5869 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:54.113852  5831 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.126189  5831 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.126570  5834 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.064580  5685 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.146961  1536 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:54.173839  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.174989  1681 raft_consensus.cc:2393] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:54.194312  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 247849us
I20260709 13:02:54.195102  1541 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:02:54.263759  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 68211.9us
I20260709 13:02:54.267238  1538 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:54.273728  1532 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:02:54.274190  1532 pending_rounds.cc:85] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 6
I20260709 13:02:54.274436  1532 pending_rounds.cc:107] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:02:54.274690  1532 raft_consensus.cc:2889] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:54.115235  5828 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.268558  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet 5853661a3b2948fbb9b9483e9e4176a3 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:02:54.216568  5708 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:54.172125  5834 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:54.308354  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.308941  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.309621  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.309461  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:54.310920  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.312419  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.313184  1539 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:54.221635  5608 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.043946  5765 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.318538  1541 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 7: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:54.323168  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:54.323623  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.327852  1539 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:54.275415  5909 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.329363  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:54.305123  5708 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:54.339238  5913 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.315279  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet 5853661a3b2948fbb9b9483e9e4176a3 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-5853661a3b2948fbb9b9483e9e4176a3
I20260709 13:02:54.339777  5922 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.280808  5600 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:54.351179  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:54.351845  1532 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.300711  5809 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.334960  5665 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:54.335250  5804 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:54.343079  5844 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:54.315572  5658 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:02:54.350592  5922 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.410224  5708 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:54.411278  5922 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:54.334957  5608 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.347592  5867 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.413312  5608 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:54.414847  5765 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.381482  5665 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:54.416757  5915 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.418627  5831 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.269446  5506 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.419252  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.420444  5506 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.389698  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:54.322080  5834 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:54.407624  5880 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.003s
I20260709 13:02:54.364467  5809 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.367039  5600 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:54.416354  5665 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.420295  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.402302  5846 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.403673  5685 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.400234  5654 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:54.393620  5892 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.435006  1532 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
W20260709 13:02:54.475420  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 146162us
I20260709 13:02:54.477185  1690 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:02:54.348485  5909 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.387715  5844 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.481098  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:54.488384  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.490144  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:54.470629  5926 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:02:54.494270  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:54.486685  5839 consensus_meta.cc:287] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.004s
I20260709 13:02:54.500386  5844 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.508153  5802 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:54.509131  1700 tablet_copy_source_session.cc:215] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:54.365419  5913 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:54.478886  5867 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:54.527997  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.495982  5847 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:54.540908  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.543104  1534 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 13:02:54.545008  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.497534  5892 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:54.550275  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 68098.1us
W20260709 13:02:54.550802  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.487355  5810 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.539783  5867 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.556583  5810 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.556746  5913 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:54.557755  5867 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.502512  5654 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:54.560777  1682 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:54.560894  5654 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:54.561892  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:54.529098  5665 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.563875  5847 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:54.569531  1686 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:54.493435  5827 consensus_queue.cc:1059] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:02:54.525324  5802 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:54.515120  5927 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:54.584509  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:54.599731  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58843.2us
W20260709 13:02:54.597515  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.616328  5827 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:54.616802  5827 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:54.617688  5827 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.618860  5827 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:54.621050  5608 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:54.621495  5608 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.621865  5608 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.552090  5846 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:54.624064  5846 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:54.626888  5846 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:54.548839  5933 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:54.628346  5933 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:54.635264  5896 consensus_meta.cc:287] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.000s
I20260709 13:02:54.636993  5600 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:54.637614  5600 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:54.638116  5600 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:54.641185  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 2162) took 1018 ms. Trace:
I20260709 13:02:54.641744  1540 rpcz_store.cc:276] 0709 13:02:53.622300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.622437 (+   137us) service_pool.cc:224] Handling call
0709 13:02:54.640927 (+1018490us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b54001fb8d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:54.641098 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757384064}
I20260709 13:02:54.644400  5809 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.650035  5909 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.651340  5834 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.593914  5831 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.652302  5831 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:54.653110  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1783) took 1219 ms. Trace:
I20260709 13:02:54.653453  1690 rpcz_store.cc:276] 0709 13:02:53.433491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.433641 (+   150us) service_pool.cc:224] Handling call
0709 13:02:54.652907 (+1219266us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540004a454. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:54.653014 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2365265152}
I20260709 13:02:54.654860  5831 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:54.594316  5922 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.656198  5922 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.656793  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1864) took 1050 ms. Trace:
I20260709 13:02:54.657138  1615 rpcz_store.cc:276] 0709 13:02:53.606416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.606990 (+   574us) service_pool.cc:224] Handling call
0709 13:02:54.656608 (+1049618us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540007bcd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:54.656711 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623640320}
I20260709 13:02:54.658397  5922 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:54.659976  5847 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:54.654937  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 2150) took 1864 ms (client timeout 1906 ms). Trace:
W20260709 13:02:54.664677  1536 rpcz_store.cc:269] 0709 13:02:52.790092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:52.810632 (+ 20540us) service_pool.cc:224] Handling call
0709 13:02:54.654752 (+1844120us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54001dfbd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:54.654879 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3043299072}
I20260709 13:02:54.668291  1683 raft_consensus.cc:2410] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:02:54.671310  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 161523us
I20260709 13:02:54.706012  1536 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:54.713860  5608 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.718518  5608 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:54.721730  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.721498  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.732455  1536 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:54.736545  1541 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:54.739784  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.740875  1540 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:54.744328  1541 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:54.745455  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:54.751346  5845 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.729723  5831 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:54.753331  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.760785  1681 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:02:54.773178  5904 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:54.773413  5943 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:54.773811  5904 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.606534  5938 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 13:02:54.709007  5933 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.777515  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:54.778126  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:54.779263  1615 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:54.607667  5927 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:54.794632  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 247945us
I20260709 13:02:54.800909  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.807881  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.808887  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.809149  1614 raft_consensus.cc:2393] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:54.810148  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:54.810377  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:54.811100  1612 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:54.812346  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.812508  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:54.813462  1611 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:54.812387  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.815085  1615 raft_consensus.cc:2410] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:54.815237  5899 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:54.720800  5892 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.820375  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:54.822261  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:54.824445  1538 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.826457  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.830569  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.831492  1615 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:54.803192  5843 raft_consensus.cc:3055] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.834178  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.834967  1690 raft_consensus.cc:2410] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:54.834827  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.834697  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.835707  1614 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:02:54.838016  1611 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:02:54.838347  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.839097  1609 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:02:54.839857  5665 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:54.840586  5665 raft_consensus.cc:697] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:54.842597  5665 consensus_queue.cc:237] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.845026  1612 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:54.846691  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.849483  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.851096  5600 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:54.800324  5804 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:54.853073  5804 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.854447  5802 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:54.857254  5871 raft_consensus.cc:3055] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.857461  5927 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.779860  5831 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.859325  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.860419  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:54.857822  5871 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:54.838054  5910 consensus_queue.cc:1059] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:02:54.864975  5831 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.857491  5843 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:54.857266  5844 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.864975  5904 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:54.863677  5871 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.866384  5843 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:54.867359  5827 consensus_queue.cc:1175] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c98c328741aa493d87abafbf08f04944" responder_term: 10 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:02:54.858705  5950 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:02:54.868959  5902 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:54.869408  5902 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:54.870211  1533 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:54.870296  5871 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.870464  5902 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:02:54.872285  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.873167  1612 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:54.875324  1653 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:54.878072  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:54.874557  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:54.880360  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:54.881397  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 278236us
W20260709 13:02:54.888283  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.886060  1609 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:02:54.889690  1504 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:54.858664  5802 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:54.897137  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:54.901160  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.902397  1612 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:54.881096  1579 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:54.919939  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45443.6us
I20260709 13:02:54.921371  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:54.922051  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.915482  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:54.906011  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:54.887603  5950 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:02:54.925100  1612 raft_consensus.cc:1813] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Handling vote request from an unknown peer c98c328741aa493d87abafbf08f04944
I20260709 13:02:54.925802  1612 raft_consensus.cc:2410] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:02:54.945858  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 65145.9us
I20260709 13:02:54.946390  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:54.947031  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:54.905282  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 171451us
I20260709 13:02:54.956954  1684 raft_consensus.cc:2410] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:02:54.957867  1580 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:54.945988  1504 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:54.893699  5741 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:54.891011  5902 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:54.963722  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:54.903693  5600 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:54.965917  1504 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:54.903781  5506 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:54.965417  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:54.978098  5625 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.978654  5625 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.957345  5658 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:54.945080  5802 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:54.983312  1538 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:02:54.969098  1580 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:54.965188  5899 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:54.992764  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:54.967681  5741 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:54.968325  5933 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.967156  5872 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:54.976743  5810 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:54.976152  5845 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:54.976522  5600 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.001302  1690 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:54.980712  5665 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:54.961670  5831 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:02:55.010788  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:55.016476  1689 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:02:55.040211  1689 pending_rounds.cc:85] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 4
I20260709 13:02:55.040597  1689 pending_rounds.cc:107] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:02:55.040916  1689 raft_consensus.cc:2889] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:54.962359  5757 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:02:54.980219  5909 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:55.045495  5899 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.051555  5909 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.052016  5909 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:54.988433  5658 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:55.024335  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54906.8us
I20260709 13:02:55.024973  1504 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:54.964808  5927 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:02:55.009467  5741 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.007200  5802 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.021832  5828 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:55.055812  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.066684  5900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5853661a3b2948fbb9b9483e9e4176a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:55.019879  5933 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.041059  5845 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:55.030807  5600 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.128857  2329 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:55.122510  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 157166us
I20260709 13:02:55.130038  1579 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:55.130867  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 161831us
I20260709 13:02:55.132063  1580 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:55.049738  5621 raft_consensus.cc:3055] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:55.040014  5810 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:55.051987  5899 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:55.053614  5847 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:55.143464  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 118634us
W20260709 13:02:55.145161  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.114078  5658 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.146238  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.153527  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.154073  5873 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.155052  5873 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:55.160225  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.046664  5665 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.162230  5946 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.137557  5621 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:55.175624  5757 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:55.164623  1690 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:55.148886  5888 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:55.184259  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:55.185917  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 195770us
I20260709 13:02:55.182169  1579 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:55.176748  5802 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:55.152315  5844 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:55.206310  5904 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:55.213845  1682 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:55.206231  5873 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.208384  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:55.218600  1686 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:55.184819  5828 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:02:55.168105  5938 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:55.216957  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.208498  5845 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.186012  5943 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:55.241812  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 81610.7us
I20260709 13:02:55.179831  5899 raft_consensus.cc:697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:55.170295  5947 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:55.200629  5888 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.213411  5804 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.159615  5847 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.275267  1504 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:55.246932  5927 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.210976  5967 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:02:55.294222  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.241592  5831 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:02:55.296595  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 48140.3us
I20260709 13:02:55.233415  5828 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.210623  5858 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:02:55.245452  5873 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:55.242268  5869 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.275899  5872 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:55.307021  5965 log.cc:927] Time spent T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:02:55.311048  5843 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.287739  5880 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:55.312059  5621 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:55.313819  5952 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 13:02:55.303577  5809 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:55.317631  5665 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:55.317957  5927 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.299913  5967 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.290459  5888 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.244809  5844 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.247465  5947 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.324020  5785 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:55.324858  5933 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:55.238761  5802 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:02:55.327540  1612 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:02:55.328053  5608 raft_consensus.cc:993] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:55.328421  5831 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.329015  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:55.330407  5708 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.330691  5847 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:55.298856  5963 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.331657  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:55.323342  5828 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:02:55.242286  5938 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.266175  5810 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.467607  1609 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:55.467382  1611 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:55.446055  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2379) took 1080 ms. Trace:
W20260709 13:02:55.337193  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 154123us
I20260709 13:02:55.488138  1539 rpcz_store.cc:276] 0709 13:02:54.365268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.365897 (+   629us) service_pool.cc:224] Handling call
0709 13:02:54.366294 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.511616 (+145322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.511648 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.515752 (+  4104us) log.cc:844] Serialized 26 byte log entry
0709 13:02:54.799787 (+284035us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:02:54.799864 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.428662 (+628798us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5400067a54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:55.428756 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:55.428849 (+    93us) raft_consensus.cc:1685] finished
0709 13:02:55.428872 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:55.445936 (+ 17064us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126150,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":13742,"spinlock_wait_cycles":49786624,"thread_start_us":357712,"threads_started":2,"wal-append.queue_time_us":307987}
I20260709 13:02:55.488773  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.452270  5621 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.446477  5809 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.421731  5757 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.455013  5904 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.420426  5871 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.481518  5923 raft_consensus.cc:1081] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:02:55.454594  5785 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:55.532254  5785 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:55.495213  5963 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.536201  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:55.537398  5871 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.475742  5719 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:55.514770  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.516389  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.518312  1540 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:55.452729  5967 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:55.505865  1539 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:02:55.454479  5947 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:55.481822  5933 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:55.521570  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.523285  5962 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:02:55.523232  1534 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:55.456086  5600 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.456156  5844 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.541543  1532 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:02:55.541993  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.543632  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:55.543962  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:55.528388  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.363283  5869 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.446300  5880 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.546222  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.553064  1536 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:02:55.524893  5757 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.553817  1535 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:55.524273  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:55.450814  5872 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.474756  5831 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.482018  5708 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.558781  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:55.559181  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 411750us
I20260709 13:02:55.520212  5809 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:55.562266  1614 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:55.568063  1611 raft_consensus.cc:2376] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9. Re-sending same reply.
I20260709 13:02:55.451120  5899 consensus_queue.cc:237] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:54.833068   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:55.537854  5963 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.581815  5858 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.582023  5976 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.582409  5963 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.582502  5858 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.582695  5976 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.585068  5600 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:55.585749  5976 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.539291  5904 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.588459  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.589298  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:55.590520  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:55.583024  5963 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.590598  5970 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.571761  5975 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.594995  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:55.595103  1610 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:02:55.595800  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:55.597519  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.597947  1607 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:02:55.581588  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.603350  1609 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:02:55.553666  5719 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.604951  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:55.605526  1684 raft_consensus.cc:2410] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:02:55.605618  1690 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:55.601151  1688 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:02:55.608405  1607 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:55.616698  5871 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:55.616824  5969 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:55.617677  5969 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.619150  5880 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.571846  5867 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.621385  1533 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:02:55.622004  1607 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:55.621325  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:55.623426  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.623533  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:55.559679  5974 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.627406  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:55.627518  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:55.628638  1682 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:02:55.561786  5933 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.636127  1616 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:02:55.637917  1607 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:55.593195  5904 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.652367  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:55.649977  1607 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:55.621038  5902 consensus_meta.cc:287] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.649s	user 0.013s	sys 0.000s
I20260709 13:02:55.620183  5833 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:02:55.657182  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.660687  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:55.661311  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:55.634443  5976 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.694286  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:02:55.696615  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 85075.4us
W20260709 13:02:55.703890  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:55.706593  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.652330  5608 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.715518  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.636058  5867 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.736137  1607 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:55.736586  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.713126  5969 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.740432  5964 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.741019  5964 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.741843  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:55.743158  5964 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:55.745757  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.747784  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.750846  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.708591  5904 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.715327  5873 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:55.753446  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:55.608912  5975 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.765746  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.723845  5845 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.755918  1611 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:02:55.736434  5973 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:02:55.761505  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:55.707693  5976 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.775032  1607 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:55.812225  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45008.7us
I20260709 13:02:55.749711  5847 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:02:55.814219  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.813464  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.724208  5608 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.756554  5927 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:55.852933  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:55.817785  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:55.760269  5873 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:55.853850  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.771648  5974 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.864351  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.776084  5964 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:02:55.866946  5984 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:55.868846  5964 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:55.776588  5600 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.814597  5969 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.776172  5858 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:55.808264  5844 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.817050  5938 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:55.768666  5904 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.872764  5927 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:55.778338  5845 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.813258  5833 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:02:55.908385  5982 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:02:55.892266  5757 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.886051  5847 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.888693  5869 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:55.823763  5977 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:02:55.785229  5967 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:55.906185  5708 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:55.922405  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 59250.3us
I20260709 13:02:55.926726  5969 consensus_queue.cc:1059] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:55.929701  5927 raft_consensus.cc:3055] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:55.930188  5927 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:55.931085  5927 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:55.932199  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:55.933665  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:55.934259  1614 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:55.935963  1607 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:55.932430  5927 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:55.935029  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:55.915594  5963 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:02:55.940454  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 189720us
I20260709 13:02:55.944295  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.958447  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:55.959826  5608 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:55.960222  5975 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.963897  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:55.988411  5608 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:55.989630  5608 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:55.960530  5985 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.255s	user 0.001s	sys 0.002s
I20260709 13:02:55.919770  5847 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:55.946802  5658 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.760s	user 0.015s	sys 0.000s
I20260709 13:02:55.940171  5933 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:55.995533  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:56.007088  1616 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:02:55.992120  5993 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:55.984169  5600 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:55.956724  5719 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:55.982486  5975 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:55.992380  5867 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.004597  5757 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:56.024287  5976 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:56.024781  5909 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.972s	user 0.015s	sys 0.001s
I20260709 13:02:56.024989  5975 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.028841  5904 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.029047  5869 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:56.050381  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.010460  5993 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:02:56.069042  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 62350.5us
I20260709 13:02:56.069831  1505 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:56.070381  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.071870  1614 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:56.073060  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:56.071609  5898 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:02:56.016317  5997 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.007396  5658 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.078711  5757 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:56.079382  5757 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:56.080264  5847 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.080293  5757 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.017349  5933 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:02:56.083310  5621 consensus_meta.cc:287] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.001s
W20260709 13:02:56.083789  5741 consensus_meta.cc:287] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.939s	user 0.011s	sys 0.002s
I20260709 13:02:56.084687  5658 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:56.085033  5741 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.078071  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:56.065492  5867 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:56.081696  5785 consensus_meta.cc:287] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.001s
I20260709 13:02:56.063812  5970 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:56.085682  5975 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:56.092325  5988 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
I20260709 13:02:56.094467  5785 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.096004  5741 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:56.096693  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.098037  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.067487  5993 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:56.059415  5909 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.077986  5904 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.105532  1612 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:56.087445  5997 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.108992  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:56.070710  5869 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.073761  5939 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:02:56.114403  6001 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:56.117897  1610 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 14. Ops: []
I20260709 13:02:56.124414  1536 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:02:56.118230  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:56.132663  5831 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.132891  5785 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:56.144917  5843 consensus_meta.cc:287] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.001s
I20260709 13:02:56.085924  5809 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.106441  5845 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.109896  5904 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:56.146992  5828 consensus_meta.cc:287] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.003s
I20260709 13:02:56.148262  5608 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:56.118633  1505 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:56.100339  5867 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:56.184170  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 65651.3us
I20260709 13:02:56.122678  5847 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:56.188158  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:56.119848  5967 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.116390  5997 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.111699  5933 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 13:02:56.172425  5888 consensus_meta.cc:287] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.006s
W20260709 13:02:56.198704  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.174631  6001 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.185053  5904 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:56.197135  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:56.213001  6003 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.002s
I20260709 13:02:56.199221  5757 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.190335  5984 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:56.216130  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.217111  1607 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
W20260709 13:02:56.218217  5947 consensus_meta.cc:287] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.653s	user 0.013s	sys 0.000s
I20260709 13:02:56.218801  5947 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.200908  5888 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:56.224267  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.111954  5970 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.218222  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.194564  5927 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:02:56.195353  5844 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.189129  5845 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:56.260365  1607 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 4.
W20260709 13:02:56.263028  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 163804us
I20260709 13:02:56.193207  5600 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:02:56.267617  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:56.269583  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.206446  6001 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.216184  5621 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:02:56.270748  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.214895  5757 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.185519  5828 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.278431  5757 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.279709  1611 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:56.280360  5954 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:56.280848  5954 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:56.281284  5954 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:56.281524  5900 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53388 (request call id 547) took 3127 ms. Trace:
I20260709 13:02:56.282152  5900 rpcz_store.cc:276] 0709 13:02:53.158770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.158963 (+   193us) service_pool.cc:224] Handling call
0709 13:02:53.458082 (+299119us) ts_tablet_manager.cc:934] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
0709 13:02:54.956523 (+1498441us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:55.813003 (+856480us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:55.827543 (+ 14540us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:56.280497 (+452954us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:56.280855 (+   358us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:56.281239 (+   384us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:56.281416 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":63880,"tablet-copy.queue_time_us":237129,"thread_start_us":214227,"threads_started":2}
I20260709 13:02:56.283320  5828 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.276489  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:56.285898  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:56.286370  1654 connection.cc:256] RPC call timeout handler was delayed by -1.1045644879999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 13:02:56.286677  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.229602  5967 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.284116  5809 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.204599  5658 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:02:56.273239  5996 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:02:56.300846  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.301565  1607 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:56.302932  1611 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:56.284150  5900 tablet_copy_client.cc:806] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:56.304944  5947 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.296622  5844 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.309864  5844 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.312799  5869 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.287897  5621 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:56.313737  5658 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:56.314280  5658 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:56.314453  5621 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.299479  5809 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:56.315577  5658 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.316532  5809 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.317268  5909 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.317440  5993 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.318892  5809 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.319679  5993 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.322945  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.311728  5867 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.304984  5900 tablet_copy_client.cc:670] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:56.365206  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:56.288758  5757 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.299304  5894 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:56.366075  1607 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:02:56.368146  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.317150  5658 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:56.373766  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.298338  5967 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.327386  5938 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.376765  6012 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:02:56.378078  5979 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.683s	user 0.000s	sys 0.008s
W20260709 13:02:56.380282  5980 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.644s	user 0.002s	sys 0.000s
I20260709 13:02:56.329138  5809 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.376467  5938 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:02:56.363554  5869 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:02:56.388607  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:56.402148  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.402438  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.403412  1607 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:56.405388  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.406279  1607 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:56.412994  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:56.415545  1537 raft_consensus.cc:2393] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:56.417061  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.420120  5970 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.367050  5922 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:02:56.404229  5809 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.426707  5809 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.374899  5894 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.429620  5894 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.429785  5967 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.431072  5888 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.426744  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:56.435339  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:56.385957  5600 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.385448  5909 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:56.438177  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 61441.9us
I20260709 13:02:56.402906  5844 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.442819  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2395) took 1450 ms. Trace:
I20260709 13:02:56.455833  1538 rpcz_store.cc:276] 0709 13:02:54.992513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:54.992654 (+   141us) service_pool.cc:224] Handling call
0709 13:02:54.993025 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:54.993532 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:54.993572 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:54.994226 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.477144 (+482918us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b180011e120. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:02:55.573586 (+ 96442us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:55.573623 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.573693 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:56.379123 (+805430us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:56.442488 (+ 63365us) raft_consensus.cc:1685] finished
0709 13:02:56.442522 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.442711 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9006,"spinlock_wait_cycles":82480256,"thread_start_us":96208,"threads_started":1,"wal-append.queue_time_us":659061}
I20260709 13:02:56.449945  5873 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.373036  5757 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.400864  5780 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:02:56.471516  5780 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.474902  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.475683  1616 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
W20260709 13:02:56.492019  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.499125  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:56.499311  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.499794  1611 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:56.476776  6013 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.504493  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.505342  1616 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 7.
I20260709 13:02:56.506174  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:56.508750  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:56.512075  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.512960  1616 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:56.514067  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.504010  6013 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.518414  6013 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:56.525059  5922 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:56.525575  5922 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:56.526018  5922 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.485376  5780 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.465140  5844 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.528456  5938 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:56.529146  5938 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:56.529865  5844 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.529681  5938 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.457223  5600 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.533249  5600 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.533489  5757 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.534183  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:56.508962  5873 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:56.534987  1607 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:56.525799  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:56.536923  1681 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
I20260709 13:02:56.538923  1616 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:56.539649  1611 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 8.
I20260709 13:02:56.542150  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:56.455344  5909 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.546335  1616 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:56.556783  1607 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:56.553928  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.555220  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:56.562218  1608 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:02:56.563541  5859 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:02:56.564157  5859 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:56.564544  5859 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:56.563711  1608 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:02:56.567626  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:56.551461  6013 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:56.574244  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.579879  1616 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:56.646601  1607 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:56.569635  5982 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:56.654778  1611 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:56.655341  5938 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:56.661105  5954 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.670423  5904 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.652098  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:56.688570  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 179886us
I20260709 13:02:56.693053  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:56.578749  6013 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.744259  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:56.678825  5780 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.647699  6001 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.745664  6013 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:56.778434  6014 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:02:56.777289  5780 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:56.764319  5938 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:56.772583  6016 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:56.663964  5954 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:56.787746  5938 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:56.836274  6015 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:02:56.788205  5909 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.886102  5757 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:56.880524  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 671) took 1287 ms. Trace:
I20260709 13:02:56.789016  6016 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:56.894392  1613 rpcz_store.cc:276] 0709 13:02:55.593230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.595146 (+  1916us) service_pool.cc:224] Handling call
0709 13:02:55.595386 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.622094 (+ 26708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.622122 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.622159 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:55.622187 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.858733 (+1236546us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54002265d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:56.880289 (+ 21556us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.880460 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61002496}
I20260709 13:02:56.904845  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.906060  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:56.909678  1538 raft_consensus.cc:2393] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:02:56.910126  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.799553  5938 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:56.914855  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:56.931531  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:56.932622  5780 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.933511  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 668) took 1341 ms. Trace:
I20260709 13:02:56.887028  5757 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:56.935654  1615 rpcz_store.cc:276] 0709 13:02:55.592368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.596059 (+  3691us) service_pool.cc:224] Handling call
0709 13:02:55.598688 (+  2629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.724372 (+125684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.724410 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.724469 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:02:55.724509 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:56.933173 (+1208664us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540040a1d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:56.933231 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:56.933423 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288547200}
I20260709 13:02:56.903891  5966 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:56.922788  6016 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:56.942473  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:56.943472  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.943938  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:56.961151  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:56.962476  1579 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:56.963764  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:56.941618  5904 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.941108  5939 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:02:56.946894  5966 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:56.977023  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.069289  1616 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:57.071530  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.071365  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.072793  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.072418  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:57.065573  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 121745us
I20260709 13:02:57.078636  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.080051  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.070564  6019 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.081194  6019 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.082897  5757 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.083245  6019 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:57.084144  6018 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.084875  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.084713  6018 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.080523  1687 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:57.086570  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.087553  1681 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:57.087734  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.088452  1689 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.074143  1683 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:57.088594  1687 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:56.973097  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 197851us
I20260709 13:02:57.089560  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.092163  1615 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:57.092537  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.094862  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 768) took 1515 ms. Trace:
I20260709 13:02:56.975585  5900 tablet_copy_client.cc:538] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:57.095242  1532 rpcz_store.cc:276] 0709 13:02:55.579849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.581554 (+  1705us) service_pool.cc:224] Handling call
0709 13:02:55.581927 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:55.601989 (+ 20062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.602025 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:55.602071 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:55.602108 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.094648 (+1492540us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b5400400954. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:57.094691 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.094810 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45629824}
I20260709 13:02:57.099861  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.095214  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.102324  1688 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:57.097909  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.107717  1681 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:57.110097  5658 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:57.110618  5658 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:57.111397  5859 consensus_meta.cc:287] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.004s
I20260709 13:02:57.112499  5938 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.114187  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37898 (request call id 2183) took 1399 ms. Trace:
I20260709 13:02:57.114600  1536 rpcz_store.cc:276] 0709 13:02:55.714663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.714833 (+   170us) service_pool.cc:224] Handling call
0709 13:02:57.113978 (+1399145us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b540008edd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:57.114111 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934391680}
I20260709 13:02:57.086957  6018 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:57.118345  5966 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:57.006565  5997 consensus_meta.cc:287] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.767s	user 0.011s	sys 0.003s
I20260709 13:02:57.119128  5997 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.120105  1687 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:02:57.121450  5997 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.033265  5506 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.122812  5506 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.125108  6016 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.087886  6013 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.008862  5804 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:56.985666  5906 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.127496  5970 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.131408  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.132957  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.136368  1689 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:57.164906  1683 raft_consensus.cc:2410] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:02:56.978669  5834 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:56.986851  5780 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:02:57.138401  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 61734.7us
W20260709 13:02:57.139189  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 193091us
I20260709 13:02:56.996542  6001 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.114898  5938 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:57.157806  1688 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:56.978335  5982 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:02:56.995782  6023 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:57.111555  5658 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.171940  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.174302  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.179402  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:57.160192  5922 consensus_meta.cc:287] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.002s
I20260709 13:02:57.126091  5506 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:57.176007  1685 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:02:57.180274  1688 raft_consensus.cc:2468] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:02:57.157368  5870 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:57.183890  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.167605  5834 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.111984  5859 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:02:57.198084  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 316683us
I20260709 13:02:57.169516  5780 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:57.213726  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.173748  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 188732us
I20260709 13:02:57.186362  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.175935  5804 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.220930  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.221650  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:57.223268  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.223829  1613 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.224017  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.223170  1532 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
I20260709 13:02:57.229535  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:57.201299  5834 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.170073  5970 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.253777  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.248755  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.255074  1616 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 7.
I20260709 13:02:57.256117  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.256768  1616 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:57.257675  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.166916  5906 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.246014  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.251235  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.252454  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.188927  5922 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.220840  5780 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:57.253778  1615 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:57.246620  1613 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:02:57.261533  1538 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:57.253528  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.232618  6001 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.196372  5870 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.271274  1579 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:57.277192  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.280743  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.272526  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.273556  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.274255  1533 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 9: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:57.279405  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.272388  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.282907  1608 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:57.282172  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:57.284968  1686 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:02:57.285247  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.286120  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.281486  1538 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:57.286751  2367 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:57.281162  1537 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:57.281486  1579 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:57.292445  1688 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:02:57.295850  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:57.296887  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.297994  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.298141  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.299278  1534 raft_consensus.cc:2410] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:02:57.299326  1537 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 14: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:57.305044  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.305938  1607 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:02:57.272806  5873 consensus_meta.cc:287] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.738s	user 0.012s	sys 0.001s
I20260709 13:02:57.253580  5909 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.310796  1616 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:57.233851  5804 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.254071  5904 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.261978  5658 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.314193  1690 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 13: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:57.287338  5982 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.308997  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.268383  5757 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:57.317590  1612 raft_consensus.cc:2410] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
W20260709 13:02:57.316665  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 198750us
I20260709 13:02:57.318022  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.304967  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.184382  6023 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.309847  5894 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:57.335812  2365 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:57.340723  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.345623  1537 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:57.321592  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.347270  1534 raft_consensus.cc:2368] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8.
I20260709 13:02:57.303730  5719 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:57.352463  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.353312  1616 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:57.353207  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:57.352520  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 71091us
I20260709 13:02:57.354562  1611 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.357923  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:57.361047  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.358095  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.300952  6001 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.364635  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:57.364461  1579 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:57.366138  1683 raft_consensus.cc:2468] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:02:57.367690  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2377) took 1604 ms. Trace:
I20260709 13:02:57.344338  5867 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.343426  6033 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.349586  5873 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:57.372109  5873 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.367544  5938 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.372728  5873 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.373569  5871 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:57.374897  5871 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:57.375298  5871 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:57.368224  1614 rpcz_store.cc:276] 0709 13:02:55.763172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.941794 (+178622us) service_pool.cc:224] Handling call
0709 13:02:55.942105 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.072298 (+130193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.367428 (+1295130us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002f0b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:57.367624 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297942400}
I20260709 13:02:57.343576  5894 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:57.320957  5909 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:57.377251  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 132547us
I20260709 13:02:57.379098  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:57.381299  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:57.383173  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.371726  1611 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:57.317305  6036 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:02:57.386771  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.387372  1536 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:02:57.331995  5904 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.389439  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:57.401754  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.401795  1534 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:02:57.391625  1532 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:57.392874  1536 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
W20260709 13:02:57.394003  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.337110  6035 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:02:57.381909  5779 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:57.379823  6013 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:57.397683  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:57.344695  5757 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.371702  5867 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.417604  1533 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:57.373730  5976 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:02:57.421140  6032 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:02:57.373044  5938 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.435503  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.358981  5719 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.445233  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:57.432492  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 68111.3us
I20260709 13:02:57.453222  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.456615  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.457218  1533 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:57.400101  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:57.398867  6016 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:57.339370  5982 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.463796  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.466785  1536 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:02:57.400647  6028 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:57.470561  1533 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:02:57.471334  1536 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:57.471755  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.472982  1533 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:57.471940  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:57.445725  5915 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.448788  5867 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.447984  5976 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:57.501830  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 101819us
I20260709 13:02:57.372011  6045 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:57.380250  6033 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.505091  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.453649  6034 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:57.474591  6028 raft_consensus.cc:697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:57.508296  1536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:02:57.534701  1536 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:57.535274  1536 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:57.536418  6038 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:02:57.536609  5892 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:02:57.540395  6037 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:02:57.541703  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.542635  1683 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:57.543509  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:57.545363  6040 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:02:57.547036  5757 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:57.548188  5970 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.548408  6023 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:57.510324  6014 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:57.550101  6014 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:57.550503  6014 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:57.499241  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.558681  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.559424  1653 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:57.560819  6001 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.465394  6036 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.562862  6036 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.563912  5896 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:57.564867  1613 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:57.565821  6033 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.450920  5894 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:57.566593  5981 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.817s	user 0.016s	sys 0.005s
I20260709 13:02:57.525039  5938 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:02:57.526515  6041 log.cc:927] Time spent T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:02:57.567027  5966 raft_consensus.cc:3055] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:57.526803  5719 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.527918  5904 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.567536  5966 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:57.568454  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2373) took 1835 ms. Trace:
I20260709 13:02:57.568858  1610 rpcz_store.cc:276] 0709 13:02:55.733723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.734133 (+   410us) service_pool.cc:224] Handling call
0709 13:02:55.734567 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:56.124502 (+389935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:57.568222 (+1443720us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540030d254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:57.568394 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880998144}
I20260709 13:02:57.510314  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:57.467226  5859 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:57.474993  6043 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.476370  5870 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:57.504421  5915 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:57.572366  5915 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.572068  6043 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.527630  5804 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.528334  5906 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:57.545161  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.584474  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.585124  1681 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:02:57.531418  1684 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:02:57.391656  5931 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.124s
I20260709 13:02:57.569316  6036 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.462699  5779 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:57.589804  5779 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.590322  1537 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:57.590854  5982 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.571141  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.469866  6013 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:57.566900  6019 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:02:57.574373  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2172) took 2061 ms. Trace:
I20260709 13:02:57.574572  6043 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.575292  5870 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:57.575634  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 65411.2us
I20260709 13:02:57.575920  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.517988  5997 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:02:57.530836  6034 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:57.576898  5867 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.519315  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.559296  5871 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.593936  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.594398  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.512259  5976 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.596737  1536 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.603849  1685 raft_consensus.cc:2410] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:02:57.601925  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.638334  1537 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
W20260709 13:02:57.604543  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 132833us
I20260709 13:02:57.639463  1681 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:02:57.640398  1535 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:57.598786  1541 rpcz_store.cc:276] 0709 13:02:55.512552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:55.512730 (+   178us) service_pool.cc:224] Handling call
0709 13:02:55.513149 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:55.521484 (+  8335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:55.521513 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:55.528453 (+  6940us) log.cc:844] Serialized 26 byte log entry
0709 13:02:55.657519 (+129066us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:55.657574 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:55.657667 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:57.376551 (+1718884us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:57.574053 (+197502us) raft_consensus.cc:1685] finished
0709 13:02:57.574077 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:57.574311 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5932,"spinlock_wait_cycles":12033920,"thread_start_us":103041,"threads_started":1,"wal-append.queue_time_us":189956}
I20260709 13:02:57.640758  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:57.641853  1505 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:57.642967  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:57.613155  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.645804  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.615388  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.646211  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.635004  1608 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:02:57.608835  5909 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.635777  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.652205  1533 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:57.652426  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.653779  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.639358  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.654930  1537 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:57.649940  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:57.655251  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.656225  1535 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:02:57.650619  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 193536us
I20260709 13:02:57.608347  5997 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:57.663414  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.663707  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.664265  1534 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.664954  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.666096  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.666795  1536 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.665903  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.661154  1688 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 14: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:57.592010  5966 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.667505  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.670475  1683 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:02:57.668926  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.669418  1537 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 14: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:57.658741  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:57.672775  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.674527  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.644266  5870 raft_consensus.cc:697] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:57.600505  6013 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.529533  6045 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.677507  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.657891  5904 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:57.680243  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.681334  1536 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:57.653829  5804 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:57.677968  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:57.665647  6001 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:57.658119  6046 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:57.686623  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.663369  5757 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.619990  5906 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:02:57.667675  5997 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:57.724679  1504 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:57.709962  1536 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:57.663517  5922 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:57.644106  5905 consensus_queue.cc:1059] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:02:57.711488  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.687655  6043 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:02:57.758306  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:57.758903  6013 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:57.759665  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:57.761996  6045 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.763017  1616 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:02:57.755628  5873 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.767361  5873 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.768996  5828 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:57.769582  5828 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:57.771054  5894 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:57.770684  5828 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.772861  1534 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:02:57.773183  5871 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:57.691759  5804 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:57.774140  5804 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:57.720275  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.779417  5867 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.780820  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.782500  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.782543  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.690788  5904 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:57.784467  1614 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:57.784341  5870 consensus_queue.cc:237] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.728798  5757 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.690578  5966 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:57.789005  5757 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.711905  6001 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:57.789265  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.789830  6001 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:57.791891  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.792802  1684 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:57.794085  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.684921  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.796168  1537 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:57.796326  1690 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:02:57.731151  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.742585  5905 raft_consensus.cc:3055] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:02:57.743673  5906 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:57.745818  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:57.749818  6044 log.cc:927] Time spent T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.246s	user 0.005s	sys 0.000s
I20260709 13:02:57.751658  5780 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.637084  6028 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.753168  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.753844  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.807221  1613 raft_consensus.cc:2393] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 15: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:57.754654  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:57.755630  1579 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:02:57.808183  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 52612.9us
W20260709 13:02:57.756213  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:57.809751  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.756592  5831 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.783505  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:57.815168  1616 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:02:57.794214  1684 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:02:57.735971  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.818055  1684 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:57.722826  1681 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:57.816406  1579 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:57.687517  5909 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:02:57.784408  5904 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:02:57.838827  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 151878us
I20260709 13:02:57.801147  5906 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:57.802451  5905 raft_consensus.cc:740] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:57.818056  5828 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.805503  5915 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.856928  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.833184  6035 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:02:57.837872  5873 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:02:57.881858  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.852344  6043 raft_consensus.cc:697] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:57.685266  6034 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.849634  5757 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:02:57.894824  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47761.5us
I20260709 13:02:57.894667  6062 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:02:57.851815  5779 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:57.794389  6014 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.897678  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.899267  2365 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:57.832372  5831 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.908797  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.888357  6035 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:57.899608  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:57.898138  5873 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:57.920956  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.902026  6046 raft_consensus.cc:697] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:57.939282  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:57.941248  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.941367  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:57.946890  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.949798  1686 raft_consensus.cc:1240] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 14. Current term is 15. Ops: []
I20260709 13:02:57.950052  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.951105  1540 raft_consensus.cc:2410] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:02:57.952550  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.950539  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:57.953559  1537 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:02:57.954231  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:57.955541  1540 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:02:57.955487  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.956656  1536 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:57.951666  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:57.959838  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:57.960601  1537 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:57.961892  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:57.962596  1613 raft_consensus.cc:2376] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12. Re-sending same reply.
I20260709 13:02:57.963815  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:57.964114  1580 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:57.965162  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:57.991429  1534 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:02:57.908455  5779 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.994251  2370 raft_consensus.cc:1240] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:57.948751  5909 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:57.999325  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:57.954964  5982 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:02:58.006953  1580 leader_election.cc:400] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8.
I20260709 13:02:58.008524  1537 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:58.012382  5804 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:57.962409  6048 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.015651  1580 leader_election.cc:403] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:02:58.017028  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.013505  6033 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:58.019727  5780 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:57.964370  6036 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:02:58.019148  1686 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
W20260709 13:02:58.001976  5658 consensus_meta.cc:287] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.006s
I20260709 13:02:58.014737  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:57.964536  6064 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:02:58.028971  6061 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:02:58.029580  5765 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 7. Current term is 8.
I20260709 13:02:58.030282  5900 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:02:57.913964  5906 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.081347  5906 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.037135  5831 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.083851  5779 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:58.037686  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.038594  5804 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.040148  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.041435  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:58.085700  6070 log.cc:927] Time spent T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:02:58.041796  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.045312  6014 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:58.000820  5859 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.049571  5873 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.001133  6043 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:57.917623  5905 consensus_queue.cc:260] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.022210  6048 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:58.093261  6048 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.093483  5905 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:02:58.050210  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.100399  1682 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
W20260709 13:02:58.104423  5978 consensus_queue.cc:1175] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" responder_term: 15 status { last_received { term: 14 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:02:58.105671  5892 consensus_meta.cc:287] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.002s
I20260709 13:02:58.004191  5909 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:58.105849  5757 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:58.106403  1687 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:58.106805  5757 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.059082  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.108074  5843 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.109378  5625 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:58.108601  5843 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.060892  2328 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.023255  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.014065  5982 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:58.112855  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 89719.4us
I20260709 13:02:58.070402  1536 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:58.071587  5737 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:02:58.076421  5834 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.005s
I20260709 13:02:58.076977  5904 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.034631  6036 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:58.110908  5915 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:58.161937  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 101108us
W20260709 13:02:58.162271  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 437696us
I20260709 13:02:58.114253  1684 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.117301  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:58.168896  1684 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:58.169126  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51957.3us
I20260709 13:02:58.164958  5834 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.179023  5834 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.169582  6030 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:58.164604  6070 log.cc:927] Time spent T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 13:02:58.126283  5982 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:02:58.205390  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.188779  1532 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:58.169003  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.119891  5859 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:02:58.187516  1612 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2389) took 2177 ms (client timeout 1637 ms). Trace:
I20260709 13:02:58.214907  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:58.166689  6036 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:02:58.232432  1612 rpcz_store.cc:269] 0709 13:02:56.010087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:56.117787 (+107700us) service_pool.cc:224] Handling call
0709 13:02:58.187260 (+2069473us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002acbd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:58.187430 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609932672}
I20260709 13:02:58.221455  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:58.167047  6064 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:58.225641  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.175360  6033 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:58.163425  5765 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:02:58.068565  6035 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:58.221875  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 121833us
I20260709 13:02:58.228377  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.160631  5831 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:02:58.231642  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.242154  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 73268.3us
I20260709 13:02:58.243263  1504 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.176362  5997 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.235164  1684 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:58.072619  6046 consensus_queue.cc:237] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.233112  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:58.106879  5909 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.247802  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1828) took 1004 ms. Trace:
I20260709 13:02:58.248370  1684 rpcz_store.cc:276] 0709 13:02:57.243523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.793758 (+550235us) service_pool.cc:224] Handling call
0709 13:02:57.794076 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.113793 (+319717us) spinlock_profiling.cc:243] Waited 6.74 ms on lock 0x7b4c003c1300. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02cdd4a20 00007fd02cde5a29 00007fd02cdab644 00007fd02cdd2f2d 00007fd02cdd2b93 00007fd02eb0318b 00007fd02eb03cb5 00007fd02eafef30 00007fd02eb007de 00007fd02eb0ab49 00007fd02eb0b416
0709 13:02:58.246524 (+132731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.247721 (+  1197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15503104}
I20260709 13:02:58.232438  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.220386  5834 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:02:58.216971  5942 consensus_queue.cc:1059] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:02:58.253849  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.254101  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.255007  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.259006  1686 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11. Re-sending same reply.
I20260709 13:02:58.234579  5859 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:58.236073  6033 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.256767  1690 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:02:58.263803  1690 pending_rounds.cc:85] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 5
I20260709 13:02:58.264066  1690 pending_rounds.cc:107] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:02:58.238266  5779 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:02:58.250408  5802 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.268754  1683 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:02:58.269155  1683 pending_rounds.cc:85] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 7
I20260709 13:02:58.264842  1688 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.257162  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.271404  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:58.264298  1690 raft_consensus.cc:2889] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.271257  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:58.276243  5871 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.281639  5871 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.276736  5658 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:02:58.285691  5997 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:58.256007  6012 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:02:58.257158  5873 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:58.290995  5873 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.269439  1683 pending_rounds.cc:107] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.8
I20260709 13:02:58.296749  1683 raft_consensus.cc:2917] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Aborting config change with OpId 9.8: Aborted: Op aborted by new leader
I20260709 13:02:58.266860  5859 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:02:58.266368  6033 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.266057  5779 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.266455  5757 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:58.314532  1683 raft_consensus.cc:2889] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:58.293717  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:02:58.277313  5967 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:58.280375  6075 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.263139  6001 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.328688  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:58.329015  6001 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:58.280988  5896 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:58.298489  5997 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:58.325690  1684 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:02:58.335935  1688 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:58.332146  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:58.319612  5966 consensus_meta.cc:287] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.531s	user 0.001s	sys 0.011s
I20260709 13:02:58.335813  1535 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:58.326249  1690 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:58.340692  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2197) took 1084 ms. Trace:
I20260709 13:02:58.313983  5779 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:02:58.324290  5976 consensus_meta.cc:287] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.001s
I20260709 13:02:58.341161  1538 rpcz_store.cc:276] 0709 13:02:57.256222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.286959 (+ 30737us) service_pool.cc:224] Handling call
0709 13:02:57.287282 (+   323us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:02:57.449436 (+162154us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:02:57.833561 (+384125us) log.cc:844] Serialized 14 byte log entry
0709 13:02:57.895271 (+ 61710us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:02:57.902195 (+  6924us) log.cc:844] Serialized 104 byte log entry
0709 13:02:57.902381 (+   186us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:57.902682 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.095205 (+192523us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b18003dd500. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287
0709 13:02:58.095695 (+   490us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.105597 (+  9902us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b18003dd500. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd0329dc58f 00007fd02ba1b571 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd
0709 13:02:58.170668 (+ 65071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.287971 (+117303us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540009a454. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:58.288026 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.340428 (+ 52402us) raft_consensus.cc:1685] finished
0709 13:02:58.340446 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.340632 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95232,"prepare.queue_time_us":114815,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":134,"raft.queue_time_us":236937,"raft.run_cpu_time_us":564,"raft.run_wall_time_us":123935,"spinlock_wait_cycles":420225792,"thread_start_us":404861,"threads_started":3,"wal-append.queue_time_us":79248}
I20260709 13:02:58.340718  5967 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:58.321215  6062 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:58.345224  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50318 (request call id 0) took 6361 ms. Trace:
I20260709 13:02:58.324620  5871 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:58.356268  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.352921  1683 rpcz_store.cc:276] 0709 13:02:51.988879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.991948 (+  3069us) service_pool.cc:224] Handling call
0709 13:02:52.094909 (+102961us) log.cc:844] Serialized 506 byte log entry
0709 13:02:52.513509 (+418600us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b54001c05a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea81142 00007fd02ea61eaa 00007fd02ea68d53 00007fd02ea68cd9 00007fd02ea68c69 00007fd02ea68c31 00007fd02ea67dfd 000000000038f354 000000000038f199 00007fd02ba1b475
0709 13:02:52.515582 (+  2073us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b54001c05a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea88b26 00007fd02ea8249a 00007fd02ea81714 00007fd02ea61eaa 00007fd02ea68d53 00007fd02ea68cd9 00007fd02ea68c69 00007fd02ea68c31 00007fd02ea67dfd 000000000038f354
0709 13:02:52.692849 (+177267us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:02:58.336820 (+5643971us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2482,"raft.queue_time_us":7511,"raft.run_cpu_time_us":6434,"raft.run_wall_time_us":394101,"spinlock_wait_cycles":87516032,"thread_start_us":253711,"threads_started":1,"wal-append.queue_time_us":389172,"wal-append.run_cpu_time_us":4408,"wal-append.run_wall_time_us":1227583}
I20260709 13:02:58.337191  5896 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.336417  5997 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:58.357004  5870 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:02:58.324626  5894 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:02:58.362828  5896 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.377524  5906 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:58.378630  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.380071  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.380887  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.354864  6062 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:58.387023  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.423029  1682 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:58.388182  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:02:58.423672  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.390337  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.424573  1689 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:58.401319  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.402345  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:58.407161  1504 connection.cc:256] RPC call timeout handler was delayed by -1.0730432670000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
W20260709 13:02:58.408748  6074 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:02:58.409797  6076 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:02:58.413655  5997 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.280759  6064 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.399577  5843 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:58.420224  1688 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:58.420794  1684 raft_consensus.cc:2393] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:58.357873  5904 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.423336  1682 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:58.429057  1504 connection.cc:256] RPC call timeout handler was delayed by -1.0181432669999708s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 13:02:58.416788  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.353679  5976 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:58.436388  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48512.9us
W20260709 13:02:58.437281  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 204248us
I20260709 13:02:58.450414  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.450706  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.448475  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.456506  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:58.455605  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:58.457499  1540 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:58.457903  1538 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:58.456525  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:58.459098  1534 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.459172  1541 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:58.430722  6062 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.465164  1612 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:02:58.465348  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:58.465984  1611 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:58.467792  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:58.468231  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.470031  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:58.470232  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:58.470724  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.462754  1682 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.472780  1682 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.473549  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:58.474103  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:58.474359  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:58.474992  1611 raft_consensus.cc:2393] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:58.472705  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:58.476125  1614 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.476747  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.480821  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:58.481958  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:58.444474  5873 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:58.453310  5658 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:58.487241  1654 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:58.508883  1685 raft_consensus.cc:2368] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:02:58.511916  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.490795  1534 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:02:58.488651  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:02:58.487459  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.517796  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.518540  6012 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.519516  6012 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:58.521441  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 5853661a3b2948fbb9b9483e9e4176a3: Aborted: Op aborted by new leader
I20260709 13:02:58.521554  1539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2193) took 1269 ms. Trace:
I20260709 13:02:58.521977  1539 rpcz_store.cc:276] 0709 13:02:57.252642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.252798 (+   156us) service_pool.cc:224] Handling call
0709 13:02:57.253163 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.188985 (+935822us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b18003f7120. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02e6b04bc 00007fd02b9fe48b 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba18455 00007fd02eb00060 00007fd02eb00bfb 00007fd02eb0b64b
0709 13:02:58.189166 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.189205 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:58.215658 (+ 26453us) log.cc:844] Serialized 26 byte log entry
0709 13:02:58.420378 (+204720us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:02:58.420411 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:58.420483 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:58.521243 (+100760us) raft_consensus.cc:1685] finished
0709 13:02:58.521263 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:58.521494 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30803,"raft.queue_time_us":83891,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":12060,"spinlock_wait_cycles":7213312,"thread_start_us":275184,"threads_started":2,"wal-append.queue_time_us":292091}
I20260709 13:02:58.520927  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.524106  6012 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:02:58.525666  5892 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:58.527338  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:58.530071  5906 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.527571  5982 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.509939  6001 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:02:58.534701  5982 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.467037  5970 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:58.535760  5970 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.537175  6062 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.538139  5970 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.452464  5967 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.538583  6034 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.539271  6062 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:58.540653  5976 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:58.546203  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.487011  5900 tablet_bootstrap.cc:700] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Time spent opening tablet: real 0.191s	user 0.001s	sys 0.001s
I20260709 13:02:58.467343  5765 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:58.554484  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:58.465410  5904 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:58.559037  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:58.485512  6084 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.478796  5843 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.510893  5757 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:58.584246  5997 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.586469  5997 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:58.587198  1614 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:02:58.591310  5779 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.475584  5870 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:58.593140  5870 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.593528  5870 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:58.594239  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:58.595155  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:58.510663  6023 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.509999  5658 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:58.574258  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.576336  5765 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.599025  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:02:58.600255  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 154349us
I20260709 13:02:58.605723  1682 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:02:58.478833  5894 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.607621  1687 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 13: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:58.587528  5859 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.663822  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:58.667429  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 68488.5us
I20260709 13:02:58.669749  1616 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 14: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:58.472769  6048 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.672866  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.676378  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.677695  1682 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:02:58.584296  5757 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.658238  5658 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:02:58.684273  1504 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:38063 timed out after 1.953s (SENT) [suppressed 29 similar messages]
I20260709 13:02:58.683959  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.707489  1689 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.707465  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:58.708201  1504 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.709122  6062 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.710105  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.711091  6062 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.679061  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.711933  6062 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:02:58.685421  5828 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.819s	user 0.007s	sys 0.007s
I20260709 13:02:58.712710  1682 raft_consensus.cc:2376] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7. Re-sending same reply.
I20260709 13:02:58.713440  6001 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:58.713980  6001 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:58.714105  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.715040  1682 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:58.714834  6001 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.601632  6084 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.688778  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:58.660107  5904 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:58.676932  5997 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:02:58.687747  6048 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.733580  1689 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:02:58.706226  5859 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.711840  6036 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.685297  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.717295  1504 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.660517  5894 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:58.695039  1612 raft_consensus.cc:2410] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:02:58.743346  1689 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:02:58.747421  1504 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.682184  5757 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.758940  1687 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:02:58.742213  5894 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.762557  1504 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:02:58.770190  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 223119us
I20260709 13:02:58.775209  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.778859  1504 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:58.761853  5905 consensus_meta.cc:287] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.000s
I20260709 13:02:58.745649  5997 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:58.752265  6073 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:58.783640  1579 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.734511  6033 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.760138  6043 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.790799  1504 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.777141  5802 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.803233  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:58.804016  1539 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:58.795765  1579 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.780702  5911 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:58.813989  1579 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:02:58.781575  6075 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:58.794031  6064 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:58.795078  6048 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.785195  6045 consensus_queue.cc:1059] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:02:58.788235  5859 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:02:58.816063  5828 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:58.826149  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.822482  6073 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:58.843014  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:58.850524  1539 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:02:58.825371  5970 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:58.786543  5904 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.851768  1579 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
W20260709 13:02:58.861711  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 71026.4us
I20260709 13:02:58.862536  1504 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:58.827239  5982 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:02:58.866770  1579 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:58.844291  6073 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:58.850136  5779 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.852715  5967 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:02:58.819144  5911 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.872274  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.875478  5828 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:02:58.862274  5970 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:58.891110  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.868929  6064 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:58.870011  6034 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.891613  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.888949  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:02:58.908911  6092 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:02:58.910660  6036 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:58.902247  6084 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:58.912726  6090 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:02:58.915242  6033 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:58.881755  5896 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.876423  6045 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:58.863292  6058 consensus_queue.cc:1059] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:02:58.918000  1686 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:58.877856  5831 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:02:58.923625  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.926614  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:58.929018  5896 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:58.930740  5658 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:58.949868  5658 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:58.935348  2370 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:02:58.873405  6073 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:58.940728  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:58.942648  6064 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.892299  6083 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 13:02:58.945034  6099 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:02:58.945897  5870 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.932477  5911 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:58.952129  1682 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:58.953719  1689 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:58.860198  5997 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:58.956700  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 81078.1us
I20260709 13:02:58.966634  5831 raft_consensus.cc:3055] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:58.983676  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.986079  1689 raft_consensus.cc:2410] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:02:58.969220  5970 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:58.971069  6080 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.686s	user 0.000s	sys 0.005s
I20260709 13:02:58.926875  6045 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:58.967630  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:58.943356  5757 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:58.988399  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:58.999475  1682 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:58.990779  6030 raft_consensus.cc:3055] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:58.991328  5870 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:58.998051  1687 raft_consensus.cc:2393] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:59.003715  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.004485  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.005076  6084 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.005609  6034 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:59.006835  1613 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:59.009107  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:59.015776  1607 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:59.022943  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.024004  1615 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:58.983203  1504 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.012727  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.035620  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:59.019822  1682 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:58.984328  5831 raft_consensus.cc:740] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:02:59.042037  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58935.2us
I20260709 13:02:59.056524  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.056964  1504 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.042832  1682 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:02:59.055037  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 106126us
I20260709 13:02:59.058467  1613 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:59.060532  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:58.999150  6083 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.006194  6045 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:58.977835  6100 consensus_queue.cc:1059] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:02:59.006414  6030 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:59.073051  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.073938  1682 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:02:59.007498  6104 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:02:59.078890  1504 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.080787  6099 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:59.090420  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.093097  6099 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:59.097193  1538 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:02:59.098384  1536 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:59.099643  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.102232  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:59.104717  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:59.040247  6084 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.145591  6001 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.146281  6084 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.077385  6100 raft_consensus.cc:3055] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:02:59.148116  6100 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:59.070036  6083 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.149494  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.149209  6100 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.150439  1612 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 8: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:59.150800  6083 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:59.057605  6034 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.106813  6054 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.153375  6034 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.156177  6100 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.159373  1537 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:02:59.160533  1611 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:02:59.161379  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.162397  1684 raft_consensus.cc:2410] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:02:59.162828  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.163671  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.110694  1536 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:59.113821  5831 consensus_queue.cc:260] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.093930  6099 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.117523  1682 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:02:59.170017  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 67919.8us
W20260709 13:02:59.121395  6105 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:02:59.123752  6036 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.078369  6103 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.124615  6030 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.132798  1614 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:02:59.133329  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.137668  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.151279  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.165083  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:59.160457  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.117451  6106 consensus_queue.cc:1059] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:59.109253  6033 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:02:59.171427  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.198213  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.198010  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.198880  1537 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:59.199110  1534 raft_consensus.cc:2376] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11. Re-sending same reply.
I20260709 13:02:59.173343  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.191627  2365 raft_consensus.cc:2410] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:02:59.191838  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:59.184011  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.171454  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
W20260709 13:02:59.200857  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 140411us
I20260709 13:02:59.203872  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.204970  1534 raft_consensus.cc:2410] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:02:59.208304  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:02:59.201241  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 140571us
I20260709 13:02:59.212190  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.214258  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:59.214744  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:59.215833  1534 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.172652  6014 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:02:59.172603  6034 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:02:59.161545  5894 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.228142  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:59.233533  1537 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.205518  6084 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:59.236644  1539 raft_consensus.cc:1240] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:59.230948  5843 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.238324  5843 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.210750  6033 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:59.213269  5831 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.242415  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:59.249078  1539 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:59.215423  5896 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:02:59.249083  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:59.205036  6108 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.193634  6083 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:02:59.254191  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:59.255414  1539 raft_consensus.cc:1240] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:02:59.250368  1536 raft_consensus.cc:2393] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:02:59.196201  5757 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.232928  5982 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:02:59.252481  1689 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:02:59.228863  6034 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:59.251667  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.239163  5765 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.264569  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.267824  5894 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:59.268800  6034 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.275043  6033 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.257027  6084 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:59.264554  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:02:59.202950  6036 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.281198  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:59.284070  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.280982  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.286846  1534 raft_consensus.cc:2410] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:02:59.281992  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 78014.9us
I20260709 13:02:59.294849  6036 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:59.298024  1537 raft_consensus.cc:2410] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:02:59.299288  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 87448.4us
I20260709 13:02:59.300335  6109 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:02:59.301355  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:59.301980  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:59.304463  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:59.289016  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:59.290367  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.305665  1612 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.305282  2362 raft_consensus.cc:2393] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:02:59.306257  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.307827  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.308174  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.311445  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.311785  1504 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.317232  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:59.319212  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.287496  6048 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.309899  6014 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:02:59.362339  6077 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.082s	user 0.000s	sys 0.003s
I20260709 13:02:59.312100  6046 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:02:59.431768  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 120417us
I20260709 13:02:59.322634  6023 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:02:59.309943  5892 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.309414  5870 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.323191  6103 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:02:59.403916  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 81565.6us
W20260709 13:02:59.404155  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.450584  6083 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.451215  6083 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.446326  6046 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.420055  6036 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:02:59.406509  6078 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 1.053s	user 0.000s	sys 0.008s
I20260709 13:02:59.406905  1612 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:02:59.316195  5896 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:02:59.408493  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.408798  6001 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:59.409637  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.482395  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.329222  6118 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:02:59.320906  6019 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:02:59.310446  5894 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:02:59.353128  6084 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.288784  6108 raft_consensus.cc:3055] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:02:59.303915  6109 raft_consensus.cc:3055] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:59.460269  6062 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:59.420809  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1819) took 2250 ms. Trace:
I20260709 13:02:59.434056  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.438290  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.512077  1685 rpcz_store.cc:276] 0709 13:02:57.169941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.645904 (+475963us) service_pool.cc:224] Handling call
0709 13:02:59.364435 (+1718531us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b540015b654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:59.420730 (+ 56295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1928465280}
I20260709 13:02:59.513459  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.513856  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.514931  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.439790  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.516302  1684 raft_consensus.cc:2376] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12. Re-sending same reply.
I20260709 13:02:59.517328  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:02:59.446866  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.404407  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:59.449697  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.447849  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:02:59.436728  5970 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:02:59.475996  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:02:59.478816  1687 raft_consensus.cc:2368] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 13. Current term is 14.
I20260709 13:02:59.428609  6048 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.492537  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.523563  1690 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:59.503319  5909 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.504737  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2223) took 1047 ms. Trace:
I20260709 13:02:59.308966  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:02:59.508921  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49928.7us
I20260709 13:02:59.510298  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2422) took 1930 ms. Trace:
W20260709 13:02:59.524370  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 90088.1us
I20260709 13:02:59.463491  5982 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:59.542858  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.491408  6118 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:02:59.559742  6118 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.561215  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 786) took 1950 ms. Trace:
I20260709 13:02:59.561843  1535 rpcz_store.cc:276] 0709 13:02:57.610476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.777571 (+167095us) service_pool.cc:224] Handling call
0709 13:02:57.777875 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.339303 (+561428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.560856 (+1221553us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400400954. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:59.561129 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268973312}
I20260709 13:02:59.564850  6045 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.567277  6045 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.546139  6062 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.568462  5859 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:59.569005  5859 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.569555  5904 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:59.570250  5904 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:59.570891  6062 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:59.571135  5859 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:59.573881  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1837) took 1243 ms. Trace:
I20260709 13:02:59.574383  1683 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:02:59.574314  1686 rpcz_store.cc:276] 0709 13:02:58.330320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.331808 (+  1488us) service_pool.cc:224] Handling call
0709 13:02:59.573689 (+1241881us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54002ec7d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:59.573822 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332817280}
I20260709 13:02:59.574788  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.575094  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.575562  1690 raft_consensus.cc:2368] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:59.571405  5904 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.547278  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.545892  1532 rpcz_store.cc:276] 0709 13:02:57.579884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.751194 (+171310us) service_pool.cc:224] Handling call
0709 13:02:57.751543 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.231431 (+479888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.510039 (+1278608us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54000ca8d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:59.510237 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005102848}
I20260709 13:02:59.547465  1537 raft_consensus.cc:2393] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:59.555480  6099 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.544396  5970 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.545554  5894 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:02:59.557634  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.507306  6108 raft_consensus.cc:740] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:59.460310  6036 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.506079  6075 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.550194  1682 raft_consensus.cc:2368] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:02:59.597327  1613 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:02:59.598747  1613 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:02:59.598955  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.581410  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.522159  6023 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:59.559218  6083 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:59.550400  1540 rpcz_store.cc:276] 0709 13:02:58.456891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.469112 (+ 12221us) service_pool.cc:224] Handling call
0709 13:02:58.469401 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:02:58.469798 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:02:58.791491 (+321693us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.979549 (+188058us) log.cc:844] Serialized 14 byte log entry
0709 13:02:58.979774 (+   225us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:02:59.500385 (+520611us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b18002b26a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a
0709 13:02:59.500959 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:02:59.501172 (+   213us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:02:59.501225 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.501324 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:02:59.504316 (+  2992us) raft_consensus.cc:1685] finished
0709 13:02:59.504344 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:02:59.504541 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54659,"prepare.queue_time_us":124095,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":82,"raft.queue_time_us":127019,"raft.run_cpu_time_us":439,"raft.run_wall_time_us":38414,"spinlock_wait_cycles":26455936,"thread_start_us":360067,"threads_started":3,"wal-append.queue_time_us":165883}
I20260709 13:02:59.510389  6109 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:02:59.592495  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:59.604292  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.606084  1613 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:02:59.608513  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:59.582706  5892 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.622620  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.623803  1607 raft_consensus.cc:2393] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:02:59.586279  5904 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.614368  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:02:59.603111  6023 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:59.625195  5894 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.631039  5870 raft_consensus.cc:3055] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:59.634218  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 782) took 2077 ms. Trace:
W20260709 13:02:59.637043  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.521986  6001 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.658223  1541 rpcz_store.cc:276] 0709 13:02:57.556756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.680851 (+124095us) service_pool.cc:224] Handling call
0709 13:02:57.681137 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:58.459633 (+778496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:02:59.633985 (+1174352us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54001fca54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:02:59.634154 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789032832}
W20260709 13:02:59.658720  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44466.3us
W20260709 13:02:59.653450  1533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2432) took 1973 ms (client timeout 2046 ms). Trace:
I20260709 13:02:59.653280  2367 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:02:59.659200  2370 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46602 (request call id 433) took 1611 ms (client timeout 1886 ms). Trace:
W20260709 13:02:59.659224  1533 rpcz_store.cc:269] 0709 13:02:57.679596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:57.679982 (+   386us) service_pool.cc:224] Handling call
0709 13:02:59.647974 (+1967992us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400099a54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:59.653362 (+  5388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3611052928}
W20260709 13:02:59.659750  2370 rpcz_store.cc:269] 0709 13:02:58.038134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.058684 (+ 20550us) service_pool.cc:224] Handling call
0709 13:02:58.328568 (+269884us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b5800043e98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3eee 0000000000375939 00007fd033a571e0 00007fd033b200c4 00007fd033b20131 00007fd033ace0a0 00007fd033acd984 00007fd02d0486d4 00007fd02d048662
0709 13:02:59.649019 (+1320451us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400523354. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:02:59.649187 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124945152}
I20260709 13:02:59.594286  6034 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.675719  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.660172  5892 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:59.658025  5870 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:59.671926  6073 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.007s
W20260709 13:02:59.685132  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 96379.2us
I20260709 13:02:59.622596  5982 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.674875  6109 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.704888  6109 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.705641  6048 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.694353  6023 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.710930  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.681927  6019 consensus_queue.cc:1059] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:02:59.684015  5894 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.718863  5870 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.721467  6036 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:59.725140  6118 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.697326  6073 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.746089  2363 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:02:59.748064  6073 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.744958  6099 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.733628  1538 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:02:59.752302  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.741657  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:02:59.742268  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 148261us
I20260709 13:02:59.735741  5780 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.665647  5658 consensus_queue.cc:1059] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 13:02:59.735051  5900 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:02:59.761808  5900 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:59.758922  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:02:59.765491  5802 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:02:59.765936  5802 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:02:59.766745  5802 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:02:59.768199  2328 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.773825  6118 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.775568  5870 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:02:59.759490  5894 raft_consensus.cc:3055] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:02:59.778173  5894 raft_consensus.cc:740] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:02:59.778542  6091 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.945s	user 0.003s	sys 0.000s
I20260709 13:02:59.779230  5894 consensus_queue.cc:260] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.780738  5894 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:02:59.759272  6045 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:02:59.760802  5970 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:02:59.756203  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:02:59.782387  2370 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:02:59.759598  6133 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:02:59.781049  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:59.784873  1615 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:02:59.749351  6023 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:02:59.790349  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.791603  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.792142  1504 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.792418  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:02:59.793047  1690 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:02:59.794080  6045 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:59.794533  6030 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.781292  5658 raft_consensus.cc:3055] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:59.845958  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.848589  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:02:59.851424  2365 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:02:59.675194  6108 consensus_queue.cc:260] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.854763  1684 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:02:59.865137  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.798264  5658 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:59.866561  6118 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.867106  6046 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:02:59.867228  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 2e50d062d07e4a4eac4206ea9ec136cd: Illegal state: Replica f6eecf73c1c24b5eb268b5088a3030d4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:02:59.862480  6045 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:02:59.873504  1437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 97) took 12196 ms (client timeout 15000 ms). Trace:
I20260709 13:02:59.875506  1579 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.886518  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:02:59.876521  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 198372us
I20260709 13:02:59.876587  1682 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
W20260709 13:02:59.877878  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.879421  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.889820  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.891844  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.893482  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:02:59.896103  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.898976  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.899605  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.902211  1579 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.903873  1504 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.862466  6010 consensus_queue.cc:1059] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:02:59.908695  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.908810  1504 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.912276  6137 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:59.913041  6137 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.915405  6137 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:59.916267  6019 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.916791  6019 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.915865  6137 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:59.918565  6019 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:59.918831  6137 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.919618  6019 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:02:59.920204  5976 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:02:59.920964  6137 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:02:59.921767  5982 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:59.922230  6033 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:02:59.923290  5967 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:02:59.923629  1579 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.927968  1608 raft_consensus.cc:1240] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 7. Current term is 8. Ops: []
I20260709 13:02:59.904362  6140 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:02:59.958649  1579 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.932330  1504 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:02:59.896390  5867 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:02:59.898044  6046 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.896775  6023 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.903039  5625 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:02:59.972018  6122 log.cc:927] Time spent T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:02:59.901415  6014 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:02:59.972731  6139 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:02:59.945897  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:59.973212  6139 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:59.905599  6099 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.905267  5608 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:02:59.974136  6139 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:02:59.975607  6139 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:02:59.906332  5892 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:02:59.963398  6064 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:02:59.950291  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.965085  1579 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:02:59.974169  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.981365  1615 raft_consensus.cc:2368] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:02:59.962306  6048 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:02:59.983294  5765 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:02:59.983476  6048 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:02:59.983970  5765 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:02:59.947100  5658 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.905805  5970 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.961542  1504 leader_election.cc:400] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 13. Current term is 14.
I20260709 13:02:59.961557  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:02:59.988981  1504 leader_election.cc:403] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:02:59.962855  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:02:59.953523  5900 tablet_bootstrap.cc:492] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:02:59.937680  6045 raft_consensus.cc:2764] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:02:59.959056  5976 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:02:59.971063  6124 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:02:59.944380  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:02:59.974726  5608 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:02:59.982510  1615 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:02:59.884912  1437 rpcz_store.cc:269] 0709 13:02:47.677039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.677569 (+   530us) service_pool.cc:224] Handling call
0709 13:02:59.873409 (+12195840us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:52.623619 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:52.624430 (+   811us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:52.624493 (+    63us) write_op.cc:435] Acquired schema lock
0709 13:02:52.624535 (+    42us) tablet.cc:662] Decoding operations
0709 13:02:52.728064 (+103529us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:52.728183 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:52.728214 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:02:52.729004 (+   790us) tablet.cc:701] Row locks acquired
0709 13:02:52.729102 (+    98us) write_op.cc:260] PREPARE: finished
0709 13:02:52.729317 (+   215us) write_op.cc:270] Start()
0709 13:02:52.729488 (+   171us) write_op.cc:276] Timestamp: P: 1783602172729226 usec, L: 0
0709 13:02:52.729512 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:02:52.903472 (+173960us) log.cc:844] Serialized 3217 byte log entry
0709 13:02:53.464114 (+560642us) op_driver.cc:464] REPLICATION: finished
0709 13:02:53.560075 (+ 95961us) write_op.cc:301] APPLY: starting
0709 13:02:53.562412 (+  2337us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:53.766794 (+204382us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:53.766922 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:53.778632 (+ 11710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:53.795943 (+ 17311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 13:02:53.814184 (+ 18241us) write_op.cc:312] APPLY: finished
0709 13:02:53.814598 (+   414us) log.cc:844] Serialized 80 byte log entry
0709 13:02:53.814803 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:53.814943 (+   140us) write_op.cc:454] Released schema lock
0709 13:02:53.815001 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:53.815447 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:53.815477 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2185509,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":95586,"apply.run_cpu_time_us":13897,"apply.run_wall_time_us":255369,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37535,"num_ops":8,"prepare.queue_time_us":97955,"prepare.run_cpu_time_us":35452,"prepare.run_wall_time_us":687263,"raft.queue_time_us":34754,"raft.run_cpu_time_us":5069,"raft.run_wall_time_us":69724,"replication_time_us":734342,"thread_start_us":446176,"threads_started":4,"wal-append.queue_time_us":423532,"wal-append.run_cpu_time_us":12832,"wal-append.run_wall_time_us":1494313}]]}
I20260709 13:02:59.906133  6118 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:02:59.967669  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:02:59.961076  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47756.1us
I20260709 13:02:59.928737  6073 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:02:59.958133  5871 raft_consensus.cc:3055] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:02:59.986253  6001 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:02:59.994095  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:00.012984  1684 raft_consensus.cc:2393] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:02:59.995205  1579 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:00.015269  1579 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:00.017283  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:00.006006  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 44629.2us
I20260709 13:03:00.005998  1681 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:00.007936  1607 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:03:00.010203  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:02:59.993836  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:00.021394  1504 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:00.022361  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:48524
I20260709 13:03:00.022884  5900 ts_tablet_manager.cc:1403] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 1.993s	user 0.048s	sys 0.042s
I20260709 13:03:00.011268  6118 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.004706  5997 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 13. Current term is 14.
I20260709 13:02:59.989517  5765 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.010561  5859 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:03:00.033826  5976 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:00.034439  5970 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:00.034963  6121 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:02:59.995675  5658 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:02:59.987516  5779 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:03:00.048134  6121 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.011060  5871 raft_consensus.cc:740] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:00.038180  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:00.037452  6118 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.039253  1504 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:00.057477  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.040452  5625 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.067430  1504 leader_election.cc:400] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:03:00.043159  5967 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:00.067766  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.111186  1682 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:00.112921  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:00.041462  6001 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.043000  6137 consensus_queue.cc:1059] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:03:00.121820  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 83785.3us
I20260709 13:03:00.122735  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:00.106293  5967 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:00.124851  5967 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:00.051620  5608 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:00.127763  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.102562  6127 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:00.103612  5997 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:00.130122  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:00.132326  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:00.134632  2367 raft_consensus.cc:2376] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15. Re-sending same reply.
I20260709 13:03:00.103281  1504 leader_election.cc:403] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:03:00.137015  6045 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.140187  6125 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:03:00.141995  6108 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:00.147491  6045 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
W20260709 13:03:00.149852  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.053584  6121 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.048612  6129 consensus_queue.cc:1059] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
W20260709 13:03:00.155884  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 69614us
I20260709 13:03:00.060511  5859 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:03:00.126039  6147 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:00.152905  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:00.149710  6014 consensus_queue.cc:1059] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:03:00.156193  6001 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.129076  5970 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:03:00.173869  1504 leader_election.cc:400] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:03:00.178691  1504 leader_election.cc:403] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:03:00.159080  6148 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.182423  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:00.185261  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.177429  5765 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.186916  5904 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.002s
I20260709 13:03:00.189251  6154 tablet_replica.cc:333] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:00.185058  6023 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:00.185783  1504 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:00.196344  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:00.217504  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.218220  1540 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:00.197645  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:00.199296  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.200121  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.219764  1534 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:00.200448  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.203218  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:00.203989  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:00.214519  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:00.221196  1607 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:00.224287  1607 raft_consensus.cc:1240] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:00.225590  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.220618  1615 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:00.228394  1537 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:03:00.230010  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:00.231204  5894 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:00.231988  5894 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.232472  5894 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.233906  5896 consensus_queue.cc:1059] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:00.235694  5896 raft_consensus.cc:3055] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:00.236146  5896 raft_consensus.cc:740] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:00.237275  5896 consensus_queue.cc:260] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.238688  5896 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.241089  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:00.195675  5997 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:03:00.152063  6127 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.241709  1537 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:03:00.243273  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 57582.3us
I20260709 13:03:00.247223  1654 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:00.244306  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.201481  5867 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:00.201233  6075 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:00.252655  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:00.253014  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.257378  1684 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:00.253911  1686 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:03:00.260270  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.242463  6023 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.261462  1540 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
W20260709 13:03:00.263269  6109 consensus_meta.cc:287] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.001s
I20260709 13:03:00.212808  5765 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.266424  5765 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.273269  2370 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:00.180227  6001 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.280295  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:00.194949  5900 raft_consensus.cc:359] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351 [term 9 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.289288  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:00.292165  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.294759  1540 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 14: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:00.250411  6043 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:00.262001  6023 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:00.257594  6014 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:00.283104  5909 consensus_meta.cc:287] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.003s
I20260709 13:03:00.317853  5828 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.318457  5828 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:00.296294  6111 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:00.281586  6139 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.321908  6014 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.280284  6001 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.292024  6148 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:00.338128  1533 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:00.359297  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:03:00.359441  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.368638  1533 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:03:00.371975  1533 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:00.327008  6062 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.343640  6014 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.395464  1537 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:00.395951  5892 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:00.343397  6139 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.399258  6139 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.374045  5894 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.405968  1688 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:03:00.407629  1611 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57944 (request call id 696) took 1395 ms (client timeout 1719 ms). Trace:
I20260709 13:03:00.408836  1614 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:03:00.408124  1611 rpcz_store.cc:269] 0709 13:02:59.012650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.035326 (+ 22676us) service_pool.cc:224] Handling call
0709 13:03:00.407442 (+1372116us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003a1bd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:00.407570 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284922752}
I20260709 13:03:00.379365  6062 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.412966  6148 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:00.400748  6127 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.390722  5843 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.401948  5900 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:00.421092  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:00.419399  6161 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:03:00.424122  5967 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:00.441987  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.463702  1533 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:03:00.464278  1533 pending_rounds.cc:85] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 6
I20260709 13:03:00.464547  1533 pending_rounds.cc:107] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:03:00.464828  1533 raft_consensus.cc:2889] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:00.422752  6048 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:00.481735  2363 consensus_queue.cc:237] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.467341  6108 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.502645  6164 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:03:00.503098  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet a93cfc3bb7634fb1b78c60f120616d9d with delete_type TABLET_DATA_TOMBSTONED (TS c98c328741aa493d87abafbf08f04944 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:57272
I20260709 13:03:00.425349  6148 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.482702  6048 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:00.529733  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.490692  6108 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.549749  6023 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.553196  5894 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.554104  6121 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.562105  6121 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.534894  5967 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:00.522583  6084 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:00.563309  6084 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.565912  6084 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.481417  5900 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:03:00.567811  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.569855  5900 ts_tablet_manager.cc:1434] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.529s	user 0.010s	sys 0.003s
I20260709 13:03:00.569990  6108 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:00.570415  5900 ts_tablet_manager.cc:1467] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Tablet startup took 533ms
I20260709 13:03:00.557937  6014 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:00.524658  6157 log.cc:927] Time spent T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.148s	user 0.000s	sys 0.005s
I20260709 13:03:00.574581  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:00.577874  1685 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:03:00.579455  2328 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:00.577159  6084 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:03:00.585979  6158 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:03:00.580550  6033 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:03:00.587733  6174 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:03:00.588708  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.591517  6014 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.591708  6179 tablet_replica.cc:333] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:00.601244  6084 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.608024  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1929) took 2134 ms. Trace:
I20260709 13:03:00.609112  6084 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:00.608690  1609 rpcz_store.cc:276] 0709 13:02:58.474030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:58.477329 (+  3299us) service_pool.cc:224] Handling call
0709 13:02:58.477702 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:02:58.478088 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:58.478122 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:02:59.602751 (+1124629us) spinlock_profiling.cc:243] Waited 9.91 ms on lock 0x7b180037b580. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a
0709 13:03:00.368181 (+765430us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b2c0000e5c8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:03:00.379225 (+ 11044us) log.cc:844] Serialized 52 byte log entry
0709 13:03:00.422543 (+ 43318us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:00.422575 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.422658 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:00.607726 (+185068us) raft_consensus.cc:1685] finished
0709 13:03:00.607763 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.607939 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":468,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":24491,"spinlock_wait_cycles":26038912,"thread_start_us":33060,"threads_started":1,"wal-append.queue_time_us":107633}
W20260709 13:03:00.610334  6175 log.cc:927] Time spent T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 13:03:00.611282  6176 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.055s	user 0.004s	sys 0.000s
I20260709 13:03:00.576826  6121 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.584228  6150 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:00.624825  6150 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:00.624565  6121 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.624747  6154 raft_consensus.cc:2243] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.625388  6150 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.626252  6154 raft_consensus.cc:2272] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.627409  6121 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.599047  6034 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.617143  1653 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:00.620244  5871 consensus_queue.cc:260] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.629273  5608 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:00.621883  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2446) took 1021 ms. Trace:
I20260709 13:03:00.621507  2329 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:00.630851  1616 rpcz_store.cc:276] 0709 13:02:59.599990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.600135 (+   145us) service_pool.cc:224] Handling call
0709 13:02:59.600457 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:02:59.626906 (+ 26449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:02:59.626952 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:02:59.627006 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:02:59.627049 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:00.621591 (+994542us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b54003f8254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:00.621656 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:00.621820 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60307840}
I20260709 13:03:00.633721  5737 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:00.634145  5737 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:00.634414  5737 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.603055  6033 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:00.630107  6023 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.639349  5625 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:00.648540  5625 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:03:00.640182  6118 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.535s	user 0.013s	sys 0.005s
I20260709 13:03:00.652827  6033 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.655859  6033 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.652294  6154 ts_tablet_manager.cc:1916] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:00.662199  5625 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.670992  5737 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.650936  6118 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.664582  6048 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.675357  5737 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.673202  6125 raft_consensus.cc:3055] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:00.676710  6150 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:00.570758  5900 ts_tablet_manager.cc:1469] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Trace:
0709 13:02:53.158770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:53.158963 (+   193us) service_pool.cc:224] Handling call
0709 13:02:53.458082 (+299119us) ts_tablet_manager.cc:934] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
0709 13:02:54.956523 (+1498441us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:02:55.813003 (+856480us) tablet_metadata.cc:665] Metadata flushed
0709 13:02:55.827543 (+ 14540us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:02:56.280497 (+452954us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:02:56.280855 (+   358us) tablet_replica.cc:206] Creating consensus instance
0709 13:02:56.281239 (+   384us) ts_tablet_manager.cc:989] Replica registered.
0709 13:02:56.281416 (+   177us) inbound_call.cc:177] Queueing success response
0709 13:02:58.029808 (+1748392us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:03:00.040515 (+2010707us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:03:00.191811 (+151296us) tablet_replica.cc:261] Starting instrumentation
0709 13:03:00.192646 (+   835us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":63880,"raft.queue_time_us":3675,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":133,"tablet-copy.queue_time_us":237129,"tablet-download-pool.queue_time_us":2469,"tablet-download-pool.run_cpu_time_us":1786,"tablet-download-pool.run_wall_time_us":598828,"thread_start_us":214227,"threads_started":2}
I20260709 13:03:00.684363  6148 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:00.682372  6125 raft_consensus.cc:740] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:00.686757  6062 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.686612  6125 consensus_queue.cc:260] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.690356  6150 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.690999  6118 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.691411  6125 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:00.621148  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet f09947f1336f47c4b5bffef2326f83ee: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:03:00.749440  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.750209  1608 raft_consensus.cc:2368] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:03:00.771261  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:00.774521  1689 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:00.779237  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-5853661a3b2948fbb9b9483e9e4176a3 received from {username='slave'} at 127.0.0.1:35722
I20260709 13:03:00.784017  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-5853661a3b2948fbb9b9483e9e4176a3 on tablet 5853661a3b2948fbb9b9483e9e4176a3 with peer 9d926c10b90f452ba52d80dab6a50351
W20260709 13:03:00.808736  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 403590us
I20260709 13:03:00.810117  2370 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:00.811513  5871 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:00.816672  6150 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.812553  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 554544us
I20260709 13:03:00.818100  6043 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:00.799717  5828 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.818123  6150 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.811590  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:00.836933  6062 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:00.837188  1537 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:00.827564  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.838310  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:00.851276  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:00.867724  5625 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.869531  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 23137a56fb91492eb22faa7c97ee9aec: Illegal state: Replica f6eecf73c1c24b5eb268b5088a3030d4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:00.869083  5625 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.870352  6150 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:00.869095  6075 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:00.883610  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.850648  6043 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:00.889945  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 59836us
I20260709 13:03:00.891146  1536 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:00.891535  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:00.890911  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.893908  6103 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:00.894831  6103 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:00.895861  5828 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.867787  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:00.897540  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:00.897766  5828 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:00.898871  1614 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:00.899045  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.886330  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.894635  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:00.889523  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:00.869575  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:00.863636  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:00.906176  1615 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
W20260709 13:03:00.913790  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.914748  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:00.916389  1610 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:00.920621  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.922251  6075 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.925058  1536 raft_consensus.cc:1240] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:00.926896  6152 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.064s	user 0.000s	sys 0.004s
I20260709 13:03:00.858088  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:00.900239  1537 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:00.927134  1616 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:00.942396  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.943547  2370 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 14: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
W20260709 13:03:00.947515  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.958905  1539 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:03:00.961282  6162 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:00.961649  5843 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.962955  5843 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.964636  1611 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:00.964754  6147 raft_consensus.cc:3055] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:00.965778  6148 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:00.966763  6148 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:00.965472  6147 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:00.968655  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:00.986263  5625 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.989094  5843 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.990047  5828 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:00.998123  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.994068  6162 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:00.999038  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:00.992218  5802 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:01.005615  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.006665  1688 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
I20260709 13:03:00.992378  6148 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:00.992477  6100 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:01.040419  6162 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.063894  6100 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.070066  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.066359  1538 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
W20260709 13:03:01.074971  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 55959.5us
W20260709 13:03:01.075073  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 180826us
I20260709 13:03:01.077704  6133 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:01.078261  6133 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.078667  6133 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:01.078667  5608 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.080902  5608 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:01.083617  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.084292  6062 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.085011  6062 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.098083  1689 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:03:01.100847  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.102805  1681 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 8.
I20260709 13:03:01.076318  6100 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:01.096553  5608 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.115202  2328 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.119648  5966 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:01.120514  5966 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:01.151603  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:01.131506  5966 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:01.162554  6033 consensus_meta.cc:287] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.021s
I20260709 13:03:01.174012  1539 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:01.176441  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:01.180940  6048 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:01.182307  6048 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.184612  6133 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.186043  1613 raft_consensus.cc:1275] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:01.189610  6048 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:01.190762  6185 log.cc:927] Time spent T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 13:03:01.196245  6162 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.176939  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:01.203799  1612 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:01.206193  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:01.208149  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:01.208779  1611 raft_consensus.cc:2410] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:01.209189  1609 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:03:01.213260  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:01.189766  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:01.230538  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:01.232004  1610 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:01.245549  1613 raft_consensus.cc:2410] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:03:01.243271  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 86059.5us
I20260709 13:03:01.258270  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:01.236452  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 123398us
I20260709 13:03:01.240058  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:01.240775  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:01.187163  6133 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.247217  1616 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:03:01.293133  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.232391  6062 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.295270  1614 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:01.234792  5997 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.308094  6115 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:01.310943  5976 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:01.313391  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:01.319347  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.318717  6148 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.338635  6062 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:01.363328  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:01.364429  1681 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:03:01.369779  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.354321  6133 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:01.362772  5871 consensus_meta.cc:287] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.005s
I20260709 13:03:01.380486  1612 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:03:01.389181  6133 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.390380  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.391458  1690 raft_consensus.cc:2393] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:03:01.396265  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 83164.5us
I20260709 13:03:01.340833  5976 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:01.392120  6188 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
W20260709 13:03:01.392215  6186 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.208s	user 0.004s	sys 0.000s
I20260709 13:03:01.413259  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:01.413403  1439 catalog_manager.cc:5697] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:01.424333  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:01.424990  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:01.428619  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:01.429731  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:01.430603  1535 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:01.425398  1534 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:01.395012  6148 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.430285  6103 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.415226  1439 catalog_manager.cc:5697] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:01.387015  6150 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:03:01.449348  1533 raft_consensus.cc:2410] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:01.452068  6135 consensus_queue.cc:1048] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:01.454475  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:03:01.456085  6189 log.cc:927] Time spent T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:03:01.456571  6187 log.cc:927] Time spent T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.300s	user 0.002s	sys 0.000s
I20260709 13:03:01.424369  5997 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:01.446334  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:03:01.462157  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.416818  6133 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.468577  1690 raft_consensus.cc:1240] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:01.467798  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:01.454502  6184 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.421s	user 0.006s	sys 0.001s
I20260709 13:03:01.461015  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.476866  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:01.470849  5871 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.481033  5658 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.481622  5871 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:01.482596  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 86549.5us
I20260709 13:03:01.481726  5658 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.484784  5871 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.486915  5658 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:01.481288  1439 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 8 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:01.465420  6103 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.489069  1439 catalog_manager.cc:5697] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 7, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.492892  1538 raft_consensus.cc:2410] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:03:01.493112  1439 catalog_manager.cc:5697] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 8 to 11, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:01.494407  6147 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.495713  6147 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:01.497695  1439 catalog_manager.cc:5697] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
W20260709 13:03:01.504077  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 150326us
I20260709 13:03:01.512243  1681 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 15.
I20260709 13:03:01.504891  5997 raft_consensus.cc:697] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:01.508492  5658 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:01.508137  6148 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.525563  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:01.522917  1690 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:03:01.527798  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.519721  6073 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.524243  5658 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:01.531906  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 80968.6us
W20260709 13:03:01.539083  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.544638  1689 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:01.549418  1438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 171) took 32490 ms (client timeout 15000 ms). Trace:
I20260709 13:03:01.548895  5997 consensus_queue.cc:237] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.538689  5658 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.553493  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:01.554021  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:01.554920  6148 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:01.556684  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.557189  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.554971  1688 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:01.544158  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.530936  5802 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:01.558172  1685 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:01.575479  6045 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:01.576162  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 135076us
I20260709 13:03:01.577297  1505 leader_election.cc:400] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:03:01.546042  5871 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.579625  5871 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.582023  6046 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:01.582716  5871 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.586748  5976 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.586923  5625 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.597524  5625 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.586802  5608 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.600907  5608 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.603502  5608 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:03:01.587996  6148 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.604429  6148 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.607460  6148 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:01.549996  1438 rpcz_store.cc:269] 0709 13:02:29.058280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:29.165154 (+106874us) service_pool.cc:224] Handling call
0709 13:03:01.549054 (+32383900us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:48.536066 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:48.536646 (+   580us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:48.536683 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:02:48.536700 (+    17us) tablet.cc:662] Decoding operations
0709 13:02:48.538315 (+  1615us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:48.538400 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:48.538428 (+    28us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:02:48.569246 (+ 30818us) tablet.cc:701] Row locks acquired
0709 13:02:48.569267 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:02:48.588575 (+ 19308us) write_op.cc:270] Start()
0709 13:02:48.588714 (+   139us) write_op.cc:276] Timestamp: P: 1783602168588492 usec, L: 0
0709 13:02:48.588736 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:02:48.834384 (+245648us) log.cc:844] Serialized 8297 byte log entry
0709 13:02:49.433266 (+598882us) op_driver.cc:464] REPLICATION: finished
0709 13:02:49.671426 (+238160us) write_op.cc:301] APPLY: starting
0709 13:02:49.673714 (+  2288us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:49.828594 (+154880us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:49.828708 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:50.398127 (+569419us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:50.398843 (+   716us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=0,mrs_lookups=0
0709 13:02:50.398956 (+   113us) write_op.cc:312] APPLY: finished
0709 13:02:50.400022 (+  1066us) log.cc:844] Serialized 187 byte log entry
0709 13:02:50.416425 (+ 16403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.417382 (+   957us) write_op.cc:454] Released schema lock
0709 13:02:50.417504 (+   122us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:50.513538 (+ 96034us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:50.513592 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2818901,"reported_tablets":52,"spinlock_wait_cycles":151296,"child_traces":[["op",{"apply.queue_time_us":237869,"apply.run_cpu_time_us":45787,"apply.run_wall_time_us":841738,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91823,"num_ops":21,"prepare.queue_time_us":120758,"prepare.run_cpu_time_us":59389,"prepare.run_wall_time_us":498856,"raft.queue_time_us":296104,"raft.run_cpu_time_us":34634,"raft.run_wall_time_us":181923,"replication_time_us":844359,"thread_start_us":541550,"threads_started":5,"wal-append.queue_time_us":313568,"wal-append.run_cpu_time_us":35149,"wal-append.run_wall_time_us":2361713}]]}
I20260709 13:03:01.591006  6045 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:01.612373  5802 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.593040  1505 leader_election.cc:400] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:03:01.617691  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.618654  1685 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:01.593464  6046 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:01.621299  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:01.621938  2328 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.624187  1610 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:03:01.624701  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.625312  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.625567  6148 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:01.594312  6103 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:01.575798  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:01.628158  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.630822  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:01.538717  6073 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.627171  6148 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.632200  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:01.632817  1612 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 14.
I20260709 13:03:01.633250  6073 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.622139  1683 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:01.633919  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:01.634465  1614 raft_consensus.cc:3060] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:01.617518  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.631529  1613 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:01.638242  1610 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:01.625720  6115 raft_consensus.cc:2804] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:01.640300  1690 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:03:01.640452  6115 raft_consensus.cc:697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 15 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:01.642526  6115 consensus_queue.cc:237] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.641999  1439 catalog_manager.cc:5697] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:01.600114  6154 ts_tablet_manager.cc:1929] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:03:01.645044  6154 log.cc:1199] T 7d86302e0fce4e1585ef0f1cbc65dc7a P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/7d86302e0fce4e1585ef0f1cbc65dc7a
I20260709 13:03:01.647073  6154 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48524 (request call id 1) took 1733 ms. Trace:
I20260709 13:03:01.599826  5625 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:01.647961  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 94604.6us
I20260709 13:03:01.656965  1688 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:01.674966  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.679792  2370 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:01.680925  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:01.681829  2367 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:01.684952  1687 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:01.686693  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.690852  6073 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:01.691802  6073 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.694952  6073 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.696118  6148 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:01.700614  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.708091  6148 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:01.710955  6148 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.709784  5658 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.715673  5658 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.717139  6148 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.718111  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.731560  1685 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:01.702489  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.722203  1683 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:03:01.724941  6109 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:01.734972  6109 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:01.737884  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:01.739037  1538 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:03:01.739609  2329 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:01.726605  5802 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:01.753136  5802 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:03:01.729038  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 58525.5us
I20260709 13:03:01.725109  2363 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:01.743975  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:01.748448  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:01.749382  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:01.740303  6147 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:01.741447  6109 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.745335  1690 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:01.755594  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.778616  2367 raft_consensus.cc:2393] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:01.687661  1687 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:01.763242  1614 raft_consensus.cc:2468] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 15.
I20260709 13:03:01.770627  5828 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.780339  5828 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.785277  1689 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
W20260709 13:03:01.773869  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 196521us
I20260709 13:03:01.776537  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:01.647827  6154 rpcz_store.cc:276] 0709 13:02:59.914045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.923816 (+  9771us) service_pool.cc:224] Handling call
0709 13:03:00.188771 (+264955us) ts_tablet_manager.cc:1151] Deleting tablet 7d86302e0fce4e1585ef0f1cbc65dc7a
0709 13:03:00.188892 (+   121us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:00.696925 (+508033us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:01.500631 (+803706us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:01.646925 (+146294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":371938,"tablet-delete.queue_time_us":130856,"thread_start_us":118445,"threads_started":1}
I20260709 13:03:01.678171  1439 catalog_manager.cc:5697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.790555  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:01.794920  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 135057us
I20260709 13:03:01.794337  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:01.753760  5802 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.796183  1684 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:03:01.798489  5625 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:01.802131  5625 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.802554  5625 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:01.803143  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:01.794673  6148 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:03:01.809710  1504 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.811048  1504 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.787586  6048 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:01.798825  6103 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:01.811889  6103 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:01.812084  6048 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:01.812366  6103 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:01.808360  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 68840.5us
I20260709 13:03:01.813032  6147 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.817382  1609 raft_consensus.cc:2393] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:01.799122  6109 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:01.818496  6109 raft_consensus.cc:697] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:01.819551  6109 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:01.804715  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49469.3us
I20260709 13:03:01.804454  6179 raft_consensus.cc:2243] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.792517  5658 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:01.805311  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:01.834208  6162 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:01.828914  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:01.835321  6046 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:01.772531  6125 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.840099  2328 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.843801  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:01.839339  6062 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:01.890386  6062 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.890880  6062 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:01.840569  6045 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:01.858793  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:01.861848  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.832324  6073 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:01.853477  1579 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:01.841989  6147 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:01.889174  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 83952.6us
I20260709 13:03:01.889853  1682 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:01.898614  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58651.7us
I20260709 13:03:01.904834  1439 catalog_manager.cc:5697] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.863232  6148 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:03:01.916831  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 91890.4us
I20260709 13:03:01.901602  6045 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.872372  5658 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.932574  1538 raft_consensus.cc:2393] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:03:01.929416  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 95361.9us
I20260709 13:03:01.928445  6045 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:01.933696  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 90023.9us
I20260709 13:03:01.910102  5997 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:01.939843  1684 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:01.942556  1439 catalog_manager.cc:5697] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:01.926506  5802 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.910516  6125 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.940434  6073 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:01.946419  6203 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:01.946496  6119 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:01.947453  5828 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.988391  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet 7d86302e0fce4e1585ef0f1cbc65dc7a (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:01.947793  6148 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:01.989956  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 49138.5us
I20260709 13:03:01.992873  1580 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:01.993659  6033 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:03:01.994324  5997 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:01.952082  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:01.973469  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:01.968220  1654 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:01.966955  5658 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:01.957561  6215 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:03:01.971128  5625 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.026413  1439 catalog_manager.cc:5697] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:02.026898  6199 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:02.027335  6045 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.028337  6216 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:02.001080  6046 consensus_queue.cc:1243] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:02.031644  6125 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.033164  5608 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.002843  5802 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:02.037397  6062 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.041900  6073 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:01.972339  6163 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:01.962035  6179 raft_consensus.cc:2272] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.946835  5737 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:01.976308  6201 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:03:02.064435  1424 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 76308.3us
I20260709 13:03:02.044605  6048 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.044858  6119 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.973778  6103 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.067811  5658 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:02.093837  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.088433  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.068511  5828 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:02.080663  6163 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.082440  6201 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.109915  6163 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.082399  5737 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:02.084237  6203 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:02.091667  6119 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.086557  6046 raft_consensus.cc:476] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 13:03:02.087973  5608 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.119100  6208 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.129426  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:02.134699  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 166674us
I20260709 13:03:02.135982  6045 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.116406  5737 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.136548  1541 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:02.124698  6046 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.137154  6203 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.140122  6218 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:02.180588  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 235732us
I20260709 13:03:02.087750  5802 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.087128  6217 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:03:02.115034  6201 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.144888  1609 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:03:02.108165  6048 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.213045  5997 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.193136  1608 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.185364  6208 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.192175   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:02.196132  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 67773.7us
I20260709 13:03:02.197994  6203 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:02.198325  5608 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:02.193634  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 220220us
I20260709 13:03:02.198837  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:02.238749  2367 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.240918  6162 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:02.241351  6162 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:02.242272  6162 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.187383  6046 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.243455  6162 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:02.244737  6046 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:02.245529  6048 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.245741  1684 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:02.246795  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.247653  1689 raft_consensus.cc:2410] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:03:02.248129  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:02.248633  1683 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.202237  6103 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:02.255088  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.255940  1683 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
I20260709 13:03:02.256984  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.257143  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.257613  1686 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:02.258193  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:02.258733  1683 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.259029  1686 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:02.261224  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:02.259475  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.261147  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.264390  1687 raft_consensus.cc:2393] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:02.265334  1683 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:02.266711  2367 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:02.267552  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.268100  1688 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:02.255813  1685 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:02.218781  6179 ts_tablet_manager.cc:1916] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:02.187130  5625 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:02.228783  6062 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.095875  6216 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.271934  6216 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.234211  6217 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.276772  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 148377us
W20260709 13:03:02.307232  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 108468us
I20260709 13:03:02.313377  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.313088  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.205089  6215 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:02.319279  1535 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:03:02.315057  1653 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:02.322402  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 84974.9us
W20260709 13:03:02.325189  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.276012  6045 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.333693  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:02.324698  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 181460us
I20260709 13:03:02.309264  6148 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:02.340880  1535 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:02.319312  6223 raft_consensus.cc:3055] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:02.312811  6225 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.312521  5608 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.326833  6103 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.348299  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.347345  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.347748  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.359185  1609 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:02.362931  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:03:02.365247  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.359256  1608 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:02.368556  6223 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:02.375208  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:02.375579  1538 raft_consensus.cc:2393] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 14: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:02.335053  6147 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.316944  6217 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:02.394315  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 54388.4us
I20260709 13:03:02.398980  1688 raft_consensus.cc:1275] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:02.400233  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:02.400982  1538 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:02.400527  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 178892us
I20260709 13:03:02.402629  6203 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:02.414659  6203 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.415138  6203 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.415406  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.416342  1533 raft_consensus.cc:2393] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 5: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:02.417973  6208 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.350508  6215 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.420480  6237 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:02.390349  6224 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:03:02.422693  6224 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:02.423079  6224 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:02.423991  6224 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.339646  6045 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.369648  6202 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:03:02.338384  6150 consensus_queue.cc:1059] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:03:02.408069  1439 catalog_manager.cc:5697] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 5 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:02.382380  5658 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:02.430980  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 116041us
I20260709 13:03:02.392742  6148 raft_consensus.cc:2804] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:02.434342  6148 raft_consensus.cc:697] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:02.435253  5802 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.381083  6103 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.435350  6148 consensus_queue.cc:237] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.437708  6103 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:02.438162  6220 log.cc:927] Time spent T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.230s	user 0.001s	sys 0.003s
I20260709 13:03:02.439647  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:02.337301  6048 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 13:03:02.444234  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 85513.5us
I20260709 13:03:02.381392  6062 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:03:02.445340  1504 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:02.420432  6215 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.442801  1579 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:02.381266  5608 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.453892  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:02.446350  1439 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 11, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:02.398876  6147 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.446429  6224 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.462052  6115 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 4 to 9, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:02.463629  6227 log.cc:927] Time spent T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:03:02.464073  6204 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.497478  6204 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.458178  6233 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.498487  6119 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.499545  6233 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.501994  6233 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:02.467968  5608 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:02.468717  6222 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:02.469508  5737 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.445719  5658 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:02.471068  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 78737.2us
I20260709 13:03:02.472575  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:02.473302  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.473968  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:02.476367  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.476501  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:02.477303  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:02.478006  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.478860  6045 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.480214  6215 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:02.438906  6203 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.399798  6225 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.503993  6073 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:02.525027  6073 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:02.525925  6073 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.527014  6073 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.528066  6045 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:02.461612  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:02.488292  1439 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 6 to 7, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:02.529342  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 67835.4us
I20260709 13:03:02.529956  6062 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:02.530409  6062 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.530774  6062 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.530031  1439 catalog_manager.cc:5697] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 1 to 7. New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:02.531405  1504 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:02.532366  5997 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:02.531723  1439 catalog_manager.cc:5697] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 9 to 11, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.534543  6201 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.537163  6201 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:02.529399  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 63179.6us
I20260709 13:03:02.509402  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:02.511983  1537 raft_consensus.cc:2393] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 8: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:02.571087  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:02.512570  1540 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:02.512303  1533 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
W20260709 13:03:02.524353  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 78296.8us
I20260709 13:03:02.518873  1539 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:02.557917  1538 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:02.580963  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:02.535562  1439 catalog_manager.cc:5697] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:02.585054  1534 raft_consensus.cc:2393] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:02.585312  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:02.588387  1535 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.580983  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.591199  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:02.591238  1682 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:02.508388  6216 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.517815  1579 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:02.612454  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 125678us
I20260709 13:03:02.613215  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:02.613384  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.600708  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.607290  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:02.614032  1684 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:02.614446  1608 raft_consensus.cc:3060] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:02.615371  6207 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:02.616086  6207 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:02.617175  6207 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.508333  5658 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:02.610690  1614 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:02.621912  1684 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:02.625247  1682 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:03:02.626940  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.627465  1608 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:03:02.627871  1684 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:02.620296  6222 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:02.629297  6222 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:02.630606  6222 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.633148  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.636704  1579 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:02.639115  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.639362  6202 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:02.640268  6202 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:02.642119  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.641739  6202 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.646380  1684 raft_consensus.cc:2393] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 15: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:03:02.647954  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.649088  1689 raft_consensus.cc:2468] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:02.509704  6119 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:02.515897  6218 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.512229  6208 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:02.563355  6046 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:02.517135  6217 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.522691  6147 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:02.656977  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.560457  6237 consensus_queue.cc:1048] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.121s
I20260709 13:03:02.657668  6201 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:02.506656  5737 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.662523  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.707226  1685 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:02.662240  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:02.707695  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:02.495747  6163 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.589636  5997 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:02.679570  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.707872  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:02.504312  1536 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 4 to 9, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:02.519939  6225 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:02.680756  1689 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:02.517508  6203 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.522778  6150 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 13:03:02.728734  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:02.515407  6215 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 15 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:02.723587  6048 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:02.667811  6208 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:02.735142  6208 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:02.712788  1687 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:02.722138  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:02.596522  6233 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:02.656481  6216 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.712379  5997 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:02.700951  6217 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.712407  6204 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.763742  1686 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:02.777662  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:02.774068  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:02.738103  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 228793us
I20260709 13:03:02.768088  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.768949  6135 raft_consensus.cc:3055] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:02.505368  6223 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:02.771289  1641 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:33773 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:33773 timed out after 15.000s (SENT)
I20260709 13:03:02.729739  5658 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:02.784749  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 175131us
I20260709 13:03:02.782521  1687 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:02.763548  6207 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:02.806051  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 98315.4us
I20260709 13:03:02.781185  6046 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:02.778142  6203 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:02.813181  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:02.778990  5997 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:02.815395  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.818003  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:02.784468  6135 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:02.768129  6236 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:02.804962  6148 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:02.828779  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:02.773520  6233 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:02.837065  6246 log.cc:927] Time spent T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:03:02.841348  1687 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:02.841357  1685 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:03:02.840682  6207 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.873389  6207 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.874912  6225 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.875569  6225 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.789505  6217 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:02.887182  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.777567  6048 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.852294  6243 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:02.859787  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 197656us
W20260709 13:03:02.862403  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.896370  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:02.883565  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:02.846290  1535 raft_consensus.cc:2468] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
W20260709 13:03:02.899730  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 86640.9us
I20260709 13:03:02.900398  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.902794  6203 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:02.895676  6198 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:02.927201  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:02.927920  1690 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
I20260709 13:03:02.940114  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:02.897855  6215 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.920235  6135 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.945955  6135 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:02.858487  6236 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.954048  6103 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:02.954535  6103 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:02.940100  6198 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:02.958498  6198 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:02.959585  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:02.960170  6219 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:02.962296  6248 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:03:02.967118  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.967293  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.968113  1613 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:02.968214  6125 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:02.969110  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:02.970453  6240 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:03:02.970527  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.972820  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:02.973284  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:02.973767  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 145187us
I20260709 13:03:02.973444  1609 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:02.973896  6062 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:02.976329  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:02.968787  6125 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.978015  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.980953  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.955384  6103 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:02.983292  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.985167  1610 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:02.988797  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.989375  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.990061  1610 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:03:02.952994  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43382 (request call id 3) took 3162 ms. Trace:
I20260709 13:03:02.994922  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:02.951786  6203 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:02.998967  1615 raft_consensus.cc:2410] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:02.981532  6148 raft_consensus.cc:2764] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:03.005239  6048 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.008419  6216 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.008699  6236 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.008944  5625 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:03.010146  6254 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:03.010087  6203 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.010432  1687 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:02.941747  6046 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.018291  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:03.047030  1615 raft_consensus.cc:2410] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:02.985730  6163 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:02.980255  6219 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 13:03:03.051079  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 111092us
I20260709 13:03:03.001444  6103 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:03.049410  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.052028  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:03.052412  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:03.056461  1610 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:03:03.058665  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.060946  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:03.061877  1613 raft_consensus.cc:2410] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:03:03.063534  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.066517  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:03.067289  1616 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:03:03.054453  6236 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.997488  6115 rpcz_store.cc:276] 0709 13:02:59.777650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:59.777853 (+   203us) service_pool.cc:224] Handling call
0709 13:03:00.480415 (+702562us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b58006f56d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea640aa 00007fd02eae6447 00007fd02eb0370a 00007fd02eb0476a 00007fd02eb0391b 00007fd02eb0f03c 00007fd02eb0e6b3 00007fd02eb069fa 00007fd033ace4c9 00007fd02d04ac54
0709 13:03:00.493924 (+ 13509us) log.cc:844] Serialized 501 byte log entry
0709 13:03:00.634754 (+140830us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b1800499de0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9e92a6 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7ddbe 00007fd02ea88930 00007fd02ea888d8
0709 13:03:00.649221 (+ 14467us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b5400511e20. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7ddbe 00007fd02ea88930 00007fd02ea888d8 00007fd02ea88858 00007fd02ea88813 00007fd02ea87a9c 00007fd034973626 00007fd03496ddd8 00007fd02eac47cb 00007fd02eac72c0
0709 13:03:00.675300 (+ 26079us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5400511e20. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea88b26 00007fd02ea8249a 00007fd02ea81714 00007fd02ea61eaa 00007fd02ea68d53 00007fd02ea68cd9 00007fd02ea68c69 00007fd02ea68c31 00007fd02ea67dfd 000000000038f354
0709 13:03:00.889191 (+213891us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b1800499de0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02ba1b522 00007fd02ba1d7c1 00007fd02ba1d779 00007fd02ba1d709 00007fd02ba1d6d1 00007fd02ba1c9cd 000000000038f354 000000000038f199 00007fd02b9fe83a
0709 13:03:02.933702 (+2044511us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2453,"raft.queue_time_us":4815,"raft.run_cpu_time_us":3891,"raft.run_wall_time_us":111050,"spinlock_wait_cycles":108400512,"thread_start_us":65716,"threads_started":1,"wal-append.queue_time_us":83439,"wal-append.run_cpu_time_us":6208,"wal-append.run_wall_time_us":1102078}
I20260709 13:03:03.078917  6062 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:03.083925  6073 consensus_meta.cc:287] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.001s
W20260709 13:03:03.087947  6224 consensus_meta.cc:287] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.576s	user 0.007s	sys 0.001s
I20260709 13:03:03.107864  6217 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.114802  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.116603  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:03.117416  1534 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.118357  1537 raft_consensus.cc:2410] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:03.118453  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.119484  1535 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:03.120968  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:03.096410  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet dbc0065dafc14741989730fd503966f0: Illegal state: Replica e8eefefed88a4903b423e9f487c4805a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:03.135280  1609 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:03.141187  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.151796  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.151922  1535 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:03:03.153455  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.154337  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.150741  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.152688  1540 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:03.159958  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:03.078979  6233 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:03.160808  1535 raft_consensus.cc:3060] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.161924  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.138700  6062 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:03.165041  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 113125us
I20260709 13:03:03.165508  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.166126  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:03.166512  1536 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
W20260709 13:03:03.148434  6259 log.cc:927] Time spent T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:03:03.161285  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.091003  6125 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:03.175566  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 200659us
I20260709 13:03:03.077612  6236 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.164605  6062 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.180227  6267 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:03.180385  6224 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.187696  6224 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.188184  6224 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.192956  6062 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.181910  6179 ts_tablet_manager.cc:1929] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.5
I20260709 13:03:03.193761  6179 log.cc:1199] T a93cfc3bb7634fb1b78c60f120616d9d P c98c328741aa493d87abafbf08f04944: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/wals/a93cfc3bb7634fb1b78c60f120616d9d
I20260709 13:03:03.195008  6179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:57272 (request call id 0) took 2692 ms. Trace:
I20260709 13:03:03.195152  6201 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:03.196151  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.196945  1539 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:03.164525  1537 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:03.198233  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.198719  6267 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:03.199368  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.202297  1504 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.185467  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.210024  1535 raft_consensus.cc:2468] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:03.155833  6261 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:03.211433  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.212105  1536 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 8.
I20260709 13:03:03.212862  1612 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:03.214710  1504 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.215106  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.229233  1541 raft_consensus.cc:2410] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:03.213399  6062 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.228385  6073 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.252293  6243 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:03.254674  6073 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.255234  6073 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.254918  6243 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.246485  6162 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:03.195385  6179 rpcz_store.cc:276] 0709 13:03:00.502510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:00.502803 (+   293us) service_pool.cc:224] Handling call
0709 13:03:00.590482 (+ 87679us) ts_tablet_manager.cc:1151] Deleting tablet a93cfc3bb7634fb1b78c60f120616d9d
0709 13:03:00.591352 (+   870us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:01.950075 (+1358723us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b540014c8d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb10362 00007fd0324fb34c 00007fd033b1e60a 00007fd033b4f2d0 00007fd033b3583d 00007fd033b357e9 00007fd033b35779 00007fd033b35741 00007fd033b3496d 000000000038f354
0709 13:03:02.403618 (+453543us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:03.181730 (+778112us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:03.194893 (+ 13163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1142274,"spinlock_wait_cycles":140288256,"tablet-delete.queue_time_us":86730,"thread_start_us":74687,"threads_started":1}
I20260709 13:03:03.211045  6217 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:03:03.261194  6217 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:03.261704  6217 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:03.261924  6162 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.262771  6217 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.264312  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:03.264889  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:03.266041  2363 raft_consensus.cc:2393] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:03.264365  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet a93cfc3bb7634fb1b78c60f120616d9d (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:03.267591  6217 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.265118  2367 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:03.269780  2329 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:03.272436  6162 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:03.270836  6242 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.499s	user 0.004s	sys 0.000s
I20260709 13:03:03.245788  6046 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.246474  6062 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.304832  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:03.200789  5997 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.308387  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:03.307930  6062 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.301700  6150 raft_consensus.cc:2804] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:03.317840  1614 raft_consensus.cc:2955] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 4 to 9, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:03.334471  6224 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:03.315801  6162 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:03.307040  6046 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.343554  6046 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.320008  6238 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:03.314536  6237 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:03:03.344552  6238 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:03.345149  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.320360  2367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:03:03.346702  6150 raft_consensus.cc:697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:03.347164  6238 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.347795  6150 consensus_queue.cc:237] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:03.358845  2328 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:03.360410  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71e3bb6ac3eb408ba9c57b48de886d65 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:03.362187  1538 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:03.364423  6243 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.364957  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1890) took 1117 ms. Trace:
I20260709 13:03:03.365255  6236 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:03.365798  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.365469  1681 rpcz_store.cc:276] 0709 13:03:02.247042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.248265 (+  1223us) service_pool.cc:224] Handling call
0709 13:03:02.263191 (+ 14926us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b580004fb98. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e3eee 0000000000375939 00007fd033a571e0 00007fd033b200c4 00007fd033b20131 00007fd033ae1fc0 00007fd033acc929 00007fd033acc3d2 00007fd02d043bd4
0709 13:03:02.263341 (+   150us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:02.381091 (+117750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:02.381137 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:02.398197 (+ 17060us) log.cc:844] Serialized 26 byte log entry
0709 13:03:02.655195 (+256998us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:02.655236 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:02.655305 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.269894 (+614589us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:03:03.364677 (+ 94783us) raft_consensus.cc:1685] finished
0709 13:03:03.364701 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.364868 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49078,"raft.queue_time_us":83752,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":13389,"spinlock_wait_cycles":37788800,"thread_start_us":261641,"threads_started":2,"wal-append.queue_time_us":285757}
W20260709 13:03:03.368292  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 202303us
I20260709 13:03:03.369766  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:03.371176  5658 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.371660  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:03.372280  6261 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:03.373049  5608 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:03.373749  5608 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:03.373407  6261 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.374894  5608 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.371750  5658 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:03.378731  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.379187  1534 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:03.363732  6249 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:03.387238  1504 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.401782  1504 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.413321  6046 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:03.413937  6046 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:03.414405  6046 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:03.418493  6208 consensus_meta.cc:287] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.621s	user 0.006s	sys 0.011s
I20260709 13:03:03.419123  6208 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:03.422000  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50420.3us
I20260709 13:03:03.377440  6232 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:03.424355  5625 raft_consensus.cc:2764] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:03.437496  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:03.410197  6073 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:03.442101  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 148556us
W20260709 13:03:03.451726  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.423715  6224 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:03.453138  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:03.459532  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.426437  6045 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.465627  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.471338  1654 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.451534  6233 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:03.451129  6232 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:03.461987  6045 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.497749  6232 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:03.510021  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.511237  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 197360us
I20260709 13:03:03.526692  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:03.527379  2370 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:03.528688  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57472.5us
I20260709 13:03:03.519594  1579 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.529863  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:03.541213  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.494911  6148 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:03.492806  6147 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:03.500912  6045 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.560132  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.566711  1541 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:03:03.537923  6261 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.555675  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:03.588232  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 105509us
I20260709 13:03:03.595531  1682 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:03:03.599061  1579 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.566064  6148 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:03.604550  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.504698  6233 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.604667  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.610270  1689 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:03.602747  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:03.610904  1682 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:03.536878  6222 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:03:03.612051  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.609835  1684 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:03.608022  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.604399  6215 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:03.592535  6261 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.621488  6261 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.616258  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.617128  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.622406  1685 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:03.600656  6202 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.620801  6287 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:03.607975  6283 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.158s	user 0.000s	sys 0.003s
I20260709 13:03:03.607365  6207 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.596442  5997 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.632006  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:03.632256  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 91133.2us
I20260709 13:03:03.626067  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.628584  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:03.572147  6147 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.610160  6148 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.629954  2367 raft_consensus.cc:606] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 15 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:03.634195  6274 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.329s	user 0.002s	sys 0.002s
W20260709 13:03:03.621836  6290 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:03:03.634011  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.615877  6222 consensus_queue.cc:1243] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:03:03.640700  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.642225  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.619134  6225 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.627487  6266 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:03.622044  6234 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:03.648536  6282 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.006s
I20260709 13:03:03.648536  6201 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:03.628919  6202 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.656662  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.649667  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.635473  6207 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.671471  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:03:03.715838  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 87352.1us
W20260709 13:03:03.674383  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 491439us
I20260709 13:03:03.671272  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.713537  1689 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 5.
I20260709 13:03:03.670879  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.638538  6287 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:03.716914  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:03.667115  6265 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:03.685137  6233 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:03.729631  6265 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:03.675328  6276 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:03:03.729722  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.730438  6265 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.731184  1689 raft_consensus.cc:2410] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:03:03.727260  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 56466.5us
I20260709 13:03:03.740556  1684 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.741393  1579 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.748301  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:03.656702  5625 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.668365  6208 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.674569  6252 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.753065  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:03.754415  2363 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:03.676910  6147 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:03.755875  1689 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:03.715189  6202 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.754151  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.718312  6207 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.755175  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:03.630017  6215 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.744691  6201 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:03.789927  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2398) took 1014 ms. Trace:
I20260709 13:03:03.790274  1687 rpcz_store.cc:276] 0709 13:03:02.775148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.050080 (+274932us) service_pool.cc:224] Handling call
0709 13:03:03.060716 (+ 10636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:03.071426 (+ 10710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:03.071461 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:03.094214 (+ 22753us) log.cc:844] Serialized 26 byte log entry
0709 13:03:03.143688 (+ 49474us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:03.143741 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:03.143828 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:03.480574 (+336746us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:03:03.775105 (+294531us) raft_consensus.cc:1685] finished
0709 13:03:03.775143 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:03.789852 (+ 14709us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31355,"raft.queue_time_us":9481,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":51026,"spinlock_wait_cycles":43087616,"thread_start_us":49016,"threads_started":1,"wal-append.queue_time_us":150268}
I20260709 13:03:03.750176  6273 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:03.678824  6046 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.776081  6237 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:03.759853  6296 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:03.795189  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:03.750825  6062 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.760957  6219 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.797719  6292 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.798326  6295 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:03.801177  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.801283  6215 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.802917  2329 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:03.752290  5625 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:03.780906  6225 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.675472  6269 consensus_queue.cc:1059] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.179s
I20260709 13:03:03.786561  6293 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:03.761354  6267 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:03.814817  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:03.845995  6267 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:03.815986  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:03.846562  6267 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.829819  6219 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.848621  6219 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.781425  6252 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.831399  6296 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:03.834009  6292 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.837030  5625 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:03.851958  6297 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:03:03.868202  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.868909  6261 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.853690  6046 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.855966  6252 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.858049  6223 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:03.862170  6062 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.864192  6225 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.878454  1681 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 5.
I20260709 13:03:03.878870  6225 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.862465  1540 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:03.879786  1684 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:03.860244  6229 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.881595  6229 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:03.882001  6229 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.861029  6296 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.795917  6233 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 13:03:03.863634  6292 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:03.890568  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:03.816282  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:03.822615  6232 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:03.736385  6266 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.778237  6073 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:03.825423  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:03.826887  6287 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.830437  2370 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:03.788769  6147 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:03.794751  6273 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:03.840386  5997 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:03.844467  6048 raft_consensus.cc:3055] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:03.907176  1682 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
W20260709 13:03:03.911796  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.844656  6293 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:03.903146  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 87121.4us
I20260709 13:03:03.920212  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:03.914538  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 106088us
I20260709 13:03:03.902558  6265 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.907606  6147 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:03.917380  6204 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:03.918640  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.922623  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.924057  1504 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.913131  1579 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.927353  1504 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.928369  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:03.929975  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:03.917117  5997 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:03.871353  6261 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:03.944401  1685 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 13: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:03.933911  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:03.937268  1532 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:03:03.945981  1684 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:03:03.937649  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:03.933734  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:03.940683  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.947544  1535 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:03.948443  1536 raft_consensus.cc:1275] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:03.919018  6048 raft_consensus.cc:740] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:03:03.973634  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:03.977519  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44273.5us
I20260709 13:03:03.979297  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.902199  5658 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.011087  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:03.932135  6223 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:03.909847  6273 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:03.926453  6147 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:03.942345  6125 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:03.937021  6073 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:04.015656  1541 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:03.931835  6225 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:04.046054  1504 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:04.020790  1540 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:03.931936  6266 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:03.936399  6295 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:04.013469  1505 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.508s (SENT) [suppressed 10 similar messages]
I20260709 13:03:04.014564  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:04.014787  1537 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:04.040125  1683 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:03:04.055104  6266 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:04.055380  6239 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.012s	sys 0.007s
I20260709 13:03:03.979485  6062 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.018005  6284 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:04.029026  6223 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.039270  6201 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:03:04.055774  6266 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:04.072770  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 58736.1us
I20260709 13:03:04.074286  1541 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:04.074579  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:03.979765  6219 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.061455  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:04.048969  6225 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:04.083950  1685 raft_consensus.cc:2368] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:03:04.081933  6225 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:04.085523  5997 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.085907  1534 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:04.086341  6261 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:04.087073  6261 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:04.050978  6252 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:04.088503  6252 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:04.079449  6284 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:03:04.055845  6239 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.012s	sys 0.008s
I20260709 13:03:04.088541  6296 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:04.051214  6073 raft_consensus.cc:697] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:04.050807  6125 raft_consensus.cc:697] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:04.050789  6295 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:04.099593  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:04.079222  6223 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.061523  6265 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.113513  6229 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:04.063503  6293 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.091105  6284 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.082007  6266 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.053342  6202 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.150110  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:04.060519  6207 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.150748  1689 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.082746  6062 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:04.139673  6295 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.060887  6048 consensus_queue.cc:260] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.147375  6296 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:04.165907  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.171835  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 70312.2us
I20260709 13:03:04.179651  1686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2391) took 1497 ms. Trace:
I20260709 13:03:04.129158  6109 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:03:04.142948  6203 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:03:04.179224  6310 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:04.141322  6252 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.152308  6265 consensus_queue.cc:1048] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:03:04.223135  1580 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:04.232996  1689 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
W20260709 13:03:04.207782  6045 consensus_meta.cc:287] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:03:04.234050  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:04.221055  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2390) took 1555 ms. Trace:
I20260709 13:03:04.235618  1681 raft_consensus.cc:2393] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 15: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:04.234421  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:04.180303  1686 rpcz_store.cc:276] 0709 13:03:02.682448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.975144 (+292696us) service_pool.cc:224] Handling call
0709 13:03:02.986668 (+ 11524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.005654 (+ 18986us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:04.067338 (+1061684us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.179129 (+111791us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.179200 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:04.179267 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.179396 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.179566 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1076441,"prepare.queue_time_us":1078994,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"thread_start_us":96079,"threads_started":1}
I20260709 13:03:04.235479  1690 rpcz_store.cc:276] 0709 13:03:02.665838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.943065 (+277227us) service_pool.cc:224] Handling call
0709 13:03:02.982033 (+ 38968us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:02.987944 (+  5911us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:04.066576 (+1078632us) log.cc:844] Serialized 14 byte log entry
0709 13:03:04.220710 (+154134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.220764 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:04.220808 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.220877 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:04.220986 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1194135,"prepare.queue_time_us":1088364,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":59639,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"thread_start_us":94848,"threads_started":1,"wal-append.queue_time_us":162157}
W20260709 13:03:04.345728  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.349994  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:04.352808  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:04.282114  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.299431  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 58001.3us
I20260709 13:03:04.358564  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:04.358757  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:04.240267  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 110132us
W20260709 13:03:04.213532  6307 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:04.316370  1532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 834) took 1762 ms. Trace:
I20260709 13:03:04.363467  1504 leader_election.cc:400] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:03:04.364063  1504 leader_election.cc:403] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:03:04.360352  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:04.284539  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:04.411221  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.400153  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:04.375901  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:04.416857  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.417517  1683 raft_consensus.cc:606] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:04.418110  1683 raft_consensus.cc:614] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:04.419799  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.399793  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:04.421532  1684 raft_consensus.cc:2393] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 15: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:04.363593  1532 rpcz_store.cc:276] 0709 13:03:02.544205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:02.544343 (+   138us) service_pool.cc:224] Handling call
0709 13:03:02.584696 (+ 40353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:03.946368 (+1361672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.304369 (+358001us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54001fca54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:04.306486 (+  2117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3082410752}
I20260709 13:03:04.421653  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:04.398002  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.423031  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.221292  6233 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:04.171649  6296 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:03:04.311360  6302 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.285s	user 0.000s	sys 0.003s
W20260709 13:03:04.324221  6148 consensus_meta.cc:287] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.003s
I20260709 13:03:04.511404  6148 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.514225  6148 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.515588  1688 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:04.210342  6229 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:04.522095  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.221586  6207 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.295122  6250 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.182783  6232 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:04.225018  6219 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.204348  6202 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.209649  6062 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:04.457186  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 81395.5us
I20260709 13:03:04.448717  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:04.433219  6265 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:04.275051  6045 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.491616  6301 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:04.494218  5997 raft_consensus.cc:3060] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:04.501684  6204 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:04.505683  1681 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:04.506242  6048 raft_consensus.cc:3060] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.507334  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:04.508929  1689 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:04.509580  6317 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:04.571677  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:04.572564  1608 raft_consensus.cc:2393] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:04.274346  6310 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.202721  5658 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.317881  6217 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:04.549803  6265 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:04.361379  6201 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:04.279181  6208 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:04.224352  6147 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.212604  5625 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.540998  6223 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.339695  6295 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.535172  6296 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.600441  1682 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:04.602167  6147 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.225358  6073 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:04.583082  6273 consensus_meta.cc:287] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:03:04.550176  1541 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.604784  6273 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:04.550928  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 128166us
I20260709 13:03:04.608928  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:04.611972  6295 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.582441  6217 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:04.615445  6217 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:04.616544  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:04.617360  1608 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.625809  6135 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.626402  6135 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:04.551879  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:04.628728  1684 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:04.556582  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:04.180943  6046 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.310410  6267 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.219799  6125 consensus_queue.cc:237] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.641216  1690 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:04.577315  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.574461  6317 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:03:04.570917  6292 consensus_meta.cc:287] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.682s	user 0.012s	sys 0.001s
I20260709 13:03:04.587633  2370 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:04.544907  1612 raft_consensus.cc:1275] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:04.589563  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:04.349717  6269 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:04.567397  6301 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:04.549189  6225 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.660737  2370 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:03:04.661362  2370 raft_consensus.cc:606] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:04.582620  6234 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:04.598326  6045 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.598834  6201 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:04.582816  6265 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:04.430681  1614 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:04.556468  6239 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:03:04.639569  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 276270us
I20260709 13:03:04.652719  1681 raft_consensus.cc:2393] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:04.649971  6217 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.654316  1608 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:04.553090  6250 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:04.658130  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 101652us
I20260709 13:03:04.666419  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:04.672351  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.683015  1612 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:04.654687  6317 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.677758  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:04.661384  6148 raft_consensus.cc:2764] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:03:04.699771  1536 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:04.653023  6208 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:03:04.653685  6273 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:04.680661  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.662405  6301 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:04.684834  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:04.641530  6284 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.678892  6062 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.653735  1541 raft_consensus.cc:2468] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
W20260709 13:03:04.720909  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 327397us
I20260709 13:03:04.721220  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:04.721868  1541 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:04.724367  1535 raft_consensus.cc:1240] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:03:04.726404  2329 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:04.686055  6223 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.686394  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:04.686951  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:04.687103  6250 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.740686  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.689327  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:04.743909  1538 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:04.687165  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:04.701123  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:04.694120  1504 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:04.706339  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:04.745682  1541 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:04.648392  6046 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.714179  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:04.718837  1684 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:04.684849  6045 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.687512  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:04.731190  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.659099  6292 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.742494  1681 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:04.655478  6269 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.669078  6323 consensus_queue.cc:1048] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:03:04.689227  6217 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.750677  1654 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:04.757483  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 63463.6us
I20260709 13:03:04.762388  1539 raft_consensus.cc:2410] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:03:04.759943  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.759330  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.744499  6198 raft_consensus.cc:2804] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:04.775367  1538 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
W20260709 13:03:04.802901  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 52330.4us
I20260709 13:03:04.798926  1611 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:04.761709  1532 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:04.668143  6234 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:04.710911  6147 consensus_queue.cc:1059] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:04.806646  1536 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:03:04.809275  1536 pending_rounds.cc:85] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 6
I20260709 13:03:04.805982  1687 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:04.756450  5608 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:04.812083  1685 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:04.765365  6250 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:04.742326  6062 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.809530  1536 pending_rounds.cc:107] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:03:04.888152  1536 raft_consensus.cc:2889] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:04.816766  1689 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:04.815344  1682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2412) took 1011 ms. Trace:
I20260709 13:03:04.887594  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:04.892315  6328 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.892957  6328 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:04.895054  6267 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.895516  6328 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:04.902251  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.808764  6148 raft_consensus.cc:2804] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:04.897994  6250 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:04.889758  1682 rpcz_store.cc:276] 0709 13:03:03.803585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.910469 (+106884us) service_pool.cc:224] Handling call
0709 13:03:03.910887 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.600996 (+690109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:04.815184 (+214188us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54003a4b54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:04.815300 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585392000}
I20260709 13:03:04.807688  6201 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:04.933552  6148 raft_consensus.cc:697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:04.934770  6148 consensus_queue.cc:237] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.929829  6269 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.937870  6284 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.940886  6046 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.941177  6292 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.943308  6234 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:04.944861  6225 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.818786  6135 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.946838  6217 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.947885  6310 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.814695  6198 raft_consensus.cc:697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:04.949220  6198 consensus_queue.cc:237] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:04.952448  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:04.953426  6269 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:04.953759  6062 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.953980  6269 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.954140  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:04.954571  1534 raft_consensus.cc:2410] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:03:04.953006  6296 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.957690  1689 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:04.959437  6296 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:04.960294  6269 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:04.901172  5608 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:04.960683  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.961606  5608 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.962067  1611 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:04.963479  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:04.964501  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:04.960216  6282 log.cc:927] Time spent T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:03:04.887594  6223 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:04.975172  6223 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:04.977824  6223 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:04.979215  6250 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:04.993392  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50318 (request call id 3) took 1401 ms. Trace:
I20260709 13:03:04.994305  1681 rpcz_store.cc:276] 0709 13:03:03.591695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.955600 (+1363905us) service_pool.cc:224] Handling call
0709 13:03:04.993309 (+ 37709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:04.971635  5997 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:03:04.766996  6045 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.038518  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:04.760566  6319 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
W20260709 13:03:05.075870  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 50768.5us
W20260709 13:03:05.089699  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.224174  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 105503us
W20260709 13:03:05.238118  1580 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57544 dropped due to backpressure: service queue is full with 50 items
W20260709 13:03:05.284626  1505 leader_election.cc:336] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.673s (SENT)
W20260709 13:03:05.305514  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.337960  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.250509  6328 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.251080  6319 consensus_queue.cc:1243] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 13.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:03:05.353003  6341 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 13:03:05.354413  6233 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:05.355037  6233 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:05.361366  6265 consensus_meta.cc:287] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.003s
I20260709 13:03:05.361937  6265 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.363194  1686 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:05.365980  6233 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.368633  6233 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:05.371755  6332 log.cc:927] Time spent T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.455s	user 0.012s	sys 0.013s
I20260709 13:03:05.375458  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:05.376451  6232 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:05.377002  6232 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:05.377928  6317 consensus_meta.cc:287] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.664s	user 0.008s	sys 0.000s
I20260709 13:03:05.378408  6317 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.380491  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:05.381103  6045 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:05.382550  6322 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.383394  6322 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.383880  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2423) took 1016 ms. Trace:
I20260709 13:03:05.384342  1689 rpcz_store.cc:276] 0709 13:03:04.367727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.920323 (+552596us) service_pool.cc:224] Handling call
0709 13:03:04.936926 (+ 16603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.958089 (+ 21163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.383621 (+425532us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b54002d5d54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:05.383812 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47301504}
I20260709 13:03:05.386521  6201 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:03:05.391443  6048 consensus_meta.cc:287] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.817s	user 0.013s	sys 0.001s
I20260709 13:03:05.392491  1609 raft_consensus.cc:2410] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:05.394443  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2487) took 1037 ms. Trace:
I20260709 13:03:05.391498  6201 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.398581  6201 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:05.395166  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2421) took 1028 ms. Trace:
W20260709 13:03:05.399829  1505 leader_election.cc:336] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.741s (SENT)
I20260709 13:03:05.400095  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:05.384351  6328 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.399466  1687 rpcz_store.cc:276] 0709 13:03:04.367239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.810941 (+443702us) service_pool.cc:224] Handling call
0709 13:03:04.811241 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:04.903519 (+ 92278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.903570 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:04.924356 (+ 20786us) log.cc:844] Serialized 26 byte log entry
0709 13:03:05.227065 (+302709us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:05.227125 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.227227 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:05.394905 (+167678us) raft_consensus.cc:1685] finished
0709 13:03:05.394927 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.395100 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91729,"raft.queue_time_us":92888,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":46390,"thread_start_us":248791,"threads_started":1,"wal-append.queue_time_us":415012}
I20260709 13:03:05.394841  1609 rpcz_store.cc:276] 0709 13:03:04.356749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.356884 (+   135us) service_pool.cc:224] Handling call
0709 13:03:05.394203 (+1037319us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54001b5dd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:05.394376 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2230099200}
I20260709 13:03:05.400758  6269 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:05.402724  6328 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:05.395128  6265 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:05.242616  1580 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57544 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1984)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2503)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1989)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1967)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2499)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1998)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1993)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1952)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 750)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1956)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1979)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1980)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1994)
I20260709 13:03:05.407811  6269 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:05.423327  1537 raft_consensus.cc:2468] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
W20260709 13:03:05.424237  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.418551  6280 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:05.430181  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.428839  6269 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:05.436187  6301 consensus_meta.cc:287] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.695s	user 0.013s	sys 0.000s
I20260709 13:03:05.436846  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.436710  6301 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.437505  1610 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:05.438464  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.439471  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.439761  6317 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:05.440343  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.440986  1541 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.444342  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 741) took 1017 ms. Trace:
I20260709 13:03:05.445045  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:05.445906  1535 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
I20260709 13:03:05.444861  1616 rpcz_store.cc:276] 0709 13:03:04.427397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.427838 (+   441us) service_pool.cc:224] Handling call
0709 13:03:04.501432 (+ 73594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.590636 (+ 89204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.590686 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.590752 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:04.590799 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.444068 (+853269us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b540030d754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:05.444152 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.444292 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204353408}
I20260709 13:03:05.455124  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:05.438916  1610 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.456251  1536 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.460379  1533 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:03:05.472399  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.473569  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:05.475461  6336 log.cc:927] Time spent T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:03:05.483575  1541 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:05.484731  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:05.485447  2370 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:05.487527  1536 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:05.436863  6269 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.469213  6226 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.457675  6301 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:05.511911  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.515460  1610 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:05.516539  6226 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.520267  6201 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.521132  6201 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.441465  6280 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.528343  2367 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:05.527513  6045 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.528003  6201 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:05.547412  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.548514  1687 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:03:05.552601  2328 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:05.525748  6232 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:05.553830  6343 log.cc:927] Time spent T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:03:05.559818  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1922) took 1648 ms. Trace:
I20260709 13:03:05.565443  1690 rpcz_store.cc:276] 0709 13:03:03.911901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.362591 (+450690us) service_pool.cc:224] Handling call
0709 13:03:04.431778 (+ 69187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.653384 (+221606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.559413 (+906029us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002ec7d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:05.559729 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481072512}
I20260709 13:03:05.553303  6226 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:05.559401  6109 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:05.503978  1582 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:57944 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1981)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1990)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1974)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1969)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1962)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 2000)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1972)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1987)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1988)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1968)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1961)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1970)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1978)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1950)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1954)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 2001)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1998)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1971)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1976)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1965)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1985)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1993)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1983)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1982)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1986)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1996)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1960)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2500)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1952)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 750)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2502)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2504)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1955)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1956)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1958)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1959)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1973)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1975)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1979)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1980)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1994)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1999)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 751)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 753)
I20260709 13:03:05.546641  6045 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:05.578557  1505 leader_election.cc:336] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.508s (SENT)
I20260709 13:03:05.579120  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:05.574680  6109 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:05.583079  6250 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:05.585575  6232 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:05.580952  6198 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.023s	sys 0.054s
I20260709 13:03:05.587320  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.588835  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.590072  6045 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:05.590176  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.590973  1609 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:05.592121  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.593015  1609 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:05.594053  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.594213  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.595175  1613 raft_consensus.cc:2368] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12.
I20260709 13:03:05.595371  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.583521  6109 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.596719  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:05.587805  6198 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.023s	sys 0.054s
I20260709 13:03:05.599383  1613 raft_consensus.cc:2368] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:03:05.600840  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.601382  1613 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:05.601991  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.605695  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.606158  1613 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.608181  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.609237  1609 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:05.617297  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.620913  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.623173  1687 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:05.623332  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.624748  1579 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:05.616158  6280 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:05.634312  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:05.633364  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:05.635821  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 469f8c03f4924f809435141a09c976fa: Illegal state: Replica f6eecf73c1c24b5eb268b5088a3030d4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:05.637648  1682 raft_consensus.cc:2368] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12.
I20260709 13:03:05.635390  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:05.640461  1686 raft_consensus.cc:2368] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:03:05.640686  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.626230  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:05.635489  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.645045  1687 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:05.636308  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.633585  1690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:05.646312  1690 raft_consensus.cc:606] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:05.646814  1690 raft_consensus.cc:614] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:05.610867  6250 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:05.642086  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:05.643193  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.642776  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.617022  6232 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:05.635802  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.648185  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.648742  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:05.649963  6125 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:05.650663  6301 consensus_queue.cc:1059] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:05.651868  6208 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:05.652864  6273 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:05.661581  1689 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 13: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:05.664506  1686 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:05.664867  1613 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:05.640303  6328 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:05.622781  6252 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:03:05.624362  6045 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:03:05.671752  1682 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 15: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:05.666888  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.677083  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.677874  1609 raft_consensus.cc:2368] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:03:05.678140  1687 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:05.635843  6204 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:03:05.663465  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:05.678907  1505 leader_election.cc:336] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.915s (SENT)
I20260709 13:03:05.661279  6223 consensus_queue.cc:1059] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:03:05.663880  6250 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.665859  6232 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.684607  1689 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:05.685871  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.687424  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:05.687844  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:05.692721  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.690275  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.696379  1687 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:05.698119  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.699065  1609 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:05.660133  6201 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:03:05.705425  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.709718  1687 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:03:05.709767  1505 leader_election.cc:336] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.604s (SENT)
W20260709 13:03:05.696856  6331 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.810s	user 0.009s	sys 0.004s
I20260709 13:03:05.717548  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.718163  1609 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:05.715032  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1950) took 1076 ms. Trace:
I20260709 13:03:05.718927  1613 rpcz_store.cc:276] 0709 13:03:04.639066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.705016 (+1065950us) service_pool.cc:224] Handling call
0709 13:03:05.714861 (+  9845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.721654  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.723840  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.725808  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.726406  1608 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:05.732354  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.733520  1609 raft_consensus.cc:2410] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:05.733681  5625 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:05.734534  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.735708  1609 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:05.736503  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.737528  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.738233  1609 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:05.729225  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.739249  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.729653  6348 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:05.722581  6125 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:05.739893  1686 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:05.745025  1608 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
I20260709 13:03:05.750530  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.751164  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.722779  6109 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.754395  6109 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:05.754614  6250 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:05.761194  6319 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:05.761425  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:05.761771  6319 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:05.762765  6319 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.763226  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
W20260709 13:03:05.764166  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.764598  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.765533  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.766323  1533 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:05.766580  6232 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:05.768560  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:05.769411  1686 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:05.769924  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.770570  1535 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.771718  1536 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.772450  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:05.773160  1690 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.741775  6125 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:05.777316  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.778208  1533 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:05.779773  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.780611  1541 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.783543  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:05.784408  1538 raft_consensus.cc:2410] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:03:05.786861  1505 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.606s (SENT)
I20260709 13:03:05.787307  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:05.789458  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.790066  1538 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.796741  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.796904  1535 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:05.798648  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.802212  1688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1912) took 2197 ms. Trace:
I20260709 13:03:05.802743  1613 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:03:05.802414  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.809706  1541 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:05.809721  1538 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:05.787971  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.802660  1688 rpcz_store.cc:276] 0709 13:03:03.590076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:03.590206 (+   130us) service_pool.cc:224] Handling call
0709 13:03:03.607559 (+ 17353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.527959 (+920400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.786925 (+1258966us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b5400411254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:05.787111 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2087873792}
I20260709 13:03:05.812009  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.815449  1536 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:05.817108  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.817399  1541 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:05.817945  1541 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:05.744555  6048 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:05.783012  6319 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.821810  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.822467  1540 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:03:05.822847  1540 pending_rounds.cc:85] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 7
I20260709 13:03:05.823079  1540 pending_rounds.cc:107] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:03:05.823275  1540 raft_consensus.cc:2889] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:05.820343  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.820668  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.823990  1613 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:03:05.824177  1535 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:05.825012  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.826884  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.827262  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.827539  1607 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.830024  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:05.840641  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:05.837296  1613 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:05.821810  1541 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.843168  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2500) took 1276 ms. Trace:
I20260709 13:03:05.834095  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:05.844818  1613 rpcz_store.cc:276] 0709 13:03:04.567300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.836418 (+1269118us) service_pool.cc:224] Handling call
0709 13:03:05.836880 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.842608 (+  5728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.843112 (+   504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.845578  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.817108  6232 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:05.847205  1534 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2515) took 1157 ms. Trace:
I20260709 13:03:05.820865  6048 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:05.833282  1540 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:05.849224  1541 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:05.847617  1534 rpcz_store.cc:276] 0709 13:03:04.685249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.686657 (+  1408us) service_pool.cc:224] Handling call
0709 13:03:05.842828 (+1156171us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54000befd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:05.842990 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509029760}
I20260709 13:03:05.849655  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 750) took 1155 ms. Trace:
I20260709 13:03:05.852864  1613 rpcz_store.cc:276] 0709 13:03:04.691652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.845763 (+1154111us) service_pool.cc:224] Handling call
0709 13:03:05.846098 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.846266 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:05.846289 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:05.846329 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:03:05.846357 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.846494 (+   137us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.846581 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.834443  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:05.857882  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48366 (request call id 1931) took 1910 ms. Trace:
I20260709 13:03:05.858789  1609 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:05.860944  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1952) took 1179 ms. Trace:
I20260709 13:03:05.861178  1608 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:05.862237  1609 rpcz_store.cc:276] 0709 13:03:04.682019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.828611 (+1146592us) service_pool.cc:224] Handling call
0709 13:03:05.828849 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.860625 (+ 31776us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.860879 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.858888  1685 rpcz_store.cc:276] 0709 13:03:03.938546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.338865 (+400319us) service_pool.cc:224] Handling call
0709 13:03:05.848667 (+1509802us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54000d5cd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:05.848789 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049914112}
I20260709 13:03:05.857824  1613 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:05.821132  6328 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:05.831247  6233 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:05.865435  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2504) took 1097 ms. Trace:
I20260709 13:03:05.864992  1541 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:05.831027  5608 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:05.868520  1613 rpcz_store.cc:276] 0709 13:03:04.767549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.857058 (+1089509us) service_pool.cc:224] Handling call
0709 13:03:05.857446 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.864666 (+  7220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.865339 (+   673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.868865  5608 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.869380  6358 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:05.873757  1613 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 13:03:05.873950  1535 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:05.852304  6232 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.859581  6125 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:05.875540  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45559.5us
I20260709 13:03:05.890893  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:05.886722  1616 raft_consensus.cc:2410] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:03:05.888525  1607 raft_consensus.cc:2468] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:05.898957  1690 raft_consensus.cc:2468] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
I20260709 13:03:05.901340  2328 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:05.902794  6198 raft_consensus.cc:2804] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:05.903663  6198 raft_consensus.cc:697] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:05.905054  6198 consensus_queue.cc:237] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.834646  6295 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:03:05.906484  6295 consensus_queue.cc:1243] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer c98c328741aa493d87abafbf08f04944 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:03:05.908149  1607 raft_consensus.cc:1240] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:05.908934  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1958) took 1009 ms. Trace:
I20260709 13:03:05.911317  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:05.913625  1613 raft_consensus.cc:1217] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[7.7-8.8]   Dedup: 8.8->[]
I20260709 13:03:05.934828  1615 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:05.910141  1533 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:05.909363  1607 rpcz_store.cc:276] 0709 13:03:04.899273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.907407 (+1008134us) service_pool.cc:224] Handling call
0709 13:03:05.907885 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.908638 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.908843 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.934620  6295 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:05.882205  6125 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:05.937845  1607 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:05.938019  1613 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 13:03:05.939342  1615 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:05.953886  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1979) took 1010 ms. Trace:
I20260709 13:03:05.944489  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 876) took 1846 ms. Trace:
I20260709 13:03:05.945526  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:05.947811  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:05.948707  1535 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:05.952764  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:05.959730  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:05.954463  1615 rpcz_store.cc:276] 0709 13:03:04.943326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.938836 (+995510us) service_pool.cc:224] Handling call
0709 13:03:05.939149 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.953621 (+ 14472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.953833 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.961092  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1975) took 1002 ms. Trace:
I20260709 13:03:05.961668  1607 rpcz_store.cc:276] 0709 13:03:04.942324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.937271 (+994947us) service_pool.cc:224] Handling call
0709 13:03:05.937634 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.944481 (+  6847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.944768 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.956496  1684 rpcz_store.cc:276] 0709 13:03:04.098181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.766511 (+668330us) service_pool.cc:224] Handling call
0709 13:03:04.766863 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:04.902424 (+135561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:04.902462 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:04.902508 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:03:04.902543 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.944271 (+1041728us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002d6254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:05.944319 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:05.944444 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311220480}
I20260709 13:03:05.965394  1607 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:05.969039  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.939872  6317 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:05.936441  6348 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:05.969808  1611 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:05.971081  1614 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:05.976632  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1984) took 1013 ms. Trace:
I20260709 13:03:05.977355  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1980) took 1033 ms. Trace:
I20260709 13:03:05.941548  6295 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:03:05.974032  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.978155  1614 rpcz_store.cc:276] 0709 13:03:04.943572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.944967 (+1001395us) service_pool.cc:224] Handling call
0709 13:03:05.970789 (+ 25822us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:05.977003 (+  6214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.977286 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.889858  6233 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:05.933588  6358 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:05.977299  1611 rpcz_store.cc:276] 0709 13:03:04.963341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.944420 (+981079us) service_pool.cc:224] Handling call
0709 13:03:05.976562 (+ 32142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:05.973408  1615 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:05.882581  6265 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:03:05.965363  6252 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:05.989252  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:05.877095  6048 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:05.995894  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:06.000560  1610 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.001492  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2511) took 1317 ms. Trace:
I20260709 13:03:05.997202  1615 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:05.976404  6317 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:06.001991  1537 rpcz_store.cc:276] 0709 13:03:04.683853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.686070 (+  2217us) service_pool.cc:224] Handling call
0709 13:03:06.001305 (+1315235us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400440cd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:06.001437 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797370112}
I20260709 13:03:05.999135  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1959) took 1099 ms. Trace:
I20260709 13:03:06.007490  1613 rpcz_store.cc:276] 0709 13:03:04.899535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.913023 (+1013488us) service_pool.cc:224] Handling call
0709 13:03:05.913496 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:05.965023 (+ 51527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:05.999055 (+ 34032us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.009130  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:06.014755  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.015996  6048 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.017185  6358 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.018031  6233 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:06.019207  6322 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:06.015348  1610 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:06.020153  6204 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:06.020491  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57544 (request call id 1981) took 1076 ms. Trace:
I20260709 13:03:06.020825  1610 rpcz_store.cc:276] 0709 13:03:04.943824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.995557 (+1051733us) service_pool.cc:224] Handling call
0709 13:03:06.020424 (+ 24867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:06.020785  6204 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.021737  1580 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:57544 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
I20260709 13:03:05.995261  6252 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.034330  6204 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:06.034571  6252 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:05.983012  6293 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:03:06.024654  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57350.8us
W20260709 13:03:06.032624  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.041239  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:06.008241  6317 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:06.043932  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57548 (request call id 2499) took 1484 ms. Trace:
I20260709 13:03:06.046845  1616 rpcz_store.cc:276] 0709 13:03:04.559916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.503218 (+943302us) service_pool.cc:224] Handling call
0709 13:03:06.043653 (+540435us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54002acbd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:06.043847 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":858902400}
I20260709 13:03:06.012621  6273 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.062695  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:06.076625  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:06.085623  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:05.995035  6328 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.068768  5658 raft_consensus.cc:3055] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:06.112322  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.087302  6308 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:06.097199  6233 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:06.084980  5608 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:06.061262  6273 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.122766  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:06.122859  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.125772  1616 raft_consensus.cc:2410] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:03:06.100783  6295 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.132134  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57544 (request call id 1955) took 1321 ms. Trace:
I20260709 13:03:06.132535  1609 rpcz_store.cc:276] 0709 13:03:04.810967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.863137 (+1052170us) service_pool.cc:224] Handling call
0709 13:03:05.863518 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.866819 (+  3301us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:05.888735 (+ 21916us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.120553 (+231818us) log.cc:844] Serialized 14 byte log entry
0709 13:03:06.131736 (+ 11183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:06.131797 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:06.131849 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.131930 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:06.132078 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18476,"prepare.queue_time_us":22113,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":95,"raft.queue_time_us":9267,"spinlock_wait_cycles":3404032,"thread_start_us":223450,"threads_started":1}
I20260709 13:03:06.133472  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.133972  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:06.134254  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.134519  1610 raft_consensus.cc:2376] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14. Re-sending same reply.
I20260709 13:03:06.134704  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.134934  1609 raft_consensus.cc:2376] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12. Re-sending same reply.
I20260709 13:03:06.135382  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:06.120631  6352 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:06.136369  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.136637  6352 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.137517  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:06.138096  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 275708us
I20260709 13:03:06.135779  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.138871  6352 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:06.138833  1614 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:06.139909  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.116187  6361 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:06.114106  5658 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.141387  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.142215  5658 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.123689  6356 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:06.116510  6318 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:06.135861  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.147174  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:06.144325  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 93170.4us
I20260709 13:03:06.158130  1609 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:03:06.158571  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.076152  6365 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 13:03:06.163833  1505 leader_election.cc:336] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.758s (SENT)
W20260709 13:03:06.164136  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 78459.2us
I20260709 13:03:06.166059  1611 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:06.166159  1653 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:06.166323  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:06.167176  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:06.167420  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.165570  1654 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:06.168622  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.170214  1610 raft_consensus.cc:2368] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
I20260709 13:03:06.168159  1616 raft_consensus.cc:2376] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15. Re-sending same reply.
I20260709 13:03:06.129528  6233 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.175453  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:06.157557  6308 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.186697  6045 raft_consensus.cc:3055] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:03:06.198215  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.200073  6318 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.202353  6233 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.203073  6318 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.205926  6293 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:06.208776  6293 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.209827  6293 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.206972  6317 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.181915  6361 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.192168  6045 raft_consensus.cc:740] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:06.217679  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:06.222376  6308 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.216620  6361 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.226141  6371 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:06.192482  6115 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:03:06.237877  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.244812  1686 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:06.247268  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:06.235720  1504 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:06.248853  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:06.260545  1682 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:06.255136  1613 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:06.263624  1681 raft_consensus.cc:1240] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:06.266877  1685 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:06.266894  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.268487  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.268610  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.159724  6356 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.271632  1504 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:06.200377  6376 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.218614  6045 consensus_queue.cc:260] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:06.280277  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46133.1us
I20260709 13:03:06.285827  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:06.288364  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:06.289376  1654 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:06.253053  6115 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.293207  1614 raft_consensus.cc:2410] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:06.296686  6045 raft_consensus.cc:3060] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:06.270516  6224 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.280669  5997 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:06.297297  6372 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:06.295852  6371 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:06.301052  6356 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:06.281586  6380 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:06.266116  5608 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:03:06.311443  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:06.312552  1687 raft_consensus.cc:606] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:06.298367  6115 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.313181  1687 raft_consensus.cc:614] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:06.311611  6380 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.316282  6163 consensus_queue.cc:1059] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:06.288012  6295 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:03:06.304278  6360 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:06.304126  6366 raft_consensus.cc:2804] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:06.322563   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:06.334367  6232 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:06.321060  6380 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:06.312575  6377 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:06.312829  6371 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:03:06.340678  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.299463  6252 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.348498  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:06.349527  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.308066  6224 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:06.350734  1505 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.861s (SENT)
I20260709 13:03:06.340854  6360 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.352998  1612 raft_consensus.cc:1275] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:03:06.353420  1612 pending_rounds.cc:85] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 8
I20260709 13:03:06.353672  1612 pending_rounds.cc:107] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:03:06.353094  6360 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.353896  1612 raft_consensus.cc:2889] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.355055  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:06.356631  1616 raft_consensus.cc:1240] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:06.357550  6224 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:06.358361  6368 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
I20260709 13:03:06.360009  6115 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.362715  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:06.363844  1505 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.871s (SENT)
I20260709 13:03:06.349403  1609 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:03:06.365528  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:06.350291  6366 raft_consensus.cc:697] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.310850  6372 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.371174  6372 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:06.367658  6045 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:06.349429  6377 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.355643  6250 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:06.339430  6273 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:06.419415  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 137307us
I20260709 13:03:06.344154  6269 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:03:06.431744  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.367666  6328 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:06.435458  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:06.373271  6224 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.393570  5625 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.447254  1689 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:06.457880  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:06.428529  6045 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:03:06.477274  1538 pending_rounds.cc:85] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 5
I20260709 13:03:06.477619  1538 pending_rounds.cc:107] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:03:06.477856  1538 raft_consensus.cc:2889] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:06.476655  1687 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:06.434979  6269 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.448525  5625 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.485206  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:06.511896  1539 raft_consensus.cc:2393] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 15: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:06.485919  6252 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:06.486289  6362 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.476s	user 0.000s	sys 0.010s
I20260709 13:03:06.514163  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:06.437878  6328 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.482980  6198 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:03:06.482177  6317 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:06.460789  6371 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.493940  6249 raft_consensus.cc:993] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:06.445122  6224 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:06.504590  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.507031  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:06.507414  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.545787  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:06.509236  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:06.510471  1684 raft_consensus.cc:3055] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:06.546581  1685 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:06.546967  1684 raft_consensus.cc:740] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:06.502322  6115 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:06.514088  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 228021us
I20260709 13:03:06.545006  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:06.553508  1579 leader_election.cc:400] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12.
I20260709 13:03:06.553634  2329 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:06.553944  1579 leader_election.cc:403] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:03:06.555104  1579 leader_election.cc:400] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:03:06.555465  1579 leader_election.cc:403] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:03:06.572016  1536 raft_consensus.cc:3055] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:06.572629  1536 raft_consensus.cc:740] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:06.575680  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:06.552470  1684 consensus_queue.cc:260] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:06.599277  1540 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:06.573659  1536 consensus_queue.cc:260] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:06.600178  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.543606  5997 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:06.550566  6135 raft_consensus.cc:1081] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:06.553200  6273 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:06.579090  6249 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:06.638070  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 345100us
W20260709 13:03:06.639799  6362 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.071s	user 0.007s	sys 0.001s
I20260709 13:03:06.567307  6125 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12.
I20260709 13:03:06.538856  6386 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:03:06.566949  6351 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.106s
W20260709 13:03:06.655189  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 83582.9us
W20260709 13:03:06.654829  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.445355  6366 consensus_queue.cc:237] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.637176  6301 raft_consensus.cc:3055] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:06.674551  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:06.599843  6287 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:03:06.722352  6388 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:03:06.724275  6287 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:06.726558  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:06.712234  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.727989  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:06.694212  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:06.728796  2363 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
W20260709 13:03:06.729153  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.660790  6377 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:06.730007  6163 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:06.730201  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 55791.6us
I20260709 13:03:06.730433  6301 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:06.710517  6273 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:03:06.672674  6048 consensus_queue.cc:1059] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:03:06.731230  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:06.635358  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 57407.3us
I20260709 13:03:06.734488  6048 raft_consensus.cc:3055] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:06.735342  6048 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:06.736676  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:34908
I20260709 13:03:06.737483  1540 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:06.634804  6356 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11.
I20260709 13:03:06.737934  1540 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:06.741173  6317 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:06.733265  6301 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:06.739006  1687 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:06.757980  6301 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:06.740284  6381 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:03:06.676047  6348 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:03:06.741899  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:06.645085  6387 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.170s
I20260709 13:03:06.771476  6224 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:06.774044  6269 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:06.779645  6375 log.cc:927] Time spent T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.616s	user 0.002s	sys 0.000s
I20260709 13:03:06.784502  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2502) took 2035 ms. Trace:
I20260709 13:03:06.788578  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34850 (request call id 2) took 1125 ms. Trace:
I20260709 13:03:06.766139  5997 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:06.872926  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.824322  1685 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:03:06.877945  1607 rpcz_store.cc:276] 0709 13:03:05.663556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.998484 (+334928us) service_pool.cc:224] Handling call
0709 13:03:06.788329 (+789845us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b540040a6d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0e735 00007fd033aced29 00007fd02d04d1d4 00007fd02d04d162 00007fd02d04d091 00007fd02d04d00c 00007fd02d04c2c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:06.788495 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607369600}
I20260709 13:03:06.805284  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:03:06.813445  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.815822  1608 rpcz_store.cc:276] 0709 13:03:04.749221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.846408 (+1097187us) service_pool.cc:224] Handling call
0709 13:03:05.860837 (+ 14429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:05.861744 (+   907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:06.784268 (+922524us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54000b1dd0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:06.784433 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26782464}
W20260709 13:03:06.954717  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.793983  1540 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:06.771503  6385 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:03:06.965770  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 174581us
W20260709 13:03:06.964982  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 174684us
W20260709 13:03:06.966216  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 161054us
I20260709 13:03:06.973891  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:06.978057  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 308506us
I20260709 13:03:06.768929  6317 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:06.981658  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:06.986305  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.988634  1540 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:06.990180  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.985908  6163 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:03:06.823591  6328 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:06.999823  1505 leader_election.cc:336] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.016s (SENT)
I20260709 13:03:07.000516  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.004328  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:07.006991  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.972764  6318 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:07.018083  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.737612  6048 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:07.029459  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:06.992901  6386 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:03:07.026273  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet f13a8325fe104b2582f097044dcef93c: Illegal state: Replica e8eefefed88a4903b423e9f487c4805a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
W20260709 13:03:07.021502  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.036780  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:06.830708  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.024025  6395 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:07.032907  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:07.041985  2367 raft_consensus.cc:3055] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:03:07.026778  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 53001.5us
I20260709 13:03:07.042307  2367 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:07.038280  2328 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:07.014067  6318 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:07.045281  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.046142  1654 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:03:07.044327  1505 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.593s (SENT)
I20260709 13:03:07.048166  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.025751  6224 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.028824  6295 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.087359  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.065383  2367 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:07.095041  1505 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.021s (SENT)
I20260709 13:03:07.103266  2367 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.103623  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:07.104924  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:07.105177  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.055042  6318 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:07.107859  1505 leader_election.cc:336] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.106s (SENT)
I20260709 13:03:07.062924  6223 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.109800  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.053267  6396 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:07.080322  6348 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.052937  6377 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:03:07.120812  1505 leader_election.cc:336] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.155s (SENT)
I20260709 13:03:07.121073  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:07.092626  6379 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:07.121536  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.122388  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.122888  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:07.045678  6386 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:07.170454  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.162631  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:07.121264  6403 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.164140  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.162773  1613 raft_consensus.cc:2376] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11. Re-sending same reply.
I20260709 13:03:06.818388  6380 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.107753  6371 raft_consensus.cc:2804] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:07.166805  1610 raft_consensus.cc:2376] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15. Re-sending same reply.
I20260709 13:03:07.175076  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:07.175112  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 54396.6us
W20260709 13:03:07.215093  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.214284  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 168262us
I20260709 13:03:07.215716  1607 raft_consensus.cc:2376] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12. Re-sending same reply.
W20260709 13:03:07.200421  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.219938  1505 leader_election.cc:336] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.159s (SENT)
I20260709 13:03:07.228334  2367 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
W20260709 13:03:07.231271  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.237046  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.217418  6295 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:07.220919  6379 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:07.249073  1607 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:07.230774  6371 raft_consensus.cc:697] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:07.252998  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:07.226679  6163 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:03:07.259431   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:03:07.260426  6402 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:03:07.276469  6386 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:07.278424  6409 log.cc:927] Time spent T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 13:03:07.281419  6401 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:03:07.285733  6380 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:07.286564  6301 consensus_meta.cc:287] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.004s
W20260709 13:03:07.287392  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 59815.6us
I20260709 13:03:07.125706  6396 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:07.292095  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:07.294824  6366 consensus_queue.cc:1048] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:07.302587  1612 raft_consensus.cc:2368] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10.
W20260709 13:03:07.272297  6394 log.cc:927] Time spent T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
W20260709 13:03:07.316460  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.321203  6417 consensus_queue.cc:1059] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:07.333189  6371 consensus_queue.cc:237] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.338945  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.341353  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.342099  1607 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:07.342139  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.343007  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.343688  1610 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:07.344159  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.344376  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.344566  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:07.345152  1610 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.345242  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:07.306310  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:07.345947  1536 raft_consensus.cc:3060] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.346513  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:07.347142  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.252035  6295 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.300072  6396 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:07.310300  6287 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.312347  6379 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:07.291385  6328 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.343071  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.343755  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:07.304445  6223 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.358932  1536 raft_consensus.cc:1275] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:03:07.359930  1614 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:07.360648  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.369047  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.370774  1615 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:07.417896  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.694799  1438 catalog_manager.cc:5697] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.639832  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2445) took 1131 ms. Trace:
I20260709 13:03:07.699056  1536 pending_rounds.cc:85] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 9
I20260709 13:03:07.699540  1536 pending_rounds.cc:107] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:03:07.699930  1536 raft_consensus.cc:2889] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:07.491547  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.700132  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:07.532083  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.702576  1612 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
W20260709 13:03:07.703054  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.639063  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2441) took 1394 ms. Trace:
W20260709 13:03:07.443346  1505 leader_election.cc:336] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.612s (SENT)
I20260709 13:03:07.450712  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:07.426241  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.697749  1684 raft_consensus.cc:3060] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:07.373034  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:07.706265  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.707194  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 876) took 1136 ms. Trace:
W20260709 13:03:07.704782  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 261524us
I20260709 13:03:07.451126  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:07.705196  1608 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
W20260709 13:03:07.708756  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:07.714095  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.703842  1689 rpcz_store.cc:276] 0709 13:03:06.244393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.244551 (+   158us) service_pool.cc:224] Handling call
0709 13:03:06.279903 (+ 35352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.457752 (+177849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.638702 (+1180950us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540015b654. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:07.638979 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384231168}
I20260709 13:03:07.371575  6308 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:07.699342  1687 rpcz_store.cc:276] 0709 13:03:06.508315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.508542 (+   227us) service_pool.cc:224] Handling call
0709 13:03:06.508955 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.758152 (+249197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.639475 (+881323us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002d5d54. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:07.639750 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528682880}
W20260709 13:03:07.701460  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.720769  5658 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.721750  1684 raft_consensus.cc:1275] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:03:07.704018  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 282723us
I20260709 13:03:07.728348  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:07.727909  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 889) took 1702 ms. Trace:
I20260709 13:03:07.365381  6366 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:07.706830  1607 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
W20260709 13:03:07.604277  6404 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.435s	user 0.001s	sys 0.002s
I20260709 13:03:07.605566  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2514) took 1794 ms. Trace:
I20260709 13:03:07.736776  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.737358  1611 rpcz_store.cc:276] 0709 13:03:05.810952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.995861 (+184909us) service_pool.cc:224] Handling call
0709 13:03:06.013391 (+ 17530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.166499 (+153108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.605168 (+1438669us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540014afd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:07.605455 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347899136}
I20260709 13:03:07.712253  1536 rpcz_store.cc:276] 0709 13:03:06.570818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.571491 (+   673us) service_pool.cc:224] Handling call
0709 13:03:06.571864 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.345214 (+773350us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b58001649d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea640aa 00007fd02eae6447 00007fd02eafefe7 00007fd02eb007de 00007fd02eb0ab49 00007fd02eb0b416 00007fd02eb07d8f 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4
0709 13:03:07.706930 (+361716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.707135 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79513344}
W20260709 13:03:07.724649  1505 leader_election.cc:336] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.786s (SENT)
I20260709 13:03:07.725533  1616 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 9: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
W20260709 13:03:07.741286  1505 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.832s (SENT)
W20260709 13:03:07.741961  1505 leader_election.cc:336] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.689s (SENT)
I20260709 13:03:07.742384  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:07.743507  1505 leader_election.cc:336] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.715s (SENT)
I20260709 13:03:07.726068  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.726104  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:07.744194  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.729172  1684 rpcz_store.cc:276] 0709 13:03:06.025647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.025848 (+   201us) service_pool.cc:224] Handling call
0709 13:03:06.026241 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:06.510316 (+484075us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54003587a0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7fdc0 00007fd02eb0a1c0 00007fd02eb0b231 00007fd02eb07d8f 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c
0709 13:03:07.444275 (+933959us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b58007ce2d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea640aa 00007fd02eae6447 00007fd02eafefe7 00007fd02eb007de 00007fd02eb0ab49 00007fd02eb0b416 00007fd02eb07d8f 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4
0709 13:03:07.727471 (+283196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.727840 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":770872320}
W20260709 13:03:07.731464  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.731527  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:07.733152  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:07.375029  1610 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:07.745366  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:07.660537  6393 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.647s	user 0.012s	sys 0.000s
W20260709 13:03:07.625602  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51470.4us
I20260709 13:03:07.697291  6287 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:07.570708  6226 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:07.659411  6382 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.025s	user 0.007s	sys 0.004s
W20260709 13:03:07.744678  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.745379  1504 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:07.746336  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.745898  1438 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 14 to 15, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 15 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:07.735998  6403 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.424295  6295 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:07.747709  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.737886  1614 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:07.690068  6048 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.748565  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.545477  5625 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:07.771998  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.507031  6395 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:07.736263  6392 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.759984  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:07.760234  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:07.761034  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:07.783506  1538 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:07.765188  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.373337  6361 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.395s
I20260709 13:03:07.765295  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:07.758886  6380 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.450523  6318 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.725977  6273 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:07.736006  6322 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:03:07.756708  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:07.734290  6366 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:07.808101  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:07.773051  1616 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:07.773478  1682 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 13:03:07.734970  6224 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.759328  1610 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:07.748137  6396 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.749748  6377 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:07.376127  6328 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:07.766301  1505 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.831s (SENT)
I20260709 13:03:07.784448  1612 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:07.757743  6125 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.767499  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.795655  1538 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:07.797247  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:07.768687  6386 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:03:07.802486  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 67e293fa644844dd93fd078b7ba39692: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:07.853899  1538 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:07.816627  6366 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:07.802832  1607 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:07.802977  1537 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:07.855803  1607 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:07.772152  6208 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:07.805423  1687 raft_consensus.cc:2410] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:03:07.809809  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:07.817767  1534 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:07.859143  1539 raft_consensus.cc:2410] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:03:07.818775  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 52496.4us
I20260709 13:03:07.845602  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35722 (request call id 897) took 1165 ms. Trace:
W20260709 13:03:07.834918  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.769207  6226 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:07.789659  6392 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.846199  1613 raft_consensus.cc:2410] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:03:07.772477  6403 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.850369  1609 raft_consensus.cc:2410] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:03:07.818446  1615 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:07.859720  1690 rpcz_store.cc:276] 0709 13:03:06.680340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.681084 (+   744us) service_pool.cc:224] Handling call
0709 13:03:06.681414 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:06.725435 (+ 44021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:06.725560 (+   125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:06.727197 (+  1637us) log.cc:844] Serialized 26 byte log entry
0709 13:03:07.039670 (+312473us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:07.039729 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.039828 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:07.603409 (+563581us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:03:07.819474 (+216065us) raft_consensus.cc:1685] finished
0709 13:03:07.819509 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:07.845498 (+ 25989us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":688,"raft.queue_time_us":46596,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":114,"spinlock_wait_cycles":19496320,"thread_start_us":308929,"threads_started":1,"wal-append.queue_time_us":335074}
W20260709 13:03:07.864621  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.865163  1685 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:07.847702  1535 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:07.846815  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:07.821650  6224 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.864913  6386 raft_consensus.cc:697] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:07.913450  6392 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:07.917768  1540 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:03:07.922978  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.870307  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.820847  6150 consensus_queue.cc:1048] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:03:07.861456  1607 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.929101  1607 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:07.877601  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:07.809350  6273 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:07.864163  6426 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:03:07.869076  1534 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:07.821440  6396 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:07.914866  6386 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:07.924566  1438 catalog_manager.cc:5697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.925571  1609 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:03:07.931424  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 61266.7us
I20260709 13:03:07.941479  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.942634  6396 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:07.942945  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.943471  6396 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:07.944557  1539 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:07.945549  6273 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:07.945765  6392 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:07.946810  1611 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:03:07.947256  1611 pending_rounds.cc:85] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 7
I20260709 13:03:07.947579  1611 pending_rounds.cc:107] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:03:07.948202  1611 raft_consensus.cc:2889] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:07.869021  1614 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:07.955142  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:07.980152  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.982004  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:07.984072  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 215756us
I20260709 13:03:07.937834  6223 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:07.947582  6125 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.996893  1690 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:07.999868  1607 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:08.014470  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:08.022269  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 261606us
W20260709 13:03:08.022994  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.027842  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:07.982837  6392 consensus_queue.cc:1059] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
W20260709 13:03:08.028551  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.043218  5658 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.050227  5658 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.043433  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:08.025733  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 144719us
I20260709 13:03:08.054289  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:08.055244  1534 raft_consensus.cc:2393] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 6: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:08.054427  1537 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:08.046785  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:08.060566  5658 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:08.004360  6328 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.063736  1687 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:08.061816  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.063166  1538 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:07.998188  6396 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:03:08.065879  5658 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:08.066129  1579 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.072952  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:08.073935  1535 raft_consensus.cc:2376] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12. Re-sending same reply.
I20260709 13:03:08.075032  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.075961  1532 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:08.076133  5658 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:07.999581  6125 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:08.081486  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.082054  1616 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:08.079221  1654 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.082849  1616 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:08.046948  6226 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.086752  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:08.045426  6428 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.003271  6223 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:03:08.045595  6371 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.116719  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.072505  6163 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:03:08.085534  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 187219us
W20260709 13:03:08.095638  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 115626us
W20260709 13:03:08.106335  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.079520  6232 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:03:08.090108  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:08.124078  1610 raft_consensus.cc:2393] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 10: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:08.084234  1616 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.121405  1615 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:08.079799  6403 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.128274  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.133493  1616 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.108923  6273 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.151979  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:08.153929  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:08.163301  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 50955.5us
I20260709 13:03:08.122044  6163 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:08.128213  6224 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.125048  6440 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:08.163990  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 48099.7us
I20260709 13:03:08.120654  6204 consensus_queue.cc:1059] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:03:08.152383  6403 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.117638  6428 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.167157  6392 raft_consensus.cc:3055] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:08.173588  6163 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.187252  6396 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.197443  5658 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:08.131423  6328 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:03:08.185104  6438 consensus_queue.cc:1048] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:03:08.191396  6360 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:08.126401  6371 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:08.230414  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 169958us
I20260709 13:03:08.209537  6392 raft_consensus.cc:740] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:03:08.267130  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.238292  6317 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:03:08.316634  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.226140  6250 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.273308  1616 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:08.229637  6403 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:03:08.322479  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.270262  6456 raft_consensus.cc:3055] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:08.282805  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:08.292327  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 140886us
I20260709 13:03:08.302837  1608 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:08.271688  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 86824.3us
I20260709 13:03:08.321126  1689 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:08.330900  1505 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.333963  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.335361  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:08.272425  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 193306us
I20260709 13:03:08.337010  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.338258  6453 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:08.338691  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.339679  1607 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:08.328913  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.340207  5658 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:08.348484  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.335235  1615 raft_consensus.cc:1275] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:08.342046  1686 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
W20260709 13:03:08.321946  6430 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:08.340175  6453 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:03:08.316164  6396 raft_consensus.cc:493] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.356273  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.361843  5658 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:08.324345  6360 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:08.347764  6428 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.376770  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.378058  5658 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:08.378712  6360 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.385732  6371 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:08.386189  6163 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.388490  6460 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.388957  6163 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:08.389300  6460 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.324146  6456 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:08.352260  6421 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.369973  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.352588  6418 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:08.360993  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.322429  6317 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:08.414320  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 53492.1us
I20260709 13:03:08.415165  1505 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.327029  6366 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:08.402879  5658 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:03:08.392752  6443 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.410463  1689 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
W20260709 13:03:08.427340  6377 consensus_meta.cc:287] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.002s
I20260709 13:03:08.391904  6460 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.360194  6208 consensus_queue.cc:1059] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:03:08.393814  6380 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:08.413360  6459 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:08.392406  6457 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.425371  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:08.360942  6441 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:03:08.428622  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.432181  1689 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:08.443166  1689 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:08.444862  6465 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:08.411697  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:08.375861  6392 consensus_queue.cc:260] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.391988  6445 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.446699  6392 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:08.447382  6208 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:08.447909  6208 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:08.448936  6208 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.450181  6208 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:08.452162  6449 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:03:08.453663  1538 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:08.457384  6456 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.458969  6456 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:08.432667  6464 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:08.394578  6442 log.cc:927] Time spent T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:03:08.463034  1613 raft_consensus.cc:1275] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:08.440274  1532 raft_consensus.cc:2410] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:03:08.431813  6377 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:08.369243  6396 raft_consensus.cc:515] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:08.466118  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.430881  6443 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:08.392443  6435 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 13:03:08.455871  6048 consensus_meta.cc:287] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.680s	user 0.005s	sys 0.005s
I20260709 13:03:08.479390  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.439365  6380 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:08.481586  1687 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:08.397809  6462 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:03:08.485124  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.485229  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:08.486243  1610 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:08.487596  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:08.488227  1613 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:08.488355  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.476480  5658 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:08.469029  6250 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:03:08.499023  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.417738  6418 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:08.469373  6459 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:08.502559  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.472659  6443 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:08.535055  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.487176  6273 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.478302  6198 consensus_queue.cc:1059] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:03:08.479295  6457 raft_consensus.cc:2764] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:03:08.554100  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:08.556561  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.535935  6404 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:08.533887  6464 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:08.489034  6380 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:08.569932  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:08.504781  6295 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.541543  6386 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:03:08.578033  6386 raft_consensus.cc:2764] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:03:08.577775  6295 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:08.581310  6295 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:08.489059  6445 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:03:08.570015  6465 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:08.574123  6464 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:08.552544  6273 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:08.633255  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 79279.1us
I20260709 13:03:08.638017  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.640081  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.641089  6457 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.642613  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:08.643908  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.644829  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:08.625417  6464 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.648756  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.649264  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.651849  1505 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.652274  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:08.652966  2367 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:03:08.655800  1608 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:08.547211  6459 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.645853  6250 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:08.650143  6470 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:03:08.646704  6386 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.646298  6366 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:08.646354  6476 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.665987  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.660643  6396 leader_election.cc:290] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:08.671986  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.665764  1653 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:08.697449  6250 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:08.685077  6483 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.700495  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:08.708284  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:08.713963  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.665762  6445 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:03:08.715510  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 49867.8us
I20260709 13:03:08.719475  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:03:08.722853  6484 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
I20260709 13:03:08.728745  2368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d48f4ba9b7ac4684ba28c86536416e65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:08.734262  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.739243  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.740815  1610 raft_consensus.cc:2468] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:08.699906  6380 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.749542  6380 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.751359  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:03:08.754142  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.720587  6366 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:08.759073  6366 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:08.759508  6366 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:08.770241  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.770855  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.739599  6477 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:03:08.733408  6418 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.715575  6476 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.778644  6476 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.782547  6125 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:08.784857  6463 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:08.786223  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:08.791740  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:08.792759  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.793967  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:08.786260  1654 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.815006  1685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1959) took 1085 ms. Trace:
W20260709 13:03:08.815603  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 104321us
I20260709 13:03:08.815567  1685 rpcz_store.cc:276] 0709 13:03:07.729383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.730837 (+  1454us) service_pool.cc:224] Handling call
0709 13:03:07.731122 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.877588 (+146466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.814761 (+937173us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b540032fad4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:08.814946 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207198080}
I20260709 13:03:08.831064  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.831982  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:08.807672  6453 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:08.839008  5658 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:08.833294  6403 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:08.866209  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.824865  6445 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:03:08.825037  6125 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:08.827638  6295 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:03:08.827673  6360 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:03:08.899220  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.836602  6163 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:03:08.908921  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:08.842404  6421 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:03:08.855970  6226 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.885315  6265 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:08.927908  6265 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.930444  6265 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:08.921087  6226 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:08.934314  6226 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:08.947299  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 110139us
I20260709 13:03:08.948299  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:08.949613  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 297872us
W20260709 13:03:08.938813  6489 log.cc:927] Time spent T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:03:08.957895  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:08.947364  6301 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:08.983847  6492 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:03:08.969163  6150 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:08.987684  6150 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:08.988152  6150 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:08.982007  1654 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:08.996606  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2531) took 1276 ms. Trace:
I20260709 13:03:08.997251  1611 rpcz_store.cc:276] 0709 13:03:07.723197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.844807 (+121610us) service_pool.cc:224] Handling call
0709 13:03:07.856074 (+ 11267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.948694 (+ 92620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.996253 (+1047559us) spinlock_profiling.cc:243] Waited 90.3 ms on lock 0x7b54002acbd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:08.996513 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207676288}
I20260709 13:03:08.972985  6265 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:08.979314  6295 consensus_queue.cc:1048] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:03:09.020023  1580 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.560s (SENT) [suppressed 44 similar messages]
I20260709 13:03:09.019992  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:09.005823  6491 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:03:09.025597  6497 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:03:08.975386  6301 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:08.972005  6464 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.037700  6421 raft_consensus.cc:2804] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:09.061086  6421 raft_consensus.cc:697] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:09.062321  6464 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:09.062181  6421 consensus_queue.cc:237] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.064378  6420 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:09.065045  6420 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:09.068185  6485 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:09.058560  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:09.059970  6265 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:09.070740  6265 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.067978  6420 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:09.071347  6265 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:09.072139  6265 consensus_queue.cc:1243] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer e8eefefed88a4903b423e9f487c4805a log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:03:09.073469  6422 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.224s	user 0.003s	sys 0.000s
I20260709 13:03:09.074333  6301 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:09.077117  6425 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 1.196s	user 0.000s	sys 0.003s
I20260709 13:03:09.077347  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:09.078523  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1954) took 2342 ms. Trace:
I20260709 13:03:09.078940  1681 rpcz_store.cc:276] 0709 13:03:06.735730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:06.735876 (+   146us) service_pool.cc:224] Handling call
0709 13:03:06.736218 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:06.760407 (+ 24189us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:06.760440 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:06.761124 (+   684us) log.cc:844] Serialized 52 byte log entry
0709 13:03:07.258933 (+497809us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18002cde20. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:03:07.406294 (+147361us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:07.406361 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:07.406480 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.072707 (+1666227us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:03:09.078285 (+  5578us) raft_consensus.cc:1685] finished
0709 13:03:09.078308 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.078464 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2168,"raft.queue_time_us":2357,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3657,"spinlock_wait_cycles":47675520,"thread_start_us":147046,"threads_started":1,"wal-append.queue_time_us":1012946}
W20260709 13:03:09.080358  6482 log.cc:927] Time spent T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.355s	user 0.005s	sys 0.000s
W20260709 13:03:09.082460  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.082342  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.082948  1532 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
W20260709 13:03:09.083304  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 254765us
I20260709 13:03:08.982581  6443 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.084535  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:09.085058  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.086885  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.088186  1504 leader_election.cc:304] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.088778  1532 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:09.089147  6494 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:09.089852  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.091333  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.093932  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.095095  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.095311  6301 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.096019  6301 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.096675  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.097811  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.098594  1534 raft_consensus.cc:2410] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:09.098696  6301 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:09.099318  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.099080  1687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2457) took 1086 ms. Trace:
I20260709 13:03:09.103657  1687 rpcz_store.cc:276] 0709 13:03:08.012668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.121816 (+109148us) service_pool.cc:224] Handling call
0709 13:03:08.132485 (+ 10669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.484306 (+351821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.098818 (+614512us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54000d4dd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:09.099013 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796499840}
I20260709 13:03:09.105748  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.106526  1534 raft_consensus.cc:2393] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:09.109272  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.111456  1532 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:09.114028  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:09.026541  6366 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:09.120994  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:09.095379  6443 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:09.121757  1609 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:03:09.138248  1687 raft_consensus.cc:1240] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:09.146711  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2553) took 1378 ms. Trace:
I20260709 13:03:09.147310  1541 rpcz_store.cc:276] 0709 13:03:07.768016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.768225 (+   209us) service_pool.cc:224] Handling call
0709 13:03:07.768515 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:07.999213 (+230698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.000133 (+   920us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.025840 (+ 25707us) log.cc:844] Serialized 26 byte log entry
0709 13:03:08.156304 (+130464us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:08.156359 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.205962 (+ 49603us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4800030e58. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd033a31aa1 00007fd033a28b37 00007fd033a289ca 00007fd033b2026f 00007fd033b1ff37 00007fd033b3455c 00007fd033b34508 00007fd033b34488 00007fd033b34443 00007fd033b336ec 00007fd032a5da96
0709 13:03:09.146284 (+940322us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001faed4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:09.146362 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.146424 (+    62us) raft_consensus.cc:1685] finished
0709 13:03:09.146444 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.146629 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13258,"raft.queue_time_us":21630,"raft.run_cpu_time_us":1771,"raft.run_wall_time_us":274322,"spinlock_wait_cycles":309084160,"thread_start_us":227863,"threads_started":2,"wal-append.queue_time_us":290775}
I20260709 13:03:09.157833  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.158530  1541 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
W20260709 13:03:09.158849  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 87107.2us
I20260709 13:03:09.163813  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:09.164220  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.160884  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:09.171648  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.161490  6232 consensus_queue.cc:1048] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:03:09.169895  5625 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.156504  6280 consensus_queue.cc:1059] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:03:09.173828  6453 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:09.169050  6455 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.212164  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:09.216288  1611 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:09.226243  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.227108  1533 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.252192  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.252918  1541 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:09.253829  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.255050  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:09.256850  6502 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.279s	user 0.002s	sys 0.000s
I20260709 13:03:09.258173  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.259325  1533 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:09.259545  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.259685  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:09.260504  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.261355  1533 raft_consensus.cc:2368] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6.
I20260709 13:03:09.261983  6366 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:09.262653  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.263897  1541 raft_consensus.cc:2393] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:09.260789  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.262269  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.265653  1612 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:09.265645  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.266815  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.264256  6318 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:09.218816  6455 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:09.269364  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.269212  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.271445  1688 raft_consensus.cc:1240] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:09.271620  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.287318  6360 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:09.291268  1536 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
W20260709 13:03:09.292366  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.294067  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:09.295851  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.299124  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.300792  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.301816  1536 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:09.301780  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:09.303103  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.304662  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.306703  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.307528  1541 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 9.
W20260709 13:03:09.310071  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.309576  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.290375  6455 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.338141  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.339123  1541 raft_consensus.cc:2376] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12. Re-sending same reply.
W20260709 13:03:09.314407  6475 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.662s	user 0.000s	sys 0.005s
I20260709 13:03:09.305948  6371 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:09.349258  1536 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 13: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:09.270402  6150 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:09.337119  6453 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:09.297672  6360 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.358237  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:09.359251  1612 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.357811  1536 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:09.360777  6360 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:03:09.367110  1612 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:09.367501  6150 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:09.369009  6444 log.cc:927] Time spent T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 1.005s	user 0.002s	sys 0.002s
I20260709 13:03:09.369877  1533 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:09.356856  6453 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.374554  1654 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:09.375510  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.344403  6366 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:03:09.352253  6371 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.384382  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:03:09.400292  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.402452  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 248729us
I20260709 13:03:09.388674  6360 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:09.413375  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.417637  1541 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:09.417496  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:09.418334  1612 raft_consensus.cc:2368] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 10. Current term is 11.
W20260709 13:03:09.385069  6513 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:03:09.385265  6510 log.cc:927] Time spent T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:03:09.425717  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.426532  1580 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.742s (SENT)
I20260709 13:03:09.426997  1580 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.383266  6453 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.397845  6403 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:09.435432  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.391362  6317 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:09.413949  6360 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:09.439457  6360 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:09.429944  6204 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.444810  6204 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.447256  6204 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:09.448189  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:09.449143  1612 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:09.450238  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:09.450922  1612 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.465139  6474 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.466456  6466 raft_consensus.cc:3055] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:09.466869  6466 raft_consensus.cc:740] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:09.467749  6466 consensus_queue.cc:260] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:09.469202  6466 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.470103  6371 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:09.452816  6403 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.463824  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.479028  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.489741  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.491349  1580 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.504423  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.507082  1540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2562) took 1654 ms. Trace:
I20260709 13:03:09.507771  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:09.507745  1540 rpcz_store.cc:276] 0709 13:03:07.852811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.852935 (+   124us) service_pool.cc:224] Handling call
0709 13:03:07.853265 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:07.918376 (+ 65111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.506750 (+1588374us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b540030b454. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:09.506994 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147245440}
I20260709 13:03:09.513727  1539 raft_consensus.cc:1240] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:09.515985  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2539) took 1686 ms. Trace:
I20260709 13:03:09.525039  1540 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:03:09.516510  1614 rpcz_store.cc:276] 0709 13:03:07.829467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:07.973745 (+144278us) service_pool.cc:224] Handling call
0709 13:03:07.974211 (+   466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:07.974785 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:07.974810 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:07.975502 (+   692us) log.cc:844] Serialized 52 byte log entry
0709 13:03:08.128989 (+153487us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:08.129039 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:08.129121 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.336872 (+1207751us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:03:09.503035 (+166163us) raft_consensus.cc:1685] finished
0709 13:03:09.503069 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.515886 (+ 12817us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":79,"spinlock_wait_cycles":21606656,"thread_start_us":145179,"threads_started":1,"wal-append.queue_time_us":312904}
I20260709 13:03:09.528905  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:09.529875  1614 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:03:09.532110  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.531730  1614 raft_consensus.cc:1217] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[11.6-15.8]   Dedup: 11.6->[13.7-15.8]
I20260709 13:03:09.542440  1614 pending_rounds.cc:85] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 6
I20260709 13:03:09.542798  1614 pending_rounds.cc:107] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:09.543130  1614 raft_consensus.cc:2889] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:09.495726  6204 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.494477  6428 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.547070  1540 raft_consensus.cc:1240] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:09.549858  1612 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:09.549858  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:09.512377  6328 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.512876  6456 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:03:09.556998  1540 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:09.556833  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:09.558676  1653 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:09.558856  2362 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.484740  6474 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.561811  1540 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:09.566002  6317 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.567783  1540 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:09.569784  1540 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:03:09.570725  1540 pending_rounds.cc:85] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 5
I20260709 13:03:09.571089  1540 pending_rounds.cc:107] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:03:09.571528  1540 raft_consensus.cc:2889] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:09.578186  1540 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:09.568454  6204 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:03:09.585453  2330 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.587441  1540 raft_consensus.cc:1240] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:09.588074  6204 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:09.590745  6204 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.597084  2362 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:09.598573  2329 leader_election.cc:400] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 10. Current term is 11.
I20260709 13:03:09.598918  2329 leader_election.cc:403] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:03:09.599327  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.599124  6453 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.599555  6280 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for earlier term 10. Current term is 11.
W20260709 13:03:09.601935  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.605026  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:09.608999  1684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48364 (request call id 2462) took 1130 ms. Trace:
I20260709 13:03:09.615429  1684 rpcz_store.cc:276] 0709 13:03:08.478801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.479078 (+   277us) service_pool.cc:224] Handling call
0709 13:03:09.608766 (+1129688us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54001199d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:09.608923 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835148672}
W20260709 13:03:09.605154  6520 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 13:03:09.617849  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2577) took 1154 ms. Trace:
I20260709 13:03:09.623917  1532 raft_consensus.cc:1217] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 5.3->[7.4-9.5]   Dedup: 9.5->[]
I20260709 13:03:09.617954  6455 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:09.627944  1532 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:03:09.631449  6455 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:09.631778  6465 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:09.632442  6465 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.624229  1538 rpcz_store.cc:276] 0709 13:03:08.463342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.463618 (+   276us) service_pool.cc:224] Handling call
0709 13:03:08.463995 (+   377us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:08.464497 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.464527 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:08.465273 (+   746us) log.cc:844] Serialized 78 byte log entry
0709 13:03:08.804434 (+339161us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:08.825779 (+ 21345us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.616759 (+790980us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b1800355ba0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02eb00060 00007fd02eb12716 00007fd02eb23287 00007fd02eb23208
0709 13:03:09.617161 (+   402us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.617384 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.617469 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.617597 (+   128us) raft_consensus.cc:1685] finished
0709 13:03:09.617614 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.617779 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22878,"prepare.queue_time_us":25487,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":99,"raft.queue_time_us":793966,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":3743,"spinlock_wait_cycles":8408960,"thread_start_us":300006,"threads_started":1,"wal-append.queue_time_us":355329}
I20260709 13:03:09.635828  1538 raft_consensus.cc:1217] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 13:03:09.636343  1540 raft_consensus.cc:1240] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:09.612656  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 105079us
I20260709 13:03:09.636543  1538 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:03:09.637338  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:09.638455  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.605077  6273 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:09.641827  1540 raft_consensus.cc:1240] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:09.634553  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:09.647495  1540 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:03:09.649845  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 561809us
W20260709 13:03:09.650956  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.653164  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.653182  1538 raft_consensus.cc:1217] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:03:09.654058  1538 raft_consensus.cc:1240] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:03:09.654554  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.657696  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:09.659391  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.661171  1684 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:09.664209  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:09.663288  1540 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:09.665591  1534 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:03:09.675864  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.672205  1687 raft_consensus.cc:2393] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:09.643002  6319 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:09.665078  6453 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:09.685536  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.686676  6328 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.665814  6386 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:09.688211  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.691006  6528 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.694994  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.642601  6371 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:03:09.696820  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.710351  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.710700  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.711143  1540 raft_consensus.cc:2376] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12. Re-sending same reply.
I20260709 13:03:09.673440  6163 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:09.714102  1580 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:09.666383  6273 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.723770  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.666312  6443 raft_consensus.cc:2749] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:09.727902  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:09.734480  1607 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.695560  6463 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:09.732524  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.699007  6371 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:09.738538  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.687655  6204 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:09.750452  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.753309  1580 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:09.730926  6488 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:09.730218  6319 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:09.705960  6386 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.759107  6428 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.763607  6273 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:09.755764  6456 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:09.764313  6204 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:09.765336  6403 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.734517  6328 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:09.730182  6163 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:09.733357  6528 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:09.742179  6474 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:09.736824  6501 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:09.731252  6506 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:03:09.748206  6371 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:09.781098  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2550) took 1337 ms. Trace:
I20260709 13:03:09.788154  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 897) took 1524 ms. Trace:
W20260709 13:03:09.790618  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 127435us
I20260709 13:03:09.756157  6463 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:09.815061  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.816012  1533 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:09.798353  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:09.773082  6273 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:09.815114  1539 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:09.814008  1608 rpcz_store.cc:276] 0709 13:03:08.443886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.444430 (+   544us) service_pool.cc:224] Handling call
0709 13:03:08.444701 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:08.656220 (+211519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.780823 (+1124603us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b5400420254. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:09.781012 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":484777856}
I20260709 13:03:09.812806  1535 rpcz_store.cc:276] 0709 13:03:08.264023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.271496 (+  7473us) service_pool.cc:224] Handling call
0709 13:03:08.316430 (+ 44934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:08.500570 (+184140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:08.500616 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:08.501243 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:03:08.838176 (+336933us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:08.838226 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.787620 (+949394us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001cb454. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:09.787683 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.787747 (+    64us) raft_consensus.cc:1685] finished
0709 13:03:09.787767 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.788075 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11488,"raft.queue_time_us":12796,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":26431,"spinlock_wait_cycles":395891072,"thread_start_us":336553,"threads_started":1,"wal-append.queue_time_us":409910}
W20260709 13:03:09.818514  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.816151  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.832859  6463 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.831372  6465 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.799798  6528 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:09.835475  6403 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:09.836097  6440 consensus_queue.cc:1059] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:09.800288  6163 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:09.817588  6501 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:09.809846  1607 raft_consensus.cc:2468] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
I20260709 13:03:09.893848  1607 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:09.848757  6386 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:09.770741  6488 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:09.850476  6273 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:09.917229  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.851217  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:09.921532  1612 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.851935  6528 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:09.853469  1532 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:09.857476  6318 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:09.865551  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:09.926378  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.928203  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:09.929212  1532 raft_consensus.cc:2393] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 14: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:09.915124  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:09.932396  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:09.918622  1541 raft_consensus.cc:1217] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 13:03:09.920077  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:09.918742  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 183173us
W20260709 13:03:09.898686  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.948359  2365 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:09.948546  1541 raft_consensus.cc:1240] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:03:09.918555  1537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2587) took 1136 ms. Trace:
I20260709 13:03:09.932396  1579 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:09.974084  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:09.974989  1683 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:09.950616  1537 rpcz_store.cc:276] 0709 13:03:08.782089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:08.834281 (+ 52192us) service_pool.cc:224] Handling call
0709 13:03:08.834603 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:09.623229 (+788626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.623259 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:09.639505 (+ 16246us) log.cc:844] Serialized 52 byte log entry
0709 13:03:09.790237 (+150732us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:09.908987 (+118750us) log.cc:844] Serialized 14 byte log entry
0709 13:03:09.918196 (+  9209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.918287 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:09.918332 (+    45us) raft_consensus.cc:1685] finished
0709 13:03:09.918344 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:09.918490 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":863239,"prepare.queue_time_us":42211,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":812274,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":18497,"thread_start_us":259802,"threads_started":2,"wal-append.queue_time_us":196494}
I20260709 13:03:09.983489  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:09.996333  1537 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:09.996852  1538 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:09.999693  2329 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:09.916631  6371 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.001888  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:10.002152  6403 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:10.002769  6403 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:10.004894  6525 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.404s	user 0.002s	sys 0.002s
I20260709 13:03:10.004678  6328 consensus_queue.cc:1059] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:09.979740  6445 consensus_queue.cc:1059] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:10.007037  6328 raft_consensus.cc:3055] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:10.007426  6328 raft_consensus.cc:740] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:09.922228  6440 consensus_queue.cc:1243] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:10.012015  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:10.015787  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.017541  1689 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:10.018421  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:10.003875  6371 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
W20260709 13:03:10.024225  6521 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.668s	user 0.004s	sys 0.000s
I20260709 13:03:10.096522  1612 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
W20260709 13:03:10.103453  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:09.980073  6474 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:10.007309  6445 raft_consensus.cc:3055] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:03:10.132844  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.035252  6534 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:03:09.974594  6322 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:03:10.164067  1537 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:09.954516  6318 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:10.163942  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 123384us
I20260709 13:03:10.105072  6224 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.012643  6417 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 13:03:10.161309  6204 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:10.171481  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:10.028012  6319 consensus_queue.cc:1059] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.145s
I20260709 13:03:10.145272  6445 raft_consensus.cc:740] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:10.106817  6537 raft_consensus.cc:2804] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:10.169974  6428 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:10.188421  1684 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:10.160813  6328 consensus_queue.cc:260] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.206912  6328 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.208201  6428 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:10.171213  6496 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:10.186295  6204 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:10.210964  6428 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:10.037153  6459 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.185s
I20260709 13:03:10.230206  6318 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:10.226994  6204 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.242822  6318 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.243616  6318 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:10.245877  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 73670.5us
I20260709 13:03:10.246443  6318 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:10.186573  6224 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.248837  6465 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:10.298775  6273 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:10.301640  1608 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:10.246744  6454 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:03:10.306142  1538 raft_consensus.cc:3055] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:10.306670  1538 raft_consensus.cc:740] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:10.301554  6537 raft_consensus.cc:697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:10.307559  1538 consensus_queue.cc:260] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.317157  1538 raft_consensus.cc:3060] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:10.301919  6488 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:10.346477  1541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2287) took 1366 ms. Trace:
I20260709 13:03:10.346999  1541 rpcz_store.cc:276] 0709 13:03:08.980246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.471611 (+491365us) service_pool.cc:224] Handling call
0709 13:03:09.918500 (+446889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.949606 (+ 31106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.346257 (+396651us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540008f2d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb078ad 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:10.346415 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026977152}
I20260709 13:03:10.402570  1538 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:10.309617  6204 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:10.417007  6548 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:03:10.424242  6204 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:10.354501  6377 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.406031  6517 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:03:10.432646  1538 raft_consensus.cc:1240] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:03:10.451159  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.030s	sys 0.029s
W20260709 13:03:10.451731  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.030s	sys 0.029s
I20260709 13:03:10.452023  1541 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:03:10.459573  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 706339us
I20260709 13:03:10.460549  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:10.465975  6163 consensus_meta.cc:287] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.001s
I20260709 13:03:10.466171  6445 consensus_queue.cc:260] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:10.466635  6163 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.468163  1687 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:10.467460  6445 raft_consensus.cc:3060] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:10.451200  6273 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:10.472880  1608 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57944 (request call id 786) took 1141 ms. Trace:
I20260709 13:03:10.454973  6318 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:10.492365  1608 rpcz_store.cc:276] 0709 13:03:09.331221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.885183 (+553962us) service_pool.cc:224] Handling call
0709 13:03:09.885523 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.302715 (+417192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.472525 (+169810us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54003a1bd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:10.472788 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955224448}
I20260709 13:03:10.439900  6377 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.504240  6377 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:10.484668  6280 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:10.505015  6280 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:10.505882  6280 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:10.507347  6280 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.512145  1615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2572) took 1221 ms. Trace:
I20260709 13:03:10.512722  1615 rpcz_store.cc:276] 0709 13:03:09.290717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.821618 (+530901us) service_pool.cc:224] Handling call
0709 13:03:09.821952 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.822193 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:09.822544 (+   351us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.037744 (+215200us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.511637 (+473893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:10.511727 (+    90us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:10.511800 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.511889 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.512064 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56092,"prepare.queue_time_us":68212,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":79,"raft.queue_time_us":255261,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":43594,"spinlock_wait_cycles":64384,"thread_start_us":632044,"threads_started":2,"wal-append.queue_time_us":365700}
I20260709 13:03:10.522305  6540 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:03:10.527979  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 516018us
I20260709 13:03:10.525072  6540 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.511866  6163 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:10.566562  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:03:10.568285  1533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.033s	sys 0.020s
W20260709 13:03:10.568717  1533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.033s	sys 0.020s
I20260709 13:03:10.508368  6318 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:10.571527  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:10.442951  6537 consensus_queue.cc:237] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:10.570034  1582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.010s	sys 0.015s
W20260709 13:03:10.575374  1582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.010s	sys 0.015s
W20260709 13:03:10.575709  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.572711  1682 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.573310  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:10.571652  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:10.577725  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.527699  6233 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:10.588519  6495 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:10.589023  6495 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:10.590060  6495 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.591575  6495 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:10.578426  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.532212  6403 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:10.587920  6531 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.821s	user 0.009s	sys 0.000s
W20260709 13:03:10.598966  1616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.015s	sys 0.014s
I20260709 13:03:10.603493  1682 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
W20260709 13:03:10.604696  1616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.015s	sys 0.014s
I20260709 13:03:10.583552  6233 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:10.612291  6528 consensus_meta.cc:287] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.637s	user 0.005s	sys 0.008s
I20260709 13:03:10.623045  6501 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:10.623677  6561 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:10.624323  6561 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:10.625422  6561 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.626744  6561 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:08.260766   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.631088  1609 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2581) took 1239 ms. Trace:
I20260709 13:03:10.637219  6540 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:10.647559  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.647732  1610 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2569) took 1374 ms. Trace:
I20260709 13:03:10.649060  6318 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:10.648488  1610 rpcz_store.cc:276] 0709 13:03:09.278007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.561247 (+283240us) service_pool.cc:224] Handling call
0709 13:03:09.561517 (+   270us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:09.573430 (+ 11913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.573463 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:09.589041 (+ 15578us) log.cc:844] Serialized 52 byte log entry
0709 13:03:09.696716 (+107675us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:09.696757 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:09.848899 (+152142us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b5400420754. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:09.848969 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.587180 (+738211us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:03:10.647392 (+ 60212us) raft_consensus.cc:1685] finished
0709 13:03:10.647423 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.647652 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1462,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":4801,"spinlock_wait_cycles":25978880,"thread_start_us":81556,"threads_started":1,"wal-append.queue_time_us":139794}
I20260709 13:03:10.657037  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:10.660008  6380 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.660837  6380 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.664027  6224 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:10.666787  6538 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:03:10.670495  6403 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:10.671293  6403 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.672227  6273 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:10.673215  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.673586  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.675611  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:10.681505  6557 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:10.678450  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.682065  6557 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.671185  1607 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2580) took 1279 ms. Trace:
I20260709 13:03:10.660709  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:10.685850  6273 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:10.681141  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.686889  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.687242  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.687542  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.687723  6360 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:10.687868  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.689111  6512 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:10.691299  1612 raft_consensus.cc:1275] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:10.691653  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:10.692529  1608 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:10.696494  6569 log.cc:927] Time spent T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:03:10.701943  6501 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:10.702332  6539 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.687494  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:10.705616  6539 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.702042  6386 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.706867  6386 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.710754  6453 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:10.711405  6163 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:10.711525  6453 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.712747  6163 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:10.702817  6501 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.713794  6163 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:10.608309  6208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.023s	sys 0.014s
W20260709 13:03:10.724777  6208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.023s	sys 0.014s
I20260709 13:03:10.725749  6208 raft_consensus.cc:3055] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:10.726260  6208 raft_consensus.cc:740] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:10.727743  6208 consensus_queue.cc:260] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.769060  6208 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:10.630720  1438 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:10.631440  1609 rpcz_store.cc:276] 0709 13:03:09.392016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.006311 (+614295us) service_pool.cc:224] Handling call
0709 13:03:10.006616 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:10.006906 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:10.006934 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:10.007371 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.347207 (+339836us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:10.347289 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.348325 (+  1036us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.630837 (+282512us) raft_consensus.cc:1685] finished
0709 13:03:10.630863 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.631025 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4071,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":19845,"thread_start_us":337859,"threads_started":1,"wal-append.queue_time_us":562753}
I20260709 13:03:10.778018  1438 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:10.779110  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.779877  6233 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:10.780400  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:10.781088  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.781441  6501 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:10.783473  6386 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:10.784742  6440 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.785351  6440 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:10.787153  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:10.785709  2362 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:10.787142  6539 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:10.789155  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 328718us
I20260709 13:03:10.790584  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:10.791460  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:10.791744  6440 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:10.684792  1607 rpcz_store.cc:276] 0709 13:03:09.391694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.896834 (+505140us) service_pool.cc:224] Handling call
0709 13:03:09.897083 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:09.897265 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:10.314772 (+417507us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.670808 (+356036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:10.670868 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:10.670915 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.670999 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.671120 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":349250,"prepare.queue_time_us":33603,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":350088,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":392576,"threads_started":1}
W20260709 13:03:10.793210  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 117660us
I20260709 13:03:10.793671  6557 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:10.796495  2329 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.012s	sys 0.039s
I20260709 13:03:10.796432  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:10.796983  2329 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.012s	sys 0.039s
I20260709 13:03:10.797226  1689 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:10.776391  6528 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.779582  1438 catalog_manager.cc:5697] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.854315  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:10.818351  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:10.808372  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:10.854692  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:10.797473  1535 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.024s	sys 0.027s
I20260709 13:03:10.803540  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:10.860798  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:10.860841  1504 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:10.818560  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:10.815776  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:10.815604  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 105023us
I20260709 13:03:10.859457  1688 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
W20260709 13:03:10.864722  1535 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.024s	sys 0.028s
I20260709 13:03:10.797662  6380 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:10.793978  1579 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:10.869436  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 75544.6us
W20260709 13:03:10.870847  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 55174.2us
I20260709 13:03:10.873034  1689 raft_consensus.cc:2410] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:03:10.873617  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:10.826642  6273 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:10.894411  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2559) took 1681 ms. Trace:
I20260709 13:03:10.894877  1616 rpcz_store.cc:276] 0709 13:03:09.213331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.213463 (+   132us) service_pool.cc:224] Handling call
0709 13:03:09.213902 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.215374 (+  1472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.215421 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.229214 (+ 13793us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.034579 (+805365us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b1800362740. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a80d1 00007fd02eac3a0f
0709 13:03:10.605151 (+570572us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:10.605192 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.605257 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.894106 (+288849us) raft_consensus.cc:1685] finished
0709 13:03:10.894136 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.894351 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1724,"raft.queue_time_us":1701,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":25523,"spinlock_wait_cycles":9610496,"thread_start_us":570349,"threads_started":1,"wal-append.queue_time_us":1590335}
I20260709 13:03:10.858336  1438 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 6 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.870036  6440 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.885988  6125 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.852684  6445 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:03:10.865720  6539 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:03:10.913954  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:10.915242  1611 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:10.871917  6501 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:10.879107  6557 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:10.923213  6558 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:10.924249  6474 consensus_queue.cc:1059] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:10.932222  1608 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 16.
W20260709 13:03:10.933240  1614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.021s	sys 0.038s
I20260709 13:03:10.933589  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:10.943737  1614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.022s	sys 0.038s
W20260709 13:03:10.934998  1536 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.016s	sys 0.039s
I20260709 13:03:10.926011  6453 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:10.880600  6560 raft_consensus.cc:2804] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:10.886184  6380 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:03:10.945606  1536 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.016s	sys 0.039s
I20260709 13:03:10.835649  6386 consensus_queue.cc:1059] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:03:10.948319  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2584) took 1313 ms. Trace:
I20260709 13:03:10.913082  6512 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:03:10.965377  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d86302e0fce4e1585ef0f1cbc65dc7a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 7)) from {username='slave'} at 127.0.0.1:48524
W20260709 13:03:10.967760  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.020s	sys 0.003s
W20260709 13:03:10.969451  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.020s	sys 0.003s
I20260709 13:03:10.956892  1536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37898 (request call id 2280) took 1984 ms. Trace:
I20260709 13:03:10.961520  1611 rpcz_store.cc:276] 0709 13:03:09.635130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.019179 (+384049us) service_pool.cc:224] Handling call
0709 13:03:10.019411 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.934651 (+915240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.947980 (+ 13329us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540024ccd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:10.948234 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2059793792}
I20260709 13:03:10.827301  6232 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
W20260709 13:03:10.953635  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 65296.6us
I20260709 13:03:10.980543  1533 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:10.982368  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:10.984884  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:10.985538  1608 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 9.
I20260709 13:03:10.986683  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:10.987337  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:10.987655  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:10.988333  1616 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:10.989344  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:10.990005  1607 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:10.990101  1611 raft_consensus.cc:2410] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:03:10.989825  1609 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:10.999307  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:10.999401  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:10.970609  1536 rpcz_store.cc:276] 0709 13:03:08.972591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.360842 (+388251us) service_pool.cc:224] Handling call
0709 13:03:09.361131 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:09.694291 (+333160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:09.694328 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:09.694866 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:03:10.035967 (+341101us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:10.955960 (+919993us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.956321 (+   361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:10.956419 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:10.956483 (+    64us) raft_consensus.cc:1685] finished
0709 13:03:10.956501 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:10.956820 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":404105,"prepare.queue_time_us":154093,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":346805,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":23199,"thread_start_us":1136414,"threads_started":2,"wal-append.queue_time_us":608329}
I20260709 13:03:11.001797  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:10.955711  6474 consensus_queue.cc:1243] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer c98c328741aa493d87abafbf08f04944 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:10.926244  6440 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:10.934787  6456 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:03:11.003820  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:11.012493  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.015759  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:10.960867  6380 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.017899  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:11.019444  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.009s	sys 0.021s
I20260709 13:03:11.019992  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:11.023540  1533 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:11.024495  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:11.025003  1612 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:03:11.025875  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.009s	sys 0.021s
I20260709 13:03:11.026723  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:10.975749  6560 raft_consensus.cc:697] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:10.941912  6501 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.029850  1537 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
W20260709 13:03:11.045847  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.009096  6512 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.052397  6395 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:10.989643  6557 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:03:11.052867  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:11.055521  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.066236  1540 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
W20260709 13:03:11.060565  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.027832  6380 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:11.074859  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.072974  1607 raft_consensus.cc:2468] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:11.015674  6428 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:03:11.043212  6233 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:11.040060  6403 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:11.101639  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.050531  6377 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:11.069015  6395 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:11.123818  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.129510  1540 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:11.074972  6529 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:11.127556  6395 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:11.088377  6150 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:03:11.068629  6512 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:11.148612  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.128270  6377 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.119794  6233 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.182845  1681 raft_consensus.cc:1240] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6. Ops: []
W20260709 13:03:11.175035  6570 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:03:11.160112  6528 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.189767  6440 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.191234  6377 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:11.193084  6360 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.003s
I20260709 13:03:11.193554  6360 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:11.194793  6501 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.197342  6441 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.214030  1686 raft_consensus.cc:2410] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:11.159462  6560 consensus_queue.cc:237] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:11.226564  1684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.013s	sys 0.016s
I20260709 13:03:11.209826  6441 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:11.244378  2362 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:03:11.271910  6512 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:11.290225  6233 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:11.293067  6208 consensus_meta.cc:287] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 13:03:11.293236  6273 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:11.297221  6380 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.301131  6380 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.302330  6125 raft_consensus.cc:3055] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:11.302899  6125 raft_consensus.cc:740] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:11.303850  6125 consensus_queue.cc:260] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.306818  6125 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:11.311772  6445 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:11.321352  6572 log.cc:927] Time spent T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:03:11.348500  6573 log.cc:927] Time spent T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:03:11.389396  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.390709  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.392647  1535 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.014s	sys 0.038s
W20260709 13:03:11.392987  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.393286  1535 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.014s	sys 0.038s
W20260709 13:03:11.393306  1505 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.009s	sys 0.006s
W20260709 13:03:11.394219  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.394529  1505 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.009s	sys 0.006s
I20260709 13:03:11.394868  1533 raft_consensus.cc:2393] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:03:11.395231  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 512465us
I20260709 13:03:11.397820  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2608) took 1383 ms. Trace:
W20260709 13:03:11.402426  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.405450  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.412348  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.227157  1684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.013s	sys 0.016s
I20260709 13:03:11.416244  1614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2567) took 2186 ms. Trace:
I20260709 13:03:11.416932  1614 rpcz_store.cc:276] 0709 13:03:09.229561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:09.530946 (+301385us) service_pool.cc:224] Handling call
0709 13:03:09.531427 (+   481us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:09.644062 (+112635us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:09.678216 (+ 34154us) log.cc:844] Serialized 14 byte log entry
0709 13:03:10.944303 (+1266087us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:11.070820 (+126517us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b2c0000e5c8. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:03:11.071464 (+   644us) log.cc:844] Serialized 52 byte log entry
0709 13:03:11.071654 (+   190us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:11.071701 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.071813 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.415236 (+343423us) raft_consensus.cc:1685] finished
0709 13:03:11.415425 (+   189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.415884 (+   459us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15287,"prepare.queue_time_us":34978,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":39,"raft.queue_time_us":184587,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":8685,"spinlock_wait_cycles":35864320,"thread_start_us":1290816,"threads_started":3,"wal-append.queue_time_us":549566}
I20260709 13:03:11.421599  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:11.429891  6441 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.430270  6554 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.431651  6554 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.434867  6440 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.323279  6445 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:11.436522  6554 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.437299  6554 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.438206  6554 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.426959  6208 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.439740  6208 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.440541  6539 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:11.441273  6539 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:11.442384  6208 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.427002  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:11.443423  1610 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 9.
I20260709 13:03:11.428352  6273 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.428831  6380 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.444634  6273 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.445063  6380 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.429229  6386 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:11.448236  6273 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.448769  6386 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:11.450165  6421 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.450445  6576 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:11.398583  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 172) took 23841 ms (client timeout 15000 ms). Trace:
I20260709 13:03:11.451659  6576 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.452898  6501 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:11.453706  6386 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:11.438159  6445 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.455003  6576 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.455336  6440 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.462219  6440 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:11.452270  1439 rpcz_store.cc:269] 0709 13:02:47.557165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:47.557356 (+   191us) service_pool.cc:224] Handling call
0709 13:03:11.398071 (+23840715us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:03.252143 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:03.252857 (+   714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:03.252916 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:03:03.252934 (+    18us) tablet.cc:662] Decoding operations
0709 13:03:03.254432 (+  1498us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:03.254541 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:03.254575 (+    34us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:03:03.256228 (+  1653us) tablet.cc:701] Row locks acquired
0709 13:03:03.256300 (+    72us) write_op.cc:260] PREPARE: finished
0709 13:03:03.256467 (+   167us) write_op.cc:270] Start()
0709 13:03:03.256622 (+   155us) write_op.cc:276] Timestamp: P: 1783602183256400 usec, L: 0
0709 13:03:03.256642 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:03:03.328487 (+ 71845us) log.cc:844] Serialized 6741 byte log entry
0709 13:03:04.204903 (+876416us) op_driver.cc:464] REPLICATION: finished
0709 13:03:04.800696 (+595793us) write_op.cc:301] APPLY: starting
0709 13:03:04.813773 (+ 13077us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:05.393418 (+579645us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:05.393620 (+   202us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:05.608992 (+215372us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:05.609390 (+   398us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=0,mrs_lookups=0
0709 13:03:05.609456 (+    66us) write_op.cc:312] APPLY: finished
0709 13:03:05.609944 (+   488us) log.cc:844] Serialized 156 byte log entry
0709 13:03:05.653556 (+ 43612us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:05.653754 (+   198us) write_op.cc:454] Released schema lock
0709 13:03:05.653844 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:05.654311 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:05.654343 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":242903,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":513059,"apply.run_cpu_time_us":52380,"apply.run_wall_time_us":893089,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75119,"num_ops":17,"prepare.queue_time_us":133638,"prepare.run_cpu_time_us":21836,"prepare.run_wall_time_us":245994,"raft.queue_time_us":354833,"raft.run_cpu_time_us":81828,"raft.run_wall_time_us":338354,"replication_time_us":948042,"thread_start_us":777533,"threads_started":5,"wal-append.queue_time_us":196527,"wal-append.run_cpu_time_us":46810,"wal-append.run_wall_time_us":2796130}]]}
I20260709 13:03:11.463465  6554 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.455209  6380 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.424727  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.469062  6539 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:11.451227  6421 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:11.480070  1610 raft_consensus.cc:1240] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:11.475666  6421 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:11.398660  1535 rpcz_store.cc:276] 0709 13:03:10.013873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.013999 (+   126us) service_pool.cc:224] Handling call
0709 13:03:10.041401 (+ 27402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.041611 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:10.870658 (+829047us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.396628 (+525970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:11.396817 (+   189us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:11.397035 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.397225 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.397655 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120613,"prepare.queue_time_us":152413,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"thread_start_us":1207401,"threads_started":2,"wal-append.queue_time_us":435051}
W20260709 13:03:11.570912  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.567965  1579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.007s
W20260709 13:03:11.579475  1579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.004s	sys 0.007s
W20260709 13:03:11.579916  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 573025us
I20260709 13:03:11.585053  6587 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:11.585309  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.591609  6539 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.598446  6554 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:11.636796  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:03:11.643023  1539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.020s	sys 0.010s
W20260709 13:03:11.643653  1539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.020s	sys 0.011s
W20260709 13:03:11.643110  1608 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.013s	sys 0.013s
W20260709 13:03:11.644531  1608 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.014s	sys 0.013s
W20260709 13:03:11.645655  1654 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.035s	sys 0.047s
W20260709 13:03:11.646173  1654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.035s	sys 0.047s
I20260709 13:03:11.646943  6587 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.648798  6204 raft_consensus.cc:493] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:11.649998  6204 raft_consensus.cc:515] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:11.650484  6587 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.652276  6539 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:11.654573  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 233481us
I20260709 13:03:11.655062  6539 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.657434  1614 raft_consensus.cc:1275] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:03:11.661350  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:11.661621  6395 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.652292  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.669574  6150 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:11.670312  6150 raft_consensus.cc:493] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:11.670823  6150 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:11.672878  6363 consensus_queue.cc:1059] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:03:11.643285  1537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.000s	sys 0.020s
W20260709 13:03:11.673803  1541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.010s	sys 0.014s
W20260709 13:03:11.673869  1532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.011s	sys 0.000s
W20260709 13:03:11.686908  1537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.001s	sys 0.021s
W20260709 13:03:11.682871  1541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.010s	sys 0.015s
W20260709 13:03:11.689891  1532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.013s	sys 0.000s
W20260709 13:03:11.691028  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.688181  1438 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.027s	sys 0.004s
I20260709 13:03:11.695844  6453 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:03:11.700917  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.702704  1438 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.028s	sys 0.004s
I20260709 13:03:11.707695  1687 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:11.696662  1613 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.007s	sys 0.003s
W20260709 13:03:11.712325  6495 consensus_meta.cc:287] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 1.088s	user 0.017s	sys 0.008s
W20260709 13:03:11.708614  1534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.007s	sys 0.007s
W20260709 13:03:11.694218  1598 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.004s	sys 0.008s
W20260709 13:03:11.720870  1613 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.008s	sys 0.003s
I20260709 13:03:11.722451  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:11.722772  6421 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:11.722988  1540 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:03:11.720310  1580 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.007s	sys 0.007s
I20260709 13:03:11.703743  6395 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:11.724776  1611 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.000s	sys 0.015s
W20260709 13:03:11.726389  1534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.008s	sys 0.008s
W20260709 13:03:11.730526  1580 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.007s	sys 0.007s
W20260709 13:03:11.718338  1609 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.004s	sys 0.008s
I20260709 13:03:11.734081  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:11.738126  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:11.738425  6380 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.739459  6380 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.742865  6380 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.743014  1685 raft_consensus.cc:1240] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:11.727341  6421 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:11.747490  6421 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:11.725343  6453 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.750336  6490 raft_consensus.cc:3055] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:11.750852  6490 raft_consensus.cc:740] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:11.750212  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.754729  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:11.755357  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.732594  1683 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.019s	sys 0.025s
W20260709 13:03:11.727694  1598 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.005s	sys 0.008s
W20260709 13:03:11.760802  1683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.019s	sys 0.025s
W20260709 13:03:11.762056  1609 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.006s	sys 0.009s
W20260709 13:03:11.759931  1611 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.000s	sys 0.016s
I20260709 13:03:11.707883  6554 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:11.754241  6453 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:11.767674  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 809977us
I20260709 13:03:11.784409  6498 consensus_queue.cc:1048] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:03:11.786873  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.763864  6490 consensus_queue.cc:260] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:11.779759  6592 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:03:11.793957  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.805105  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.818746  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:11.805063  6204 leader_election.cc:290] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:11.810325  6607 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.822676  6495 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:11.822736  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.823608  6495 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.825022  6490 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:11.826328  6495 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.838600  6488 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:11.838291  6512 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:11.839898  6512 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:11.839654  6488 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:11.840492  6512 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:03:11.847049  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.841450  6554 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:11.853050  6224 raft_consensus.cc:3055] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:11.853564  6224 raft_consensus.cc:740] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:11.854676  6224 consensus_queue.cc:260] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.860539  6607 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:11.867766  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.857709  6224 raft_consensus.cc:3060] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:11.870425  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:11.868661  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:11.878328  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:11.878539  1538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 911) took 1701 ms. Trace:
I20260709 13:03:11.879142  2367 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:11.879320  1538 rpcz_store.cc:276] 0709 13:03:10.144326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.440635 (+296309us) service_pool.cc:224] Handling call
0709 13:03:10.442563 (+  1928us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:11.122725 (+680162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.122755 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:11.123318 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:03:11.689764 (+566446us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:11.780120 (+ 90356us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.822128 (+ 42008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.837840 (+ 15712us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:11.837900 (+    60us) raft_consensus.cc:1685] finished
0709 13:03:11.842830 (+  4930us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:11.845715 (+  2885us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":250943,"raft.queue_time_us":299557,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":241,"thread_start_us":943154,"threads_started":3,"wal-append.queue_time_us":506660}
I20260709 13:03:11.881242  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ec23ffe82f42bfad9cca928a92d9ab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.892179  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.892969  1690 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
W20260709 13:03:11.918514  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:11.925218  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 78280.8us
I20260709 13:03:11.926954  1580 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:11.929961  6495 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.931495  6403 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.933334  6605 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:11.937359  6428 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:11.937570  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:11.949235  1681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2487) took 1034 ms. Trace:
I20260709 13:03:11.949524  6512 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:11.951371  1504 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:11.965303  1681 rpcz_store.cc:276] 0709 13:03:10.914617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.011009 (+ 96392us) service_pool.cc:224] Handling call
0709 13:03:11.011334 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.184486 (+173152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:11.948638 (+764152us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400117bd4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb08e01 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:11.949009 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393904512}
I20260709 13:03:11.975018  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.970837  6380 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:11.994877  1687 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:11.981559  6607 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:11.966961  6421 consensus_queue.cc:1048] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:03:12.005291  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:11.983460  6380 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:11.988670  6554 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:12.030900  1689 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:12.029763  1504 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:11.996485  6495 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:12.037847  1581 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.021731  6380 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.041118  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:11.983599  6428 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:12.044126  6606 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.329s	user 0.004s	sys 0.001s
I20260709 13:03:12.045074  1616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2600) took 1052 ms. Trace:
I20260709 13:03:12.047282  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.048193  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet 7d86302e0fce4e1585ef0f1cbc65dc7a (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
W20260709 13:03:12.048995  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 122195us
I20260709 13:03:12.050242  6512 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:12.070043  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.053023  6488 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:12.060896  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.073084  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 47458us
I20260709 13:03:12.040028  6607 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.004527  6605 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.078809  1611 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2604) took 1083 ms. Trace:
I20260709 13:03:12.083312  1685 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:12.082029  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48349us
I20260709 13:03:12.086153  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:12.080863  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2602) took 1086 ms. Trace:
W20260709 13:03:12.088634  1424 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 110454us
I20260709 13:03:12.083282  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:12.088124  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.097118  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:12.097239  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 75118.5us
I20260709 13:03:12.100970  1579 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:12.103789  6204 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:12.104255  6558 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.089600  6395 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:12.104874  6558 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.105314  6395 raft_consensus.cc:697] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:12.106426  6395 consensus_queue.cc:237] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.107158  6558 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.036674  6403 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.110666  6403 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.112188  6445 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:12.115902  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.068707  1616 rpcz_store.cc:276] 0709 13:03:10.992210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.992704 (+   494us) service_pool.cc:224] Handling call
0709 13:03:10.993055 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:10.993336 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:10.999383 (+  6047us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.880417 (+881034us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b18001ef1c0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b9fde07 00007fd034858ab9 00007fd02ba1a69b 00007fd02ba1893f 00007fd02ba1ac02 00007fd02e6a220b 00007fd02e6a7d23 00007fd02e6a823a 00007fd02eb12a2a
0709 13:03:12.043828 (+163411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.043914 (+    86us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:12.043973 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.044455 (+   482us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.044805 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30117,"prepare.queue_time_us":5241,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":30935,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":163,"spinlock_wait_cycles":18875264,"thread_start_us":139069,"threads_started":1}
I20260709 13:03:12.095836  6488 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:12.125588  6488 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:12.128132  6607 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.130743  6607 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.134030  6453 consensus_queue.cc:1059] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:12.135525  6421 raft_consensus.cc:3055] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:12.135967  6421 raft_consensus.cc:740] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:12.137044  6421 consensus_queue.cc:260] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.143798  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.143597  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.144600  1608 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:03:12.145051  1608 pending_rounds.cc:85] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 5
I20260709 13:03:12.145298  6428 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:12.145808  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.147286  1614 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:12.147398  6605 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.079152  1611 rpcz_store.cc:276] 0709 13:03:10.995599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.005303 (+  9704us) service_pool.cc:224] Handling call
0709 13:03:11.005613 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.005835 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:03:11.795903 (+790068us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.016760 (+220857us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.021738 (+  4978us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:03:12.028353 (+  6615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.035807 (+  7454us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.078764 (+ 42957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3414,"prepare.queue_time_us":113550,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2664,"raft.queue_time_us":14797,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":10539,"thread_start_us":876210,"threads_started":2,"wal-append.queue_time_us":196780}
I20260709 13:03:12.087174  1613 rpcz_store.cc:276] 0709 13:03:10.994795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.994949 (+   154us) service_pool.cc:224] Handling call
0709 13:03:11.023248 (+ 28299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:11.023529 (+   281us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:11.771924 (+748395us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.050794 (+278870us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.063137 (+ 12343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:12.063220 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:12.063351 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.064348 (+   997us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.080780 (+ 16432us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31156,"prepare.queue_time_us":183987,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":118,"raft.queue_time_us":29838,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":16081,"thread_start_us":833151,"threads_started":2,"wal-append.queue_time_us":232416}
I20260709 13:03:12.162127  1610 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:12.145308  1608 pending_rounds.cc:107] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:03:12.162760  1608 raft_consensus.cc:2889] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:12.166857  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:12.184957  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.185621  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.186019  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.185901  6150 consensus_meta.cc:287] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.007s
W20260709 13:03:12.195393  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.189854  6488 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:12.196272  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:12.184823  6125 consensus_meta.cc:287] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.725s	user 0.011s	sys 0.011s
I20260709 13:03:12.199105  1608 raft_consensus.cc:2410] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:12.198203  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:12.214597  2365 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:12.224594  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 125018us
W20260709 13:03:12.229357  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 96911.7us
I20260709 13:03:12.234606  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.200841  6605 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:12.200908  6150 raft_consensus.cc:515] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:12.252348  1541 pending_rounds.cc:85] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 9
I20260709 13:03:12.258031  1541 pending_rounds.cc:107] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:03:12.229053  6428 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.263419  6428 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.265273  1608 raft_consensus.cc:1217] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 13:03:12.273955  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.274240  1608 raft_consensus.cc:1240] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:03:12.275213  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.268782  6495 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:12.275512  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet fbf20d67081f4a66af2b6a3bb0145baf: Illegal state: Replica e8eefefed88a4903b423e9f487c4805a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
W20260709 13:03:12.261909  1505 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 2.691s (SENT)
I20260709 13:03:12.258440  1541 raft_consensus.cc:2889] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:12.295840  6421 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:12.296761  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.307160  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.300812  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:12.275238  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.290185  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.267788  1612 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:12.318920  1611 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
I20260709 13:03:12.302735  1683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48366 (request call id 1989) took 1249 ms. Trace:
I20260709 13:03:12.276818  1613 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:03:12.280567  1616 raft_consensus.cc:1240] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:03:12.304287  1681 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:12.322434  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:12.273272  1607 raft_consensus.cc:1240] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:03:12.300444  6558 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.323566  6607 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.323938  6558 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:12.325173  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 76903.3us
I20260709 13:03:12.326519  6558 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:12.281047  1610 raft_consensus.cc:2410] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:12.289002  2363 raft_consensus.cc:2393] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 11: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:03:12.329200  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.328351  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.320741  1683 rpcz_store.cc:276] 0709 13:03:11.011505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:11.011665 (+   160us) service_pool.cc:224] Handling call
0709 13:03:11.016144 (+  4479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:11.813396 (+797252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:11.814632 (+  1236us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:11.881814 (+ 67182us) log.cc:844] Serialized 52 byte log entry
0709 13:03:11.983814 (+102000us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:12.081758 (+ 97944us) log.cc:844] Serialized 14 byte log entry
0709 13:03:12.242482 (+160724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:12.253265 (+ 10783us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:12.253329 (+    64us) raft_consensus.cc:1685] finished
0709 13:03:12.253352 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:12.257773 (+  4421us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15868,"prepare.queue_time_us":141734,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":75190,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":13427,"thread_start_us":1032610,"threads_started":4,"wal-append.queue_time_us":190799}
I20260709 13:03:12.289939  6150 leader_election.cc:290] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.266520  6428 leader_election.cc:290] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:12.266053  6621 log.cc:927] Time spent T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.084s	user 0.003s	sys 0.000s
I20260709 13:03:12.334550  6380 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:12.275842  1614 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.321064  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.337455  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.273438  1685 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 16.
I20260709 13:03:12.330194  1607 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:12.319383  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.321276  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.299870  6495 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.340353  6495 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.341322  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.342558  6495 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.342792  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.346617  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.352855  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:12.347260  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.337641  1611 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:12.357288  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.358777  1611 raft_consensus.cc:1240] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:12.292992  6605 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:12.351454  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.361302  1613 raft_consensus.cc:2410] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:03:12.361873  6605 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:12.367360  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.369400  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.371079  1616 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
W20260709 13:03:12.372118  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 111793us
W20260709 13:03:12.376757  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 131373us
I20260709 13:03:12.378170  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.380722  6619 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:12.384784  1607 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:03:12.390128  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:12.392411  1683 raft_consensus.cc:3060] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:12.392729  1612 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:12.394991  2329 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:12.401121  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.410077  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.410061  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:12.416285  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.396165  6558 raft_consensus.cc:493] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.406260  6428 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.424196  1607 raft_consensus.cc:2468] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
I20260709 13:03:12.426386  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.424821  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.424564  1614 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:12.424934  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.428773  6438 raft_consensus.cc:2804] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:12.430358  1612 raft_consensus.cc:2410] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:12.439426  6428 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.446580  6438 raft_consensus.cc:697] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:12.449282  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.449667  6554 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:12.453428  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.453822  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.455225  1607 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:12.455834  1608 raft_consensus.cc:2410] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:12.458835  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.435021  6558 raft_consensus.cc:515] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.461244  6438 consensus_queue.cc:237] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:12.463344  6558 leader_election.cc:290] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.464150  1504 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:12.465770  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.470466  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:12.473666  6495 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:12.474327  6495 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:12.474464  6224 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.474768  6428 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.474561  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:12.476821  6607 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:12.471729  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:12.475314  6495 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.481874  6554 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.484206  6380 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:12.487906  6619 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:12.489233  6622 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:12.489724  6622 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:12.490620  6622 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.491926  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.492122  6622 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:12.492449  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.492986  6512 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:12.493383  6512 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:12.493754  6512 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.499907  1608 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:12.501015  6554 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.501905  6554 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.511011  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.513065  6554 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.518155  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.518333  6512 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.518489  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.521282  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
W20260709 13:03:12.538719  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.544715  1607 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:12.545713  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.537818  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:12.551085  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.558878  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.559439  6445 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.537400  6554 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.560251  6445 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.560477  6554 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.562479  6554 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:12.563488  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 2e50d062d07e4a4eac4206ea9ec136cd: Illegal state: Replica f6eecf73c1c24b5eb268b5088a3030d4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:12.547653  1608 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:12.565632  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.567087  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.568523  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.569201  1608 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:12.570499  6445 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.589481  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.590698  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.592170  6456 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.592860  6456 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.595165  6456 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.597499  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.598202  1690 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 6.
I20260709 13:03:12.580883  6554 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.599954  6554 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.602293  6554 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.605264  1579 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.608234  2363 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:12.609441  1504 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:12.608961  1612 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:12.613449  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.613970  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.614661  1685 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:12.615664  1579 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.617530  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.620357  1615 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:12.609393  6554 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:12.615694  6421 raft_consensus.cc:2764] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:03:12.619639  6395 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:12.622864  6585 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:12.628278  6395 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:12.627478  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.629755  1615 raft_consensus.cc:2410] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:03:12.629674  6395 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:12.628455  6585 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.637987  1690 raft_consensus.cc:1240] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:12.626847  6554 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.646013  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:12.645167  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.646883  1615 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:12.652617  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.653962  6619 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:12.654383  6619 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:12.654798  6619 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:12.663156  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.637822  6585 raft_consensus.cc:3060] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:12.664767  1683 raft_consensus.cc:2468] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:03:12.672668  6453 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:12.672639  6558 consensus_queue.cc:1059] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:12.668430  6554 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:12.674604  6558 raft_consensus.cc:3055] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:12.675921  6558 raft_consensus.cc:740] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:03:12.680169  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.680446  6558 consensus_queue.cc:260] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.681849  6558 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.681099  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:12.685294  6462 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:12.685913  6462 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:12.686728  6462 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.689927  6623 consensus_queue.cc:1059] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:12.694257  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:03:12.699442  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.700258  6512 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:12.710001  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.712870  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:12.714651  6627 log.cc:927] Time spent T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 13:03:12.705506  6125 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:12.716377  6619 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.720543  6590 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:12.732203  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.732903  1614 raft_consensus.cc:2376] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12. Re-sending same reply.
I20260709 13:03:12.733366  6619 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:12.729350  6125 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.714026  6512 raft_consensus.cc:2764] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:03:12.730677  1608 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
W20260709 13:03:12.749465  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet dbc0065dafc14741989730fd503966f0: Illegal state: Replica e8eefefed88a4903b423e9f487c4805a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
W20260709 13:03:12.751296  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 57206.9us
I20260709 13:03:12.751546  1683 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:12.752156  6554 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.752640  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.753024  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:12.753592  1607 raft_consensus.cc:2410] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:03:12.745393  6456 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.754392  6554 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.754681  6456 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.755607  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:12.757210  6456 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.757392  1690 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:12.755919  6421 raft_consensus.cc:3055] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:12.756661  6619 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:12.758236  6619 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:12.758654  6619 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.759680  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.760370  1685 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:12.761441  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.757027  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:12.768473  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.771492  6125 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.765501  6456 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:12.772509  6456 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:12.772943  6456 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.742161  6590 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:12.773754  1690 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:03:12.776656  1579 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.778129  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.781167  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:12.783694  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 469f8c03f4924f809435141a09c976fa: Illegal state: Replica f6eecf73c1c24b5eb268b5088a3030d4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:12.781191  6403 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:03:12.775892  6590 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:12.761011  6421 raft_consensus.cc:740] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:12.796706  6421 consensus_queue.cc:260] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.795692  6558 raft_consensus.cc:2804] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:12.804986  6558 raft_consensus.cc:697] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:12.806152  6558 consensus_queue.cc:237] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.804499  6421 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.810688  1615 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 16.
I20260709 13:03:12.811442  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.812626  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.814741  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.814998  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.815557  1610 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:12.815672  1616 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:12.812896  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.813632  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.816897  1609 raft_consensus.cc:2376] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10. Re-sending same reply.
I20260709 13:03:12.817823  1607 raft_consensus.cc:2376] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13. Re-sending same reply.
I20260709 13:03:12.794749  6585 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.825707  6456 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.827083  6585 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.828080  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:12.838223  6590 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:12.841043  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:12.800050  6619 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.842774  1684 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:12.845940  1685 raft_consensus.cc:2468] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:12.847405  1579 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.847651  1612 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:12.848304  6125 raft_consensus.cc:2804] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:12.848881  6125 raft_consensus.cc:697] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:12.849757  6125 consensus_queue.cc:237] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.857612  1684 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:03:12.859095  1579 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:12.844662  6456 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.860554  1683 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:12.860051  6585 raft_consensus.cc:2804] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:12.861498  6619 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:12.861832  6585 raft_consensus.cc:697] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:12.865615  6395 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:12.865890  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.866626  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.866747  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.868476  1616 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:12.868657  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.869071  1610 raft_consensus.cc:2410] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:03:12.869341  1615 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:12.865437  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.870345  1607 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 9.
I20260709 13:03:12.867892  6403 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:12.866734  6585 consensus_queue.cc:237] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.871387  6403 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:12.878768  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 98) took 10907 ms. Trace:
I20260709 13:03:12.879789  6403 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.876633  1435 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 5 to 6, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 6 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:12.879434  1438 rpcz_store.cc:276] 0709 13:03:01.972057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:01.972371 (+   314us) service_pool.cc:224] Handling call
0709 13:03:12.870490 (+10898119us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:11.769284 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:11.861545 (+ 92261us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:11.861610 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:03:11.861633 (+    23us) tablet.cc:662] Decoding operations
0709 13:03:11.864094 (+  2461us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:11.864208 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:11.864256 (+    48us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:03:11.940809 (+ 76553us) tablet.cc:701] Row locks acquired
0709 13:03:11.940868 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:03:11.941083 (+   215us) write_op.cc:270] Start()
0709 13:03:11.941441 (+   358us) write_op.cc:276] Timestamp: P: 1783602191941005 usec, L: 0
0709 13:03:11.941492 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 13:03:11.942896 (+  1404us) log.cc:844] Serialized 2835 byte log entry
0709 13:03:12.501110 (+558214us) op_driver.cc:464] REPLICATION: finished
0709 13:03:12.670638 (+169528us) write_op.cc:301] APPLY: starting
0709 13:03:12.673207 (+  2569us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:12.754944 (+ 81737us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:12.755088 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:12.771936 (+ 16848us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:12.822927 (+ 50991us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 13:03:12.823041 (+   114us) write_op.cc:312] APPLY: finished
0709 13:03:12.824186 (+  1145us) log.cc:844] Serialized 73 byte log entry
0709 13:03:12.825462 (+  1276us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.825654 (+   192us) write_op.cc:454] Released schema lock
0709 13:03:12.825755 (+   101us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:12.826419 (+   664us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:12.835711 (+  9292us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3070267,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":125531,"apply.run_cpu_time_us":14547,"apply.run_wall_time_us":183551,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33359,"num_ops":7,"prepare.queue_time_us":782992,"prepare.run_cpu_time_us":22206,"prepare.run_wall_time_us":290257,"raft.queue_time_us":298322,"raft.run_cpu_time_us":30507,"raft.run_wall_time_us":127281,"replication_time_us":529937,"thread_start_us":951883,"threads_started":4,"wal-append.queue_time_us":174958}]]}
I20260709 13:03:12.886575  1435 catalog_manager.cc:5697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:12.887279  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.888531  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 131573us
I20260709 13:03:12.895219  6395 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:12.895699  1614 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:12.895768  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.896766  1615 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:12.897060  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.897076  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:12.897657  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.898610  1610 raft_consensus.cc:2410] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:03:12.899596  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.897917  1608 raft_consensus.cc:2393] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:12.900825  1612 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:12.888027  6403 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:12.902933  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.903795  1613 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:12.895780  6395 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:12.929909  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:12.928952  1505 leader_election.cc:336] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Timed out: RequestConsensusVote RPC to 127.0.107.194:43963 timed out after 1.509s (SENT)
I20260709 13:03:12.932211  1684 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:12.930703  1616 raft_consensus.cc:2376] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 16. Re-sending same reply.
I20260709 13:03:12.934082  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:12.934042  1505 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:12.937784  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.939667  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:12.932279  6395 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:12.940593  1435 catalog_manager.cc:5697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 2 to 9, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.940534  6495 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:12.941716  6150 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:03:12.966586  1654 leader_election.cc:304] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:12.968969  1616 raft_consensus.cc:1275] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:03:12.969956  6619 raft_consensus.cc:2749] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:12.972688  6421 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:12.972922  1654 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:12.975270  6421 raft_consensus.cc:2804] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:12.975848  6421 raft_consensus.cc:697] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:12.976748  6421 consensus_queue.cc:237] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:12.983716  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:12.984580  1435 catalog_manager.cc:5697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 5 to 8, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:12.995409  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:12.995482  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.013986  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.013139  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.023213  1538 raft_consensus.cc:2368] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6.
I20260709 13:03:13.023173  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.016108  6498 consensus_queue.cc:1048] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:03:13.025779  1541 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:13.036329  6498 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.036955  6498 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:13.038594  1683 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:13.040709  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.039338  6498 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:13.044003  6403 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:13.048429  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.049228  1613 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 10.
W20260709 13:03:13.052678  6643 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260709 13:03:13.045550  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.055930  1534 raft_consensus.cc:2410] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:03:13.060566  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.058508  2329 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:13.064543  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.077070  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.077714  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.077749  1541 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:13.082738  1538 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 6.
I20260709 13:03:13.088393  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.089802  1538 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:13.105373  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.107087  1538 raft_consensus.cc:3060] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:13.119937  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.124349  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.129434  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.080616  6620 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:13.134941  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.083300  6125 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:13.142990  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.143128  1615 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:13.152828  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.103581  6554 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:13.158509  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71514c8580924feb8600dfd3daef60d8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.162336  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.136186  6620 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.165067  1540 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:13.173715  1607 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:03:13.180173  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.180734  1607 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 16.
I20260709 13:03:13.181396  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.181968  1541 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.182090  6560 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:13.165848  6554 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.182993  6560 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:13.184273  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.184906  6380 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:13.185432  6380 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:13.187525  6380 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:13.169229  6623 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.188580  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.189181  6554 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:13.188894  6623 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.189918  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:13.190384  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.169723  6620 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.192857  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:13.193197  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:13.194967  1614 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:03:13.228014  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.170846  6635 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:13.241142  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.191992  6623 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:13.251142  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.253515  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.254163  1614 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:13.167567  6125 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.267047  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.293951  1537 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:13.304014  6650 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:03:13.315627  1615 raft_consensus.cc:2468] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:13.265601  6554 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.318040  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.333863  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.294629  6445 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:13.347498  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.362090  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.266891  6635 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.346205  6560 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:13.387408  1654 leader_election.cc:304] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:13.388942  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.349931  6445 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.423718  6622 raft_consensus.cc:2749] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:13.424693  6622 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:13.427911  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.432847  1532 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:13.433816  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.364316  6554 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:13.436436  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 86686.9us
I20260709 13:03:13.461881  1614 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:03:13.464012  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.465822  1541 raft_consensus.cc:2410] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:03:13.460948  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:13.466687  1540 raft_consensus.cc:1240] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:13.468137  1532 raft_consensus.cc:2393] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:03:13.470012  6649 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:03:13.463274  6421 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:13.487026  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.489704  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:13.503683  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.510692  1532 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
W20260709 13:03:13.512171  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.520777  6660 log.cc:927] Time spent T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:03:13.521130  1537 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:13.494704  6421 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.522995  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.523702  1537 raft_consensus.cc:3060] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:13.524466  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.525309  1536 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:13.526147  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03ff5e9bb5cd4c7590aecf8720904921" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.526805  1536 raft_consensus.cc:2393] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:13.527518  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:13.528774  6651 log.cc:927] Time spent T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:03:13.532356  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.489836  6623 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:13.536907  1537 raft_consensus.cc:2468] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:03:13.539990  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.546437  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:13.542642  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.547817  1533 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:13.558830  1538 raft_consensus.cc:2468] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:03:13.564677  1608 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:13.566843  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.513856  6125 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:13.568261  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.568830  1537 raft_consensus.cc:3060] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:13.569418  6445 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:13.569900  6421 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:13.571247  6554 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:13.571859  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.573871  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.575239  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.575944  1535 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
W20260709 13:03:13.576149  6657 log.cc:927] Time spent T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:03:13.576967  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.577286  1537 raft_consensus.cc:2468] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:03:13.578231  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.578336  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.579089  1535 raft_consensus.cc:2376] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7. Re-sending same reply.
I20260709 13:03:13.579325  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.580168  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.581002  1537 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:13.581851  1535 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:03:13.582409  1537 raft_consensus.cc:1275] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:13.605703  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.609119  1580 leader_election.cc:400] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 5 election: Vote denied by peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051) with higher term. Message: Invalid argument: T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 5. Current term is 6.
I20260709 13:03:13.625922  6635 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:13.632076  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.632824  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 66692.9us
I20260709 13:03:13.641309  1580 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:13.643117  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:13.676378  1608 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:13.672312  6668 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:13.699404  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:13.699694  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 56738.7us
I20260709 13:03:13.680115  6635 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:13.702723  1505 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.709043  1580 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:13.716105  6560 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:13.721655  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.724450  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:13.725304  1532 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:13.726704  1536 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:13.736536  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:13.737532  6421 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:13.738118  6421 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:13.738516  6421 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:13.737653  1654 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:13.699491  6620 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:13.750864  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:13.754037  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 51833.5us
I20260709 13:03:13.754885  1580 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:13.754101  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:13.757771  1684 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:13.755929  1609 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:13.763674  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:13.766566  6620 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:13.767000  1683 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:13.770033  1681 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:13.777431  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:13.780861  6655 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:13.781075  6590 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:13.782351  6655 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:13.782972  6655 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.784387  1654 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:13.784507  6512 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:13.785705  6674 raft_consensus.cc:2764] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:03:13.786409  2367 raft_consensus.cc:2368] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:03:13.787109  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:13.788403  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:13.788843  6462 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.789326  6462 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:13.789714  6462 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.790566  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:13.776381  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:13.793581  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:13.740559   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:13.799232  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:13.796923  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:13.799980  1540 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.756867  6653 raft_consensus.cc:2804] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:03:13.805545  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.798624  1438 catalog_manager.cc:5697] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:13.810827  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:13.793056  6512 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:13.815680  1580 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:13.815848  1607 raft_consensus.cc:3060] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:13.799773  6590 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:13.833032  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:13.825595  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:13.826531  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.812419  6619 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.802980  6456 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:13.836709  6619 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:13.848531  6619 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.848644  6558 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:13.823871  6512 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:13.852386  6512 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:13.853629  1438 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:13.863241  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:13.837339  6585 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:13.863684  1438 catalog_manager.cc:5697] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.866235  1438 catalog_manager.cc:5697] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 4 to 9, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New cstate: current_term: 12 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:13.869483  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 80537.6us
I20260709 13:03:13.870311  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:13.874461  1580 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:13.824350  6653 raft_consensus.cc:697] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:13.875006  1607 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
W20260709 13:03:13.876420  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 170721us
I20260709 13:03:13.876859  1580 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:13.877751  1504 leader_election.cc:400] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:03:13.881855  1504 leader_election.cc:403] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:13.886678  1683 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:13.878185  6558 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:13.893769  6558 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:13.894193  6558 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:13.916323  6619 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.919473  2329 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:13.921077  6665 raft_consensus.cc:2804] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:13.921703  6665 raft_consensus.cc:697] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:13.922377  6686 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:13.922757  6665 consensus_queue.cc:237] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:13.938290  6653 consensus_queue.cc:237] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.945214  6655 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:13.946587  6619 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:13.949132  2367 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:13.950752  6395 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:13.954044  6512 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.970122  6512 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:13.978595  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.982820  6421 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:13.992522  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:14.000202  1504 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.012823  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.012579  6462 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.014721  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.015673  6685 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:14.000691  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 123886us
W20260709 13:03:14.016714  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 102355us
I20260709 13:03:14.008419  6668 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:14.008553  1438 catalog_manager.cc:5697] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.017845  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.010430  1540 raft_consensus.cc:2468] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 11.
I20260709 13:03:14.005812  6585 consensus_queue.cc:1059] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:14.019315  1580 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:14.025139  1438 catalog_manager.cc:5697] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:14.029527  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.025303  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 208323us
I20260709 13:03:14.038564  6428 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:14.029539  6655 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.053328  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:14.054412  1607 raft_consensus.cc:2368] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:03:14.056013  1607 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:14.032873  6686 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:14.048007  6456 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:14.033004  6585 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:03:14.041805  6669 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:14.078197  1505 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:14.078557  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.078919  6682 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:03:14.085279  1438 catalog_manager.cc:5697] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.087206  1438 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.062326  6686 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:14.092736  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 752aab0c230943e5a7d35d3d2ff9e555 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:51746
I20260709 13:03:14.093609  6686 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.094798  6686 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.094061  1438 catalog_manager.cc:5697] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 10 to 13, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.091310  6685 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:14.092365  1435 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 187) took 42457 ms (client timeout 15000 ms). Trace:
I20260709 13:03:14.074079  6380 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:14.103212  6558 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.105604  6558 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:14.107530  6421 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:14.069311  6462 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:14.121356  1505 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.122812  6380 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:03:14.097774  1435 rpcz_store.cc:269] 0709 13:02:31.635007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:31.635217 (+   210us) service_pool.cc:224] Handling call
0709 13:02:31.685729 (+ 50512us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b5400002210. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e4640 00007fd0348bbb76 00007fd0349c5c3e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc 00007fd032e85392 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:14.092246 (+42406517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:13.088681 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:13.089358 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:13.089401 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:03:13.089420 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:13.090160 (+   740us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:13.090245 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:13.090273 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:13.090675 (+   402us) tablet.cc:701] Row locks acquired
0709 13:03:13.090696 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:03:13.090904 (+   208us) write_op.cc:270] Start()
0709 13:03:13.091049 (+   145us) write_op.cc:276] Timestamp: P: 1783602193090846 usec, L: 0
0709 13:03:13.091076 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:03:13.091952 (+   876us) log.cc:844] Serialized 1706 byte log entry
0709 13:03:13.431919 (+339967us) op_driver.cc:464] REPLICATION: finished
0709 13:03:13.557022 (+125103us) write_op.cc:301] APPLY: starting
0709 13:03:13.557106 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:13.637512 (+ 80406us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:13.637636 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:13.640631 (+  2995us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:13.640852 (+   221us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 13:03:13.640900 (+    48us) write_op.cc:312] APPLY: finished
0709 13:03:13.641149 (+   249us) log.cc:844] Serialized 49 byte log entry
0709 13:03:13.641362 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:13.641465 (+   103us) write_op.cc:454] Released schema lock
0709 13:03:13.645005 (+  3540us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:13.648143 (+  3138us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:13.648212 (+    69us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":694612,"reported_tablets":54,"spinlock_wait_cycles":5575424,"child_traces":[["op",{"apply.queue_time_us":120982,"apply.run_cpu_time_us":8585,"apply.run_wall_time_us":91055,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20831,"num_ops":4,"prepare.queue_time_us":99201,"prepare.run_cpu_time_us":3729,"prepare.run_wall_time_us":30279,"replication_time_us":286869,"thread_start_us":124762,"threads_started":2}]]}
I20260709 13:03:14.140853  1505 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.142616  6380 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:14.153800  1505 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.174207  6682 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:14.176826  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.180718  6682 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.182865  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:14.184788  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 118052us
I20260709 13:03:14.190122  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 752aab0c230943e5a7d35d3d2ff9e555 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:14.194500  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.196511  6682 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:14.198460  6462 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:14.200173  6462 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:14.201283  6462 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:14.204387  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 139679us
I20260709 13:03:14.207324  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.207691  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.208864  6622 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:14.211664  6691 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:14.213233  1690 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:14.213330  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:14.214896  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:14.223731  1685 raft_consensus.cc:1240] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:14.217500  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.225126  6685 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:14.225708  6685 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.226166  6685 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.232813  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.236825  6395 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.238103  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.238965  6395 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:14.239331  6395 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.239764  6395 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.240109  6685 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.239389  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.242940  6684 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:14.248457  6622 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:14.253717  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:14.257948  1685 raft_consensus.cc:1240] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:14.258502  1607 raft_consensus.cc:1275] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:14.260908  1607 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:14.261730  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:14.262563  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:14.263851  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:14.264545  1538 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.222239  6682 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:14.270256  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:14.275964  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:14.279574  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:14.279865  1608 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:14.280681  1505 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.282002  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:14.281891  6685 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:14.286578  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:14.291109  6558 consensus_queue.cc:1059] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:14.294181  6453 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:14.295311  6453 raft_consensus.cc:3055] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:14.295639  6453 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:14.252650  6653 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:14.273896  6682 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.314762  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:14.317947  1608 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:14.256626  6662 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:03:14.304466  6653 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:14.325753  1538 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:14.305931  6685 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:14.252442  6622 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.320104  6682 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.306509  6125 consensus_queue.cc:1059] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:03:14.329209  6653 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:14.313248  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:14.310257  6395 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.359547  1685 raft_consensus.cc:1240] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:14.348374  1682 raft_consensus.cc:606] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:14.296618  6453 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.366562  6686 raft_consensus.cc:3055] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:14.367031  6686 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:14.367893  6686 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.334409  6619 consensus_queue.cc:1048] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:03:14.373282  6428 raft_consensus.cc:3055] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:14.373586  6686 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.373890  6428 raft_consensus.cc:740] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:14.375087  6428 consensus_queue.cc:260] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.356770  6685 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:14.378743  6685 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:14.375909  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.377503  1532 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:14.385557  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:14.386561  6395 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:14.391819  1682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:14.392710  1682 raft_consensus.cc:606] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:14.393167  1682 raft_consensus.cc:614] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:14.395485  6453 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.381976  6428 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:14.391285  1690 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:14.445749  1537 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:14.467664  1608 raft_consensus.cc:1275] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:03:14.471794  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:14.492404  1580 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:35051 timed out after 1.588s (SENT) [suppressed 21 similar messages]
I20260709 13:03:14.522454  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.524209  6590 raft_consensus.cc:993] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:14.524856  6695 raft_consensus.cc:1081] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
W20260709 13:03:14.526073  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 275013us
I20260709 13:03:14.526816  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.508394  6558 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.529227  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.535226  1505 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.541946  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.520771  6125 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.544744  1685 raft_consensus.cc:1240] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:14.551012  1686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:14.551690  1686 raft_consensus.cc:606] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:14.552122  1686 raft_consensus.cc:614] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:14.531283  6619 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.533376  6684 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:14.536522  6558 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.562008  1505 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.542960  6659 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:14.575893  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.548504  6685 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:14.580298  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.583629  6558 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:14.558297  6462 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.571460  6380 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:14.549710  6620 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:03:14.594026  6682 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.577239  6655 consensus_queue.cc:1059] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:14.557485  6125 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.607254  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:14.583753  6706 log.cc:927] Time spent T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:03:14.561278  6684 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.633641  6684 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:14.614801  6395 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:03:14.632930  6713 log.cc:927] Time spent T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:03:14.680178  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 116341us
I20260709 13:03:14.681383  1505 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.683388  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.686712  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.687897  6395 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:14.687984  6380 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:03:14.688894  6380 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.689330  6380 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:14.696468  6655 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.697244  6655 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.697779  6682 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:14.698486  6682 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:14.698931  6682 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.699328  6682 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.699442  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:14.667367  6558 raft_consensus.cc:3055] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:14.700402  6558 raft_consensus.cc:740] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:14.701548  6558 consensus_queue.cc:260] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:14.722682  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 211703us
I20260709 13:03:14.727737  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:14.740942  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 234153us
W20260709 13:03:14.752171  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 259827us
W20260709 13:03:14.754223  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.748445  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.738199  6395 raft_consensus.cc:2764] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
W20260709 13:03:14.763680  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 220549us
I20260709 13:03:14.755164  6653 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.742659  6558 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.778308  6653 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:14.779734  1505 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.788280  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.764748  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:14.803256  6684 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:14.807569  6655 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:14.808462  6395 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:14.809489  6456 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.811435  6125 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:14.813897  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:14.791558  6707 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:14.759409  6715 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:14.821772  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:14.825420  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 79483.4us
W20260709 13:03:14.821120  6717 log.cc:927] Time spent T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:03:14.786211  6685 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:03:14.854808  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.835525  6395 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:14.866997  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 102372us
W20260709 13:03:14.885231  1653 consensus_peers.cc:597] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8464531709643ab8a8fd947089037ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.903473  1612 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:14.882716  6395 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:14.840643  6456 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:14.876219  6695 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:14.923324  2367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:03:14.929026  2367 raft_consensus.cc:606] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:14.848719  6715 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:14.937306  1537 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
W20260709 13:03:14.938217  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 150057us
I20260709 13:03:14.908499  6686 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.939455  1505 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:14.943027  1537 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 14. Current term is 15. Ops: []
W20260709 13:03:14.944039  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 114054us
I20260709 13:03:14.923748  6619 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.923521  6462 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:14.948092  1537 raft_consensus.cc:3060] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:14.949887  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:14.952603  1607 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:03:14.959362  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 53158.2us
I20260709 13:03:14.966094  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:14.904870  6727 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:03:14.981215  1535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
W20260709 13:03:15.006428  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 46244us
I20260709 13:03:14.946362  6695 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:14.983057  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.008953  1535 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.014340  1535 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:15.015058  1612 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:15.012645  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 69406.9us
W20260709 13:03:15.015784  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 59956.7us
I20260709 13:03:14.933017  6731 consensus_queue.cc:1048] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:03:14.949352  6686 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.045349  1534 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:14.968211  6619 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.057312  1537 raft_consensus.cc:1275] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:15.062938  1537 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:15.066563  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.075788  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:15.055835  6725 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:03:14.959713  6462 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.082012  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:15.085507  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 49375.4us
I20260709 13:03:15.045611  6707 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:15.094537  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51786.9us
W20260709 13:03:15.095551  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 156224us
I20260709 13:03:15.096408  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.097836  1505 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.104056  6456 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:15.105268  1505 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.106456  1505 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.113986  1612 raft_consensus.cc:2468] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:15.049749  6685 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:15.117331  1537 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:15.126335  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:15.136085  6732 log.cc:927] Time spent T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:03:15.136962  6739 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:15.137504  6739 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:15.137871  6739 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.115144  6695 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.140863  6715 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:15.141472  6715 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.142055  6715 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.091037  6684 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:15.143893  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 103253us
I20260709 13:03:15.161525  6686 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.167362  6462 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:15.172025  6380 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.174782  1541 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:15.198390  6739 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:15.208505  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 49673.4us
W20260709 13:03:15.209432  6682 consensus_meta.cc:287] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.004s
I20260709 13:03:15.112739  6590 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:03:15.220345  1535 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.236694  1686 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:15.236750  1534 raft_consensus.cc:1240] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:15.238365  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:03:15.238739  1580 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.240473  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:15.125140  6707 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.094s
I20260709 13:03:15.246202  1535 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:15.245294  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 119712us
I20260709 13:03:15.254791  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:15.260300  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:15.261066  1690 raft_consensus.cc:3055] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:15.261396  1690 raft_consensus.cc:740] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:15.229789  6380 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.264200  1690 consensus_queue.cc:260] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.266211  1690 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:15.248129  6733 raft_consensus.cc:2764] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:03:15.275014  6619 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:15.276456  6558 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:15.277168  6558 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.279425  6558 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.266712  6684 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:03:15.236306  6682 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.286862  6682 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.287669  1539 raft_consensus.cc:1240] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:15.288419  6395 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.295688  1690 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:15.301177  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:15.303412  1504 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:15.308399  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:15.305233  6380 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:15.311492  6380 raft_consensus.cc:697] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:15.312601  6380 consensus_queue.cc:237] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.315510  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.316787  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:15.328459  1685 raft_consensus.cc:606] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:15.274147  6685 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:15.320382  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 213995us
I20260709 13:03:15.324707  6669 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.342171  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:15.342269  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.343643  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 99) took 2359 ms. Trace:
I20260709 13:03:15.345438  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.344136  1438 rpcz_store.cc:276] 0709 13:03:12.981572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.984449 (+  2877us) service_pool.cc:224] Handling call
0709 13:03:15.340900 (+2356451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:14.193336 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:14.194217 (+   881us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:14.194262 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:03:14.194685 (+   423us) tablet.cc:662] Decoding operations
0709 13:03:14.195935 (+  1250us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:14.197198 (+  1263us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:14.197230 (+    32us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:03:14.197915 (+   685us) tablet.cc:701] Row locks acquired
0709 13:03:14.197930 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:03:14.198067 (+   137us) write_op.cc:270] Start()
0709 13:03:14.198195 (+   128us) write_op.cc:276] Timestamp: P: 1783602194198020 usec, L: 0
0709 13:03:14.198211 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:03:14.203880 (+  5669us) log.cc:844] Serialized 3601 byte log entry
0709 13:03:14.325494 (+121614us) op_driver.cc:464] REPLICATION: finished
0709 13:03:14.595417 (+269923us) write_op.cc:301] APPLY: starting
0709 13:03:14.595527 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:14.817204 (+221677us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:14.817361 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:15.166584 (+349223us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:15.166825 (+   241us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 13:03:15.166870 (+    45us) write_op.cc:312] APPLY: finished
0709 13:03:15.167159 (+   289us) log.cc:844] Serialized 89 byte log entry
0709 13:03:15.191823 (+ 24664us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:15.191969 (+   146us) write_op.cc:454] Released schema lock
0709 13:03:15.192022 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:15.192441 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:15.192480 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":319402,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":265347,"apply.run_cpu_time_us":19834,"apply.run_wall_time_us":597027,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41711,"num_ops":9,"prepare.queue_time_us":52461,"prepare.run_cpu_time_us":4396,"prepare.run_wall_time_us":17042,"replication_time_us":107286,"thread_start_us":237670,"threads_started":2}]]}
I20260709 13:03:15.352386  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:15.353710   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:15.343315  6669 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.355020  6739 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.355527   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:15.349684  6682 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:15.356474  6682 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:15.356767  6669 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.356873  6682 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:15.340551  6558 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.363798  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:15.364293  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:03:15.362654  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 266277us
I20260709 13:03:15.363612  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.369323  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.358680  6707 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.362571  6395 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.373425  6741 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:15.387589  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:15.385597  1654 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:15.407244  1613 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:15.373776  6380 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.385391  6707 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:15.418905  6707 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:15.419348  6707 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:15.422058  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e3bb6ac3eb408ba9c57b48de886d65 with delete_type TABLET_DATA_TOMBSTONED (TS f6eecf73c1c24b5eb268b5088a3030d4 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:51746
I20260709 13:03:15.429179  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.430766  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.433486  1532 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:15.433770  1539 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:15.434631  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:15.435425  1613 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
W20260709 13:03:15.436170  1579 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.440315  6428 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.441031  6428 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:15.443542  6428 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:15.450522  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:15.451493  1616 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
W20260709 13:03:15.452334  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 48649.4us
I20260709 13:03:15.454000  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:15.454816  6395 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:15.455224  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.406591  6653 raft_consensus.cc:2804] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:15.371507  6697 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 13:03:15.463596  1582 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:15.464289  1609 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:15.461277  1541 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:15.469641  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:15.402894  6741 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:15.475672  1505 leader_election.cc:400] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 10. Current term is 11.
I20260709 13:03:15.479123  6380 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:15.481943  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:15.481982  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.485301  6735 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.486085  6735 consensus_queue.cc:1048] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:15.488258  6755 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:15.488761  6755 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:15.489151  6755 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:15.488070  6395 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:03:15.460127  6684 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.494081  6684 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.495280  6712 consensus_queue.cc:1059] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:15.487637  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.494643  6695 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:15.502259  1538 raft_consensus.cc:1275] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:15.494055  6707 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.497978  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.499497  1534 raft_consensus.cc:1275] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:15.503227  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.503402  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:15.506198  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.506673  1538 raft_consensus.cc:2376] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13. Re-sending same reply.
I20260709 13:03:15.503728  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:15.508522  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.508850  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.509735  1607 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:15.510059  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.510270  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.511010  1538 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 15: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:15.511824  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.514533  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.514807  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:15.515709  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.506806  1541 raft_consensus.cc:2376] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15. Re-sending same reply.
I20260709 13:03:15.517465  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.519520  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.520897  1535 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 13: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:15.522658  1534 raft_consensus.cc:2393] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:15.523803  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:15.524920  1538 raft_consensus.cc:2376] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7. Re-sending same reply.
I20260709 13:03:15.525801  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.525171  1438 catalog_manager.cc:5697] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.526255  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.523803  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbf20d67081f4a66af2b6a3bb0145baf" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.529913  1610 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:15.527827  1438 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 11 to 12, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:15.530685  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:15.531852  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 67023.4us
I20260709 13:03:15.526750  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.494192  6653 raft_consensus.cc:697] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:15.538681  1539 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:15.545164  1540 raft_consensus.cc:2393] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:15.547621  6453 consensus_queue.cc:1048] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:15.549124  6727 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:15.550783  6453 consensus_queue.cc:1059] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:15.551026  6709 consensus_queue.cc:1059] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:15.553402  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.551793  6727 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:15.557821  6659 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:15.558635  6709 raft_consensus.cc:3055] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:15.559433  6743 raft_consensus.cc:3055] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:15.559314  6453 raft_consensus.cc:993] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:15.574036  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.576114  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.585660  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.546917  6622 consensus_queue.cc:1059] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:03:15.588548  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:15.538668  6684 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.513679  6674 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:03:15.592379  1539 raft_consensus.cc:2393] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 13: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:15.591144  1607 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 10.
I20260709 13:03:15.600468  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:15.604532  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 54181.6us
I20260709 13:03:15.512992  6695 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.577219  6709 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:15.611357  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.614319  1540 raft_consensus.cc:2393] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 14: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:15.582038  6743 raft_consensus.cc:740] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:15.618245  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.622128  1540 raft_consensus.cc:2376] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7. Re-sending same reply.
I20260709 13:03:15.628365  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.618305  6735 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:15.630342  6759 raft_consensus.cc:1081] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:15.635643  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.639626  6707 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.620653  6653 consensus_queue.cc:237] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.641736  6682 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.645815  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:15.649279  6758 log.cc:927] Time spent T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:03:15.715552  1580 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.756346  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.758637  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.759873  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:15.632826  6662 consensus_queue.cc:1059] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:03:15.656059  6763 tablet_replica.cc:333] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:03:15.638588  6735 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.656966  6743 consensus_queue.cc:260] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:15.753149  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 123694us
I20260709 13:03:15.643975  6682 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:15.756865  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 90838.8us
I20260709 13:03:15.765174  1505 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.763273  1609 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:15.773138  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:15.606449  6741 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.790692  1608 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:15.792119  1532 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:15.767469  6428 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:15.808938  1540 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 10: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:15.760589  6684 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:15.767612  6686 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:15.814771  1539 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:15.752866  6558 consensus_queue.cc:1048] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:03:15.820817  1539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:03:15.821736  1539 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.822579  1539 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:15.768752  6771 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:15.789167  6652 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:15.878250  6695 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:15.880842  6652 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:15.879936  6558 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:15.878903  6709 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:15.832648  6769 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:03:15.891737  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:15.811823  6453 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:03:15.881697  6380 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:15.891760  6751 log.cc:927] Time spent T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.003s
I20260709 13:03:15.854215  6735 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.886554  6743 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:15.953825  6755 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.955353  1532 raft_consensus.cc:1240] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:03:15.820026  6684 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:15.907727  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 147936us
W20260709 13:03:15.909741  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 144708us
I20260709 13:03:15.907626  1539 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:15.946702  6428 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:15.966259  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 164644us
I20260709 13:03:15.966480  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.969007  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:15.971310  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.974459  1539 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:15.831229  6771 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:15.974002  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:15.967041  6735 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:15.973982  6685 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.024115  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:15.979470  6590 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:16.027901  6652 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:16.029187  6742 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:16.029438  6462 raft_consensus.cc:3055] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:16.033046  6750 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:16.042930  1505 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.046989  1505 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.045122  6739 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:16.047940  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:16.049297  6771 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:16.044996  6750 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:16.044831  6779 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.046154  6742 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.035733  6623 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:16.058957  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:16.057354  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:16.036434  6590 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:16.072508  6590 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.054059  6755 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 17 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:16.054497  1505 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.059516  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:16.059361  6623 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:16.025625  6735 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:16.071012  6722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.023s	sys 0.052s
I20260709 13:03:16.063592  6771 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:16.053472  6685 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.065088  6674 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:16.065583  1688 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:03:16.068224  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:16.058135  6779 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:03:16.106878  6623 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.107609  1538 raft_consensus.cc:1240] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:03:16.108062  1535 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:16.108525  6623 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:16.109098  6774 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:16.110121  1535 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:16.071796  6684 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:16.051755  6750 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:16.042623  6462 raft_consensus.cc:740] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:16.087585  6755 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.053241  6742 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:16.104215  6722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.023s	sys 0.053s
I20260709 13:03:16.071110  1539 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.120159  1690 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:16.122352  1505 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.125254  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:16.130821  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.133410  1535 raft_consensus.cc:1240] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:16.134605  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:16.137006  1539 raft_consensus.cc:1240] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:16.140064  1686 raft_consensus.cc:2393] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:16.141655  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:16.111692  6462 consensus_queue.cc:260] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.144764  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:16.145463  1688 raft_consensus.cc:3055] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:16.145790  1688 raft_consensus.cc:740] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:16.147063  1688 consensus_queue.cc:260] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.133414  6750 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.153661  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:16.154096  6428 consensus_queue.cc:1048] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:16.154964  6428 consensus_queue.cc:1243] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer c98c328741aa493d87abafbf08f04944 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:16.155589  6735 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:16.139793  6755 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:16.160578  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:16.165364  6755 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:16.167456  1504 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:16.168872  6755 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:16.169837  6755 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:16.170652  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:16.171200  6755 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.167641  6659 raft_consensus.cc:3055] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:16.172748  6659 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:16.173815  6659 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.145932  1690 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.187695  6780 consensus_queue.cc:1059] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:03:16.191031  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 225330us
I20260709 13:03:16.192836  6780 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:16.196406  1580 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.197592  1580 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.201638  1580 leader_election.cc:304] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.145782  6590 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.184388  6750 consensus_queue.cc:1059] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:03:16.208168  1580 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.210623  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.212478  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.214720  1683 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:16.215622  1580 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.226620  6558 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.199996  6789 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.214757  6776 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:16.237071  6750 consensus_queue.cc:1243] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer f6eecf73c1c24b5eb268b5088a3030d4 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:03:16.214536  6735 raft_consensus.cc:2749] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.214646  6686 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.264369  6784 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.270211  6778 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:16.281215  6590 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:16.290548  1536 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37906 (request call id 2693) took 1305 ms (client timeout 1702 ms). Trace:
I20260709 13:03:16.287024  6691 raft_consensus.cc:3055] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:03:16.291110  1536 rpcz_store.cc:269] 0709 13:03:14.964438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.965781 (+  1343us) service_pool.cc:224] Handling call
0709 13:03:16.267286 (+1301505us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b540005e454. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02eb0c2fa 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6 00007fd02ce4226f
0709 13:03:16.269463 (+  2177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1479270656}
W20260709 13:03:16.292304  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 87374.4us
I20260709 13:03:16.266940  6746 raft_consensus.cc:3055] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:16.306097  1654 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:16.297849  1682 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:16.293025  6691 raft_consensus.cc:740] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:16.316835  6697 consensus_queue.cc:1059] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
W20260709 13:03:16.322722  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 107232us
I20260709 13:03:16.315203  6746 raft_consensus.cc:740] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:16.316478  6623 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.329737  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.335836  6776 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.336328  6686 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:16.337760  1580 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.339560  1580 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.340703  6776 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.341382  6776 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.345618  6512 consensus_queue.cc:1059] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:16.350927  6421 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:03:16.351446  6421 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:16.330797  6771 consensus_queue.cc:1059] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:03:16.356769  6691 consensus_queue.cc:260] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.358394  6691 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:16.360576  6776 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.356914  1580 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.361776  6742 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.362664  1580 leader_election.cc:304] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.363353  6776 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.366642  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:16.376003   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:16.388293  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63132.5us
I20260709 13:03:16.403452  6746 consensus_queue.cc:260] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.383415  6755 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:03:16.405400  6755 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:16.405778  6755 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:16.406821  6755 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:16.410106  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47550.4us
I20260709 13:03:16.411267  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.412354  1580 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.414383  1537 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:16.419948  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:16.426903  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:16.425127  6428 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.432379  6662 consensus_queue.cc:1059] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:16.433758  6697 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:16.413076  6421 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.452963  6421 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:16.426134  6776 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.458639  6428 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.459255  6795 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:16.458428  6753 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:16.460470  6684 raft_consensus.cc:3055] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:16.460937  6684 raft_consensus.cc:740] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:16.461797  6684 consensus_queue.cc:260] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.463045  6684 raft_consensus.cc:3060] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:16.467154  6709 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.407995  6755 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.471071  1579 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:16.473167  1688 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.477145  6741 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:16.481549  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63578.7us
I20260709 13:03:16.482438  1580 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.426762  6746 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:16.496546  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:16.500815  1580 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.507025  1580 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.446126  6558 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.519253  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:16.519021  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:16.524161  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:16.519841  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:16.526659  1613 raft_consensus.cc:2393] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:16.527243  1609 raft_consensus.cc:1240] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:16.527693  1607 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:03:16.515875  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 80942.4us
I20260709 13:03:16.495121  6778 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:16.549768  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:16.550741  1615 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
W20260709 13:03:16.555044  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.535048  1537 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:16.537358  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:16.538084  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:16.504380  6428 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.558892  1614 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:16.560451  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:16.539975  1532 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
W20260709 13:03:16.538604  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.569792  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.515429  6795 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:16.506963  6669 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:16.563411  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:16.574956  1610 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:03:16.524235  6776 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:16.589597  1539 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:16.537281  6590 raft_consensus.cc:3055] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:03:16.599876  1611 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.601447  1533 pending_rounds.cc:85] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 6
I20260709 13:03:16.601995  1533 pending_rounds.cc:107] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:03:16.602348  1533 raft_consensus.cc:2889] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:16.591867  1505 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.531909  6750 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:03:16.605649  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46741us
I20260709 13:03:16.607999  1688 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:16.608357  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:16.609804  1504 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:16.611054  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:16.611507  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.612119  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.567519  6380 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:16.574165  6669 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:16.605978  6590 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:16.617316  6753 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50318 (request call id 7) took 2306 ms. Trace:
I20260709 13:03:16.637874  6669 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.643265  6776 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.646486  6778 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.647891  6428 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.615306  6750 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:16.661214  6800 ts_tablet_manager.cc:933] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:16.634554  6380 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:16.687340  6759 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.697954  6759 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.720932  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:16.712482  6590 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.727246  6590 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:16.729826  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 100) took 1239 ms. Trace:
I20260709 13:03:16.730324  1438 rpcz_store.cc:276] 0709 13:03:15.490437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.491656 (+  1219us) service_pool.cc:224] Handling call
0709 13:03:16.729723 (+1238067us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:15.634049 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:15.675518 (+ 41469us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:15.750310 (+ 74792us) write_op.cc:435] Acquired schema lock
0709 13:03:15.754092 (+  3782us) tablet.cc:662] Decoding operations
0709 13:03:15.827147 (+ 73055us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:15.868581 (+ 41434us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:15.881804 (+ 13223us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:15.924520 (+ 42716us) tablet.cc:701] Row locks acquired
0709 13:03:15.924561 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:03:15.973772 (+ 49211us) write_op.cc:270] Start()
0709 13:03:15.981208 (+  7436us) write_op.cc:276] Timestamp: P: 1783602195972670 usec, L: 0
0709 13:03:15.981249 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:03:16.049971 (+ 68722us) log.cc:844] Serialized 919 byte log entry
0709 13:03:16.187663 (+137692us) op_driver.cc:464] REPLICATION: finished
0709 13:03:16.328847 (+141184us) write_op.cc:301] APPLY: starting
0709 13:03:16.343384 (+ 14537us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:16.345974 (+  2590us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:16.346079 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:16.347693 (+  1614us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:16.347938 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:03:16.348003 (+    65us) write_op.cc:312] APPLY: finished
0709 13:03:16.397641 (+ 49638us) log.cc:844] Serialized 33 byte log entry
0709 13:03:16.425188 (+ 27547us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:16.430034 (+  4846us) write_op.cc:454] Released schema lock
0709 13:03:16.431238 (+  1204us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:16.435399 (+  4161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:16.435437 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":133235,"apply.run_cpu_time_us":6870,"apply.run_wall_time_us":109828,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12479,"num_ops":2,"prepare.queue_time_us":80905,"prepare.run_cpu_time_us":5487,"prepare.run_wall_time_us":416320,"replication_time_us":204787,"spinlock_wait_cycles":2304,"thread_start_us":125528,"threads_started":2}]]}
I20260709 13:03:16.735788  1611 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:16.689744  6428 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.722162  6453 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.686507  6776 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:16.751329  1656 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:16.760946  6802 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:03:16.762506  1538 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:16.764467  6622 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.687667  6778 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.765055  6622 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.767189  6778 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:16.768127  6453 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:16.768779  1654 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:16.769364  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:16.769896  6428 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:16.770133  1682 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:03:16.770386  6453 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:16.773265  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:16.767280  6622 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:16.775086  1607 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:03:16.771171  6800 tablet_copy_client.cc:323] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:03:16.772348  1579 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:16.762558  6807 log.cc:927] Time spent T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:03:16.834821  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 46903.3us
I20260709 13:03:16.741629  6780 consensus_queue.cc:1059] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:03:16.664211  6753 rpcz_store.cc:276] 0709 13:03:14.304893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:14.305061 (+   168us) service_pool.cc:224] Handling call
0709 13:03:14.389229 (+ 84168us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b540035eba0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea85520 00007fd02eb0eb42 00007fd02eb0d800 00007fd033aced29 00007fd02d04d1d4 00007fd02d04d162 00007fd02d04d091 00007fd02d04d00c 00007fd02d04c2c2 00007fd02ce4348c
0709 13:03:14.518673 (+129444us) log.cc:844] Serialized 506 byte log entry
0709 13:03:14.803867 (+285194us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18002ebe80. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd02b995c0a 00007fd0350d5219 00007fd02ba1da40 00007fd02ba184e4 00007fd02ba18455 00007fd02ea61b0b 00007fd02eae6b63 00007fd02eb0e752 00007fd033aced29
0709 13:03:16.606232 (+1802365us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1470,"raft.queue_time_us":71085,"raft.run_cpu_time_us":2924,"raft.run_wall_time_us":128017,"spinlock_wait_cycles":115960320,"thread_start_us":213687,"threads_started":1,"wal-append.queue_time_us":329855,"wal-append.run_cpu_time_us":3523,"wal-append.run_wall_time_us":1244512}
I20260709 13:03:16.853248  6753 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:16.859292  1654 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:16.842041  6428 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:16.864452  1540 raft_consensus.cc:1275] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:03:16.864966  1540 pending_rounds.cc:85] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Aborting all ops after (but not including) 7
I20260709 13:03:16.865238  1540 pending_rounds.cc:107] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:03:16.865496  1540 raft_consensus.cc:2889] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:16.865779  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 5853661a3b2948fbb9b9483e9e4176a3: Illegal state: Replica e8eefefed88a4903b423e9f487c4805a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:16.868932  1613 raft_consensus.cc:1240] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:16.869747  6462 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:16.871819  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet 012a311e17a142298db5d9aa2a92c2f5: Illegal state: Replica f6eecf73c1c24b5eb268b5088a3030d4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:16.853796  6753 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:16.878831  6753 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:16.880632  6453 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.894819  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:16.879585  6428 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:16.902297  1487 auto_rebalancer.cc:629] Failed to schedule move for tablet fbf20d67081f4a66af2b6a3bb0145baf: Illegal state: Replica e8eefefed88a4903b423e9f487c4805a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:16.897265  6742 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:16.923573  6750 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:16.901017  6428 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.935145  6776 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:16.906394  6620 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:16.940058  6620 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:16.940542  6620 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.943277  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:16.944260  1682 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:16.947325  1579 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:16.952386  6776 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:16.959985  6776 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:16.974406  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:16.977628  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 385933us
I20260709 13:03:16.978577  1505 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:16.981597  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:16.982316  1614 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:16.983537  1613 raft_consensus.cc:1240] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:16.967218  6795 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:16.984254  6739 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:03:16.980057  6776 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:16.999538  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.006053  1613 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:17.005204  1616 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:16.991062  6682 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:17.014768  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:17.022351  1614 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:16.993741  6684 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:17.022060  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:17.099259  1506 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.007109  6685 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:17.021360  6741 consensus_meta.cc:287] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.009s
W20260709 13:03:17.146878  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 124914us
I20260709 13:03:17.144227  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.021056  6739 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:03:17.147835  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:17.152796  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 126463us
I20260709 13:03:17.153735  1505 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:17.157763  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 548069us
I20260709 13:03:17.159680  1505 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.170634  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:17.025947  6691 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.160740  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.160149  6674 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.181445  6674 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.181888  6674 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.159888  6789 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.158277  6709 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.184564  6789 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.184880  6709 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.187777  6789 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.189949  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.191391  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.191581  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.196491  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.146211  6682 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:17.203862  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:17.219882  1614 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
W20260709 13:03:17.197446  6815 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:17.157541  6806 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:17.197880  6823 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:17.229562  1654 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.156462  6684 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.209561  6590 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.178162  6669 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.244185  6590 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.244593  6590 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.245467  6684 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.246979  6797 raft_consensus.cc:2804] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:17.247663  6797 raft_consensus.cc:697] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:17.200182  6691 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.248878  6797 consensus_queue.cc:237] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:17.249934  6822 log.cc:927] Time spent T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:03:17.251168  6682 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.255017  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.240597  6753 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:17.257207  6753 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:17.258154  6753 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.249850  6691 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.240823  6750 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:17.256315  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.260996  6750 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:17.261447  1613 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:17.263798  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.264827  6691 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:17.265405  6691 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.265823  6691 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.235188  6827 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:17.267179  6827 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:17.267603  6827 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:17.158434  6685 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.209074  6824 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:03:17.280931  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 89429.2us
I20260709 13:03:17.234751  6755 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:03:17.284168  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.261502  6750 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.288072  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.209841  6739 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:03:17.273000  6806 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.248737  6759 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.297875  6685 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.298050  6806 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.285358  6674 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.300709  6674 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.312180  6428 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.313618  1614 raft_consensus.cc:2393] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 14: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:17.314767  6428 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.283191  6590 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.317415  6590 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.318708  6755 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:17.319506  6755 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.324960  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet f8464531709643ab8a8fd947089037ef from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:03:17.325387  6826 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:17.325631  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet f8464531709643ab8a8fd947089037ef from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-f8464531709643ab8a8fd947089037ef
I20260709 13:03:17.326089  6826 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.329243  6620 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:17.331321  6620 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.335327  1700 tablet_copy_source_session.cc:215] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:17.298822  6806 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:17.358309  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.360703  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.367103  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.367276  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.368005  1533 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:17.368302  1532 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:17.376118  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:17.376966  1541 raft_consensus.cc:2393] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:17.388852  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:17.389468  1541 raft_consensus.cc:3060] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.390853  6827 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.393796  6827 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.394379  6827 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:17.394546  1537 raft_consensus.cc:1240] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:03:17.394879  6827 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:17.398976  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.411029  6763 raft_consensus.cc:2243] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.412135  6763 raft_consensus.cc:2272] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.400071  6826 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.446450  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.447870  6780 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:17.448952  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:17.449582  1689 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.453544  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:17.460146  6458 raft_consensus.cc:993] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: : Instructing follower e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:17.460563  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.461319  1533 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:17.460745  6458 raft_consensus.cc:1081] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Signalling peer e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:17.465067  6669 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.470394  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:17.471191  1611 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.473575  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:17.474259  1607 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.499552  6827 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:17.501042  1615 raft_consensus.cc:1240] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:17.506126  6763 ts_tablet_manager.cc:1916] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:17.507467  6659 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.439296  6691 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.534240  6691 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.513116  6755 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.518630  6800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8464531709643ab8a8fd947089037ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:17.520275  1580 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.523108  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:17.523928  6709 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.543929  6380 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:17.546916  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:17.512270  6776 consensus_meta.cc:287] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.004s
I20260709 13:03:17.560266  1689 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
W20260709 13:03:17.564272  1655 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:17.562330  6743 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.598717  6743 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.600945  6743 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.571775  1688 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:17.566205  6746 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.601632  6746 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.603680  6746 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.582482  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:17.581974  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 59347.8us
I20260709 13:03:17.604363  1540 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:17.591336  1541 raft_consensus.cc:2468] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:17.591673  1533 raft_consensus.cc:3060] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.596701  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.605764  1532 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:17.608403  1607 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:17.608212  1579 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.607106  1615 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:17.597564  1611 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:17.622287  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.623081  1541 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:17.631348  6741 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.632237  6741 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.634791  1654 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.636314  6719 raft_consensus.cc:2804] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:17.636761  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.637076  6719 raft_consensus.cc:697] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:17.638484  6691 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:17.639933  1654 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.639405  6691 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.646080  6691 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:17.604630  6776 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.649569  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.651291  1611 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:17.652060  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:17.650220  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 456529us
I20260709 13:03:17.652729  1607 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:17.656648  1533 raft_consensus.cc:2468] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:17.647710  6622 raft_consensus.cc:2804] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:17.638417  6719 consensus_queue.cc:237] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.663218  1612 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:17.670624  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.659026  6395 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.673748  1607 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:17.674008  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:17.674715  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:17.694906  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:17.695677  1536 raft_consensus.cc:3060] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.717103  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:17.717903  1537 raft_consensus.cc:3060] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.718551  1609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:57944
I20260709 13:03:17.718876  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.719218  1609 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.719655  1609 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.696247  6395 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.668965  6622 raft_consensus.cc:697] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:17.671476  6709 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.729964  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.732883  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.750432  1607 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:17.751544  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.753095  1436 catalog_manager.cc:5697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.758620  1532 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:17.760093  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:17.758842  1536 raft_consensus.cc:2468] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:17.731201  1540 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:17.761601  1537 raft_consensus.cc:2468] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:17.759285  1436 catalog_manager.cc:5697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.765777  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.766487  1533 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:17.767885  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:17.764263  1609 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:17.768725  1536 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 16.
I20260709 13:03:17.715757  6750 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:17.770236  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 250063us
I20260709 13:03:17.772852  1612 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:17.774379  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.778247  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:17.779130  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 171028us
I20260709 13:03:17.784504  1580 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.784602  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.784906  1536 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:17.788650  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:17.790807  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.793248  1579 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:17.777087  1436 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 6 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.794562  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:17.797667  1686 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:17.795849  1682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.796151  1681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.799719  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.796245  1436 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.755304  6709 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.805666  6709 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:17.792430  6746 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:17.805769  1436 catalog_manager.cc:5697] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.808856  6718 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.809617  6691 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.809895  6805 raft_consensus.cc:2804] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:17.810669  6805 raft_consensus.cc:697] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:17.811101  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:17.809038  1436 catalog_manager.cc:5697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.811527  6805 consensus_queue.cc:237] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.779990  6835 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:17.817570  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.786825  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:17.817649  1685 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:17.821751  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.822636  1686 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:03:17.824355  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:17.763614  6776 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.827740  1541 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:03:17.819962  1609 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:17.788515  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.812966  1436 catalog_manager.cc:5697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.825603  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:17.829376  1616 raft_consensus.cc:2368] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:03:17.832199  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:17.832683  1533 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.826893  1689 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:17.762440  6753 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:17.824517  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8196c0532243f8ba687a00d2857d80" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.772459  6789 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:17.841660  2363 raft_consensus.cc:1240] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:17.844094  1579 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:17.852105  1505 leader_election.cc:400] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:03:17.852974  1505 leader_election.cc:403] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:17.849885  1436 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 4 to 11, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.857261  1612 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:17.854075  1533 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:03:17.858645  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:17.862192  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 73720.9us
I20260709 13:03:17.860226  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7137e5b424304fc6a6513886dd9dc135" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:17.863991  1615 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:17.865248  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:17.822834  6784 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:17.762921  6622 consensus_queue.cc:237] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.872538  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:17.825944  6806 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:17.842445  6753 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.882292  1612 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:17.865814  6833 log.cc:927] Time spent T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:03:17.883880   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:17.848425  6746 raft_consensus.cc:697] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:17.880450  1436 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.824664  6838 consensus_queue.cc:1059] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:03:17.864753  6780 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:17.873355  6779 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13.
I20260709 13:03:17.865345  6727 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:17.893683  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:17.896662  1436 catalog_manager.cc:5697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.891830  6753 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:17.900563  6674 consensus_queue.cc:1048] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:17.869444  6755 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:17.875015  6776 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:17.925580  1436 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:17.928515  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:17.890378  1504 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:17.893021  6784 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:17.914834  6727 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:17.918771  6827 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:17.925011  6590 raft_consensus.cc:2764] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:17.947649  1580 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:17.955554  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 65226.2us
W20260709 13:03:17.953030  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 69961.9us
I20260709 13:03:17.912483  6780 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.941908  6512 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:17.936141  6395 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:17.938585  6776 raft_consensus.cc:697] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:17.967995  6512 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.007123  6512 raft_consensus.cc:3060] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:03:17.974057  6841 log.cc:927] Time spent T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.215s	user 0.001s	sys 0.001s
I20260709 13:03:17.943081  6727 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:17.960820  6827 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:18.102365  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 153205us
W20260709 13:03:17.987253  6844 log.cc:927] Time spent T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:03:17.960443  6831 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:17.957181  6746 consensus_queue.cc:237] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.945726  6755 raft_consensus.cc:493] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.117009  6682 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:18.136821  6750 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.150549  1535 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37906 (request call id 2734) took 1619 ms. Trace:
I20260709 13:03:18.151021  1535 rpcz_store.cc:276] 0709 13:03:16.531247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.531387 (+   140us) service_pool.cc:224] Handling call
0709 13:03:16.531712 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:17.009142 (+477430us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:03:17.146009 (+136867us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.319804 (+173795us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b4800030e58. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd033a31aa1 00007fd033a28b37 00007fd033a289ca 00007fd033b2026f 00007fd033b1ff37 00007fd033b3455c 00007fd033b34508 00007fd033b34488 00007fd033b34443 00007fd033b336ec 00007fd032a5da96
0709 13:03:17.469102 (+149298us) log.cc:844] Serialized 14 byte log entry
0709 13:03:17.469531 (+   429us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:17.469966 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:03:17.470080 (+   114us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:03:17.470109 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:17.470175 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:18.150326 (+680151us) raft_consensus.cc:1685] finished
0709 13:03:18.150348 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:18.150486 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":503756,"prepare.queue_time_us":132210,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":84,"raft.queue_time_us":513114,"raft.run_cpu_time_us":2917,"raft.run_wall_time_us":342913,"spinlock_wait_cycles":5966208,"thread_start_us":223731,"threads_started":2,"wal-append.queue_time_us":391435}
I20260709 13:03:18.152554  6776 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:18.160820  6780 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:18.161428  1436 catalog_manager.cc:5697] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 10, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.163110  1436 catalog_manager.cc:5697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.101843  6849 raft_consensus.cc:2804] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:18.165984  6849 raft_consensus.cc:697] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:18.111078  6741 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:18.137573  6755 raft_consensus.cc:515] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.018157  6784 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.109344  6512 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:17.958070  1504 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.118395  1689 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:18.113682  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:18.174753  1609 raft_consensus.cc:2393] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:18.121431  1607 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:03:18.174881  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 216878us
I20260709 13:03:18.123185  6794 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:18.111985  6669 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:18.125236  1616 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:18.098094  6805 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.126725  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:18.128235  6827 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.134195  2367 raft_consensus.cc:3055] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:18.138420  6682 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:18.172672  6691 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:18.120088  1505 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.185076  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.213163  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:18.219483  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 99559.2us
I20260709 13:03:18.220996  1505 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.186475  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.222417  1535 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:18.187004  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.188293  1541 raft_consensus.cc:1275] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:18.189008  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:18.198886  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:18.226595  1537 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.190047  6794 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:18.189970  6824 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:03:18.183215  6831 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:18.195523  6421 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:03:18.248932  6794 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:18.200771  6805 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.189677  6850 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.248010  1436 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.207072  6727 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.196238  2367 raft_consensus.cc:740] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:18.212463  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.217597  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.256481  1536 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:18.257151  6428 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:18.257687  6428 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.259687  6727 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:18.235150  6512 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:18.235417  6845 log.cc:927] Time spent T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.136s	user 0.000s	sys 0.002s
I20260709 13:03:18.263331  6428 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.196375  6669 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:18.250864  6395 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.236938  6755 leader_election.cc:290] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.264881  1609 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:18.237305  6795 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:18.238580  6682 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:18.239202  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:18.240980  6779 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.241261  6848 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.268206  6795 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.250600  6835 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:18.268936  6848 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.269424  6835 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.270231  6795 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.270989  6848 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.242079  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:18.272076  1607 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:18.272432  6850 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.265987  6827 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.273355  6753 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.251183  6750 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:03:18.275650  6753 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:18.275849  1436 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.276741  1613 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:18.277093  6380 consensus_queue.cc:1059] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:18.267866  6805 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.181550  6741 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.248014  6849 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.248416  6851 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:18.254762  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:18.266779  6395 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.278146  1436 catalog_manager.cc:5697] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.267838  6669 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:18.283718  6691 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:18.255016  1537 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:18.294490  1504 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.286202  1607 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:18.318807  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:18.321237  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 214498us
I20260709 13:03:18.336230  6779 raft_consensus.cc:2749] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:03:18.337809  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 43489.4us
I20260709 13:03:18.339026  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.233172  6652 consensus_queue.cc:1059] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:03:18.271925  6835 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.349025  1540 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:18.350244  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:18.344542  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 92180us
I20260709 13:03:18.362236  1684 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:03:18.309872  6823 raft_consensus.cc:3055] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:18.352095  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.353076  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.364548  1683 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:18.369024  2363 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:03:18.369626  2363 raft_consensus.cc:606] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:18.372364  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:18.357347  1436 catalog_manager.cc:5697] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 4 to 9, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.351039  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.375528  1686 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:18.373752  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:18.376579  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 63868.4us
I20260709 13:03:18.380980  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.385038  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.381244  1686 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:18.375996  1436 catalog_manager.cc:5697] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.361593  6779 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:18.312937  6741 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.390051  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:18.375609  6827 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:03:18.322270  6727 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:03:18.320067  6512 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:03:18.365636  6823 raft_consensus.cc:740] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:18.380545  1579 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.410967  1579 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.409778  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.412530  1579 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.342980  6691 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.420246  1436 catalog_manager.cc:5697] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 7 to 8, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.427193  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23c94fd76da84decac35ba61e1d5cb3c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:18.416167  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.429847  1689 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:18.433485  1504 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.567595  6780 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.568565  6691 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:03:18.570007  6395 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.570628  1685 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 17.
I20260709 13:03:18.575608  6590 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:18.659914  6590 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:18.661170  6590 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.662979  6590 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.417774  6848 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:18.664364  6848 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.664853  6848 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.585053  6850 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.588227  6823 consensus_queue.cc:260] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:18.673363  6823 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:18.417423  6789 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:18.676374  6789 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:18.677065  6789 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.581758  6428 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:18.680466  6428 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:18.682722  6428 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.581365  6805 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:18.683321  6805 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:18.683696  6805 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:18.605079  2367 consensus_queue.cc:260] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:18.609133  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 224294us
I20260709 13:03:18.438254  6759 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:18.686307  6759 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.686707  6759 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.689348  6741 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:18.613386  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.690485  1535 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:18.614392  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.615223  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.693504  1538 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:03:18.616072  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.616881  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.617717  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.695441  1536 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 17: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:18.619045  1539 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:18.651053  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.697422  1540 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
W20260709 13:03:18.702389  6719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.094s	sys 0.131s
W20260709 13:03:18.702867  6719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.095s	sys 0.132s
I20260709 13:03:18.706454  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:18.716619  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 304181us
W20260709 13:03:18.653975  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 297901us
I20260709 13:03:18.718326  1504 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.719297  6395 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.654801  6827 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:03:18.655972  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 78033.8us
I20260709 13:03:18.657788  6852 raft_consensus.cc:993] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:18.628301  6780 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.728394  6780 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:18.740517  6831 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:18.748085  1532 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:03:18.748246  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 62460.9us
I20260709 13:03:18.752219  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.757104  1505 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:18.761198  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 345173us
I20260709 13:03:18.761665  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.763965  6682 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:18.765800  6625 raft_consensus.cc:1081] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
W20260709 13:03:18.766556  6800 consensus_meta.cc:287] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.002s
I20260709 13:03:18.768127  6800 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53388 (request call id 626) took 2396 ms. Trace:
I20260709 13:03:18.773169  1579 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.782037  1505 leader_election.cc:304] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:18.762315  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.779753  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:34908
I20260709 13:03:18.782886  6395 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:18.784703  1540 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:18.785298  1540 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.786800  6674 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:18.787510  6674 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.789759  6674 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:18.792023  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.794811  6866 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:18.795466  6866 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:18.796474  6866 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.816259  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.822718  1685 raft_consensus.cc:1275] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:18.820842  1540 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:18.795591  6848 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.809693  6850 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:18.835783  6850 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:18.839418  6850 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.781124  6800 rpcz_store.cc:276] 0709 13:03:16.384324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.393241 (+  8917us) service_pool.cc:224] Handling call
0709 13:03:16.694398 (+301157us) ts_tablet_manager.cc:934] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
0709 13:03:17.517000 (+822602us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:18.114040 (+597040us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:18.147255 (+ 33215us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:18.767257 (+620002us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:18.767563 (+   306us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:18.767969 (+   406us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:18.768026 (+    57us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":2756,"tablet-copy.queue_time_us":173113,"thread_start_us":138584,"threads_started":2}
I20260709 13:03:18.807961  6763 ts_tablet_manager.cc:1929] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.8
I20260709 13:03:18.844794  6763 log.cc:1199] T 71e3bb6ac3eb408ba9c57b48de886d65 P f6eecf73c1c24b5eb268b5088a3030d4: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/wals/71e3bb6ac3eb408ba9c57b48de886d65
I20260709 13:03:18.846398  6763 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51746 (request call id 2) took 3425 ms. Trace:
I20260709 13:03:18.847195  1580 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:18.850024  1580 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:18.851334  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:18.852540  1533 raft_consensus.cc:2393] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:18.852742  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.854336  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:18.855418  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:18.856122  1539 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.860991  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:18.861934  1536 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.865128  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.866091  1532 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 17.
I20260709 13:03:18.851284  1540 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:18.827421  6395 raft_consensus.cc:2749] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:18.875459  1685 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:18.876977  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:18.913578  1616 raft_consensus.cc:3060] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:03:18.891445  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:18.891866  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.914539  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:18.892495  6784 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:18.897351  1609 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 16: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:18.898974  6848 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:18.835917  6806 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:18.906792  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:18.846822  6763 rpcz_store.cc:276] 0709 13:03:15.421297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:15.421821 (+   524us) service_pool.cc:224] Handling call
0709 13:03:15.615008 (+193187us) ts_tablet_manager.cc:1151] Deleting tablet 71e3bb6ac3eb408ba9c57b48de886d65
0709 13:03:15.616789 (+  1781us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:03:18.113890 (+2497101us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:18.807800 (+693910us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:18.846294 (+ 38494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1559841,"tablet-delete.queue_time_us":183484,"thread_start_us":97445,"threads_started":1}
I20260709 13:03:18.930922  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:18.914747  1683 raft_consensus.cc:606] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:18.931550  1683 raft_consensus.cc:614] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:18.931583  2370 raft_consensus.cc:3055] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:18.918990  1536 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:18.920058  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:18.931706  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:18.887661  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:18.803974  6759 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.927062  1689 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.932158  2370 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:18.933084  1611 raft_consensus.cc:3060] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.874099  6669 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:18.954471  1539 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 17.
I20260709 13:03:18.955281  6780 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:18.849011  6428 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:03:18.971387  1687 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 in current term 16: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:18.942301  2370 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:18.968364  1611 raft_consensus.cc:2468] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
W20260709 13:03:18.972810  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45712.2us
W20260709 13:03:18.974431  2329 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:18.975966  1689 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:18.979789  2370 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:18.981108  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "932266aa19544648a426ac5605e04ff8"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:18.982277  1689 raft_consensus.cc:606] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:18.942931  6669 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:18.986074  1616 raft_consensus.cc:2468] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 17.
W20260709 13:03:18.987679  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 80503.2us
I20260709 13:03:18.935024  6795 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:03:18.990871  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:18.998710  1689 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:18.979434  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 71e3bb6ac3eb408ba9c57b48de886d65 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:18.992341  6669 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:18.988692  6849 consensus_queue.cc:1048] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:03:19.003052  6380 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:19.000679  6835 raft_consensus.cc:493] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:19.021539  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b07448991374497e87b5636471d14890"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:19.022667  1683 raft_consensus.cc:606] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:19.023108  1683 raft_consensus.cc:614] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:19.023207  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:19.031106  6806 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:19.032596  6835 raft_consensus.cc:515] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.040374  6380 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:19.041224  6759 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:19.041860  6780 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:19.032296  6864 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:19.050895  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:19.052809  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:19.057092  1614 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:03:19.039481  6805 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:19.032362  6873 log.cc:927] Time spent T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
I20260709 13:03:19.053557  2370 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
W20260709 13:03:19.081241  2331 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:19.080740  6380 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:19.053174  6827 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:19.095131  1538 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:03:19.096189  6421 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.096803  6421 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.098907  6421 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:19.100966  6868 raft_consensus.cc:993] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:19.101393  6868 raft_consensus.cc:1081] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:19.106621  6789 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.107659  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.108341  1537 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:19.108351  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:19.111310  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:19.108827  1539 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:19.112659  1541 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:19.113209  1687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:19.113735  1687 raft_consensus.cc:606] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:19.114192  1687 raft_consensus.cc:614] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:19.119342  1654 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:19.067914  6806 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.126037  1537 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 16.
I20260709 13:03:19.128877  1608 raft_consensus.cc:1240] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Rejecting Update request from peer 9d926c10b90f452ba52d80dab6a50351 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:19.129536  2367 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:19.122186  1505 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:19.132562  1580 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:19.134174  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:19.137797   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:19.141947   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:19.145963  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:19.128501  6674 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:19.162752  6827 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.167441  6827 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.168413  6805 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.169626  6827 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.169512  6805 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:19.130828  6850 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.171015  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:19.171224  1616 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 17.
I20260709 13:03:19.171626  1687 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 11.
I20260709 13:03:19.172205  6850 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.173142  1504 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:19.174127  6827 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:19.174549  6827 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.174906  6827 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.185755  6867 consensus_queue.cc:1048] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:03:19.187603  6867 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:19.187672  6800 tablet_copy_client.cc:806] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:19.129187  6428 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:19.136765  6691 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.144480  6750 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.207962  6674 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.154920  6848 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:19.157145  6882 log.cc:927] Time spent T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:03:19.219715  6428 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.230829  6428 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.224006  6674 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.217774  6867 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:19.232595  6867 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:19.234468  6800 tablet_copy_client.cc:670] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:19.226315  6835 leader_election.cc:290] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.243640  6789 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.252404  6867 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.242410  6806 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.254110  6827 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.257507  6669 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.261526  1612 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:19.254804  2367 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 7.
I20260709 13:03:19.283674  2362 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:19.285307  2367 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46602 (request call id 490) took 1442 ms. Trace:
I20260709 13:03:19.285948  2367 rpcz_store.cc:276] 0709 13:03:17.823953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:17.824133 (+   180us) service_pool.cc:224] Handling call
0709 13:03:18.134072 (+309939us) spinlock_profiling.cc:243] Waited 97.4 ms on lock 0x7b5400701fa0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea7fdc0 00007fd02eb0be18 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:18.570131 (+436059us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400701fa0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea8606f 00007fd02eafef60 00007fd02eb007de 00007fd02eb0c27c 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2
0709 13:03:18.595814 (+ 25683us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b5400701fa0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea85520 00007fd02eafef70 00007fd02eb007de 00007fd02eb0c27c 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c 00007fd02d0477c2
0709 13:03:18.815329 (+219515us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b580078b3d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea640aa 00007fd02eae6447 00007fd02eafefe7 00007fd02eb007de 00007fd02eb0c27c 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c
0709 13:03:19.103764 (+288435us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b580078b9d0. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea71571 00007fd02ea640aa 00007fd02eae6447 00007fd02eafefe7 00007fd02eb007de 00007fd02eb0c27c 00007fd033acdb17 00007fd02d0486d4 00007fd02d048662 00007fd02d048591 00007fd02d04850c
0709 13:03:19.266603 (+162839us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219625472}
W20260709 13:03:19.287240  6724 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:03:19.243507  6674 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.321779  6674 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:19.306823  6669 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.324098  6867 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 18 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:03:19.305933  6750 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:19.338089  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 337832us
I20260709 13:03:19.330888  6827 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.337977  6750 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.345646  6806 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:19.351783  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 205905us
W20260709 13:03:19.353152  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 206425us
I20260709 13:03:19.357548  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:19.358322  1689 raft_consensus.cc:2368] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12.
I20260709 13:03:19.358314  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:19.359915  1683 raft_consensus.cc:2368] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 17. Current term is 18.
I20260709 13:03:19.361263  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:19.361979  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:19.362732  1688 raft_consensus.cc:2368] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13.
I20260709 13:03:19.368793  6750 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.368878  1580 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:19.369619  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:19.370525  6894 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:19.372144  6894 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:19.372435  1688 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:19.373200  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:19.373840  1689 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.376143  6894 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:19.377228  6894 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.380530  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe4d60be9064db2abedb55cb715c172" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:19.384370  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.385155  1539 raft_consensus.cc:2393] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 11: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:19.386185  6682 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.386682  6682 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.387066  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:19.388873  6682 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.374773  1654 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:19.391189  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.392678  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:19.393255  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.395167  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:19.396301  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.406163  1539 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 17: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:19.400764  1538 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:03:19.397702  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.407604  1689 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:19.410921  1504 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:19.413051  1612 raft_consensus.cc:1240] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: []
I20260709 13:03:19.415759  1579 leader_election.cc:400] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12.
I20260709 13:03:19.417922  1579 leader_election.cc:403] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:03:19.408349  1654 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:19.418951  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:19.419364  1540 raft_consensus.cc:2393] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 12: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:19.419699  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:19.421101  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:19.425037  1686 raft_consensus.cc:1240] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:03:19.442338  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:19.448390  1536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "932266aa19544648a426ac5605e04ff8"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:03:19.449051  1536 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.449393  1536 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.449833  1541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.450647  1541 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.451716  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.452873  1539 raft_consensus.cc:2393] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 16: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:19.455869  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:19.457301  1614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:19.459101  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:19.466073  1608 raft_consensus.cc:1275] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:19.483445  1540 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:19.486339  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:19.421420  6682 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:03:19.486915  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 58890.6us
I20260709 13:03:19.418883  6890 raft_consensus.cc:2804] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:19.495103  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:19.418648  6885 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:19.458020  6669 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.452327  6674 raft_consensus.cc:2804] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:19.501379  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.510358  1540 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.476220  1536 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.496148  1505 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:19.513114  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 68012.2us
I20260709 13:03:19.514027  1579 leader_election.cc:400] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 17. Current term is 18.
I20260709 13:03:19.514493  1579 leader_election.cc:403] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:03:19.517956  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:19.518661  1533 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:19.520502  1539 raft_consensus.cc:1240] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:03:19.537238  1536 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.538268  1540 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:19.542268  1541 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:19.543678  6755 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:03:19.543876  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47831.8us
I20260709 13:03:19.424902  6789 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:03:19.479890  6848 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:03:19.547371  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:19.545538  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:19.549772  1616 raft_consensus.cc:1275] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:03:19.550904  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:19.551549  1579 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:19.552691  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:19.553321  1609 raft_consensus.cc:3060] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:19.551483  1611 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:03:19.559329  1689 raft_consensus.cc:3055] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:19.559835  1689 raft_consensus.cc:740] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:19.562587  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:19.563182  1616 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:03:19.566730  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 43979.1us
I20260709 13:03:19.564332  1689 consensus_queue.cc:260] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.515486  6682 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:19.575695  1611 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 18.
I20260709 13:03:19.575795  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:19.502198  6380 consensus_queue.cc:1059] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:03:19.584509  1616 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:19.550300  6674 raft_consensus.cc:697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:19.466200  6866 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:03:19.518862  6890 raft_consensus.cc:697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:19.570212  1689 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.572237  1579 leader_election.cc:400] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13.
I20260709 13:03:19.592381  1579 leader_election.cc:403] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:03:19.592551  1609 raft_consensus.cc:2468] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:19.593681  1579 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:19.563642  6722 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.602998  1579 leader_election.cc:304] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:19.517373  6885 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.580756  6727 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.579493  6428 raft_consensus.cc:2749] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:19.577003  6894 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 17. Current term is 18.
I20260709 13:03:19.603727  6893 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:03:19.604941  6848 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:19.610055  1690 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:19.612377  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:19.573000  1533 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 18.
I20260709 13:03:19.592242  6755 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:19.629172  6428 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:19.604267  6380 raft_consensus.cc:3055] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:19.600299  6806 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 12. Current term is 13.
I20260709 13:03:19.617211  6835 raft_consensus.cc:2749] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.640626  6893 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:19.627348  1689 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
W20260709 13:03:19.652958  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 74687.4us
W20260709 13:03:19.655937  6891 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:03:19.619414  6850 consensus_queue.cc:1059] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:03:19.669274  1505 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:19.639273  6380 raft_consensus.cc:740] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:19.605137  6722 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:19.691509  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:19.693377  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:19.697041  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 61395.6us
I20260709 13:03:19.604930  6682 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.649436  6784 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.710947  6900 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:19.712275  6691 consensus_queue.cc:1048] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:19.603868  6890 consensus_queue.cc:237] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.642114  6428 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:19.704456  6831 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:19.707993  6727 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:19.709492  6623 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:19.738054  6800 tablet_copy_client.cc:538] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:19.709869  6824 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:19.649848  6893 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.650753  6674 consensus_queue.cc:237] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.709653  6590 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:03:19.744236  6907 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.007s
I20260709 13:03:19.741353  6669 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 11. Current term is 12.
I20260709 13:03:19.754014  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:19.764206  6623 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:19.764766  6623 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:19.765604  6623 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.761224  1654 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:19.741871  6831 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:19.777191  1532 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:19.790392  1654 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:19.792109  6867 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:03:19.793473  6911 log.cc:927] Time spent T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:03:19.793567  1609 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:03:19.760202  6453 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:03:19.809422  6776 raft_consensus.cc:3055] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:19.809933  6776 raft_consensus.cc:740] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:19.777316  6909 raft_consensus.cc:2804] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:19.819279  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:19.753252  6824 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:19.816896  6806 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:19.821167  6453 consensus_queue.cc:1048] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:03:19.827313  6806 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.810773  6776 consensus_queue.cc:260] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.829350  6776 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:19.758641  6380 consensus_queue.cc:260] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.823978  6909 raft_consensus.cc:697] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:19.837025  6909 consensus_queue.cc:237] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.837477  6831 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.824632  6691 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:19.839211  6691 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:19.840175  6691 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:19.840639  6722 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:19.850813  6824 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.880621  6780 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:19.888214  1616 raft_consensus.cc:1240] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:03:19.889938  1613 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:19.893191  6893 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:19.889288  6913 raft_consensus.cc:493] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:19.927693  6889 consensus_queue.cc:1059] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:19.924867  6913 raft_consensus.cc:515] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:19.989259  6919 log.cc:927] Time spent T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:03:19.990356  6913 leader_election.cc:290] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:20.032282  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.022475  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:19.909451  6866 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:03:20.033776  1608 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:03:20.067636  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.069185  1534 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
W20260709 13:03:20.078644  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.093885  6800 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:20.138485  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:20.139293  2362 raft_consensus.cc:2393] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 13: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:03:20.139725  1689 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:20.142134  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:20.144426  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.145013  1689 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:20.155902   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:20.165978  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:20.166375  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.170245  6903 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:20.173283  6885 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.176676  6806 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.178428  6894 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:20.178918  6894 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:20.179280  6894 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.181221  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.188512  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:20.191433  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.192534  1533 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 14: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:20.193303  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.195804  1539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.196696  1539 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:03:20.203819  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.071730  6920 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:03:20.217625  1535 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:03:20.214972  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c75c8e4f95149fba99bb9728c2f21d8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.224575  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:20.239928  6421 raft_consensus.cc:3055] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:20.240433  6421 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
W20260709 13:03:20.248395  6918 log.cc:927] Time spent T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.118s	user 0.001s	sys 0.003s
I20260709 13:03:20.271684  1580 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:20.241385  6421 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:20.315442  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 43927.6us
I20260709 13:03:20.316781  2367 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:20.255017  6805 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.324409  6912 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:20.322816  1580 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:20.378353  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 55606.9us
I20260709 13:03:20.379235  1580 leader_election.cc:304] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:20.320273  6864 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:03:20.396955  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 320993us
I20260709 13:03:20.378505  6784 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:20.390933  6885 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:20.414641  6805 raft_consensus.cc:2749] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:20.392405  6864 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:20.390302  6682 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
W20260709 13:03:20.463811  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 84678.6us
I20260709 13:03:20.457934  6864 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.509141  6866 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:03:20.510234  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 95864us
I20260709 13:03:20.422240  6784 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:20.462653  6682 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:20.509974  6866 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:20.500900  6805 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:20.548934  6805 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:20.551348  6805 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.552448  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.554351  6784 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.557627  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.563266  6682 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.564931  1532 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:20.571566  1688 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:20.548163  6866 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:20.575239  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:20.575940  1615 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:20.579977  6380 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.581566  6894 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:20.584352  6894 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:20.585507  6929 log.cc:927] Time spent T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:03:20.587528  1505 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:20.588496  6395 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:20.588915  6395 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:20.589098  6722 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.589270  6395 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:20.589747  6722 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:20.594370  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.595043  1686 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
I20260709 13:03:20.596212  2328 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:20.596657  1507 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:20.596961  6722 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.597556  6722 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:20.598439  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:20.599165  1533 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 14: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:20.601159  6421 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.602494  1688 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:03:20.607735  1504 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:20.609496  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 118479us
I20260709 13:03:20.616209  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.615572  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.617034  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:20.598455  6722 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.615449  6861 raft_consensus.cc:2749] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.652868  1689 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
W20260709 13:03:20.654016  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 131439us
I20260709 13:03:20.622648  6806 raft_consensus.cc:493] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:20.634578  6722 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:20.660430  1611 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:20.666175  1579 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:20.619253  6395 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:20.670964  1611 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:03:20.685650  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:20.686395  1610 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:20.686630  1608 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:20.687469  1613 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:20.688941  1615 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:20.666720  6806 raft_consensus.cc:515] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:20.705772  6428 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:20.709539  1611 pending_rounds.cc:85] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 7
I20260709 13:03:20.714395  1611 pending_rounds.cc:107] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:03:20.714771  1611 raft_consensus.cc:2889] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:20.711383  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 51697.5us
I20260709 13:03:20.717334  6395 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.717414  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:20.718874  6789 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:20.719379  6789 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:20.720422  6789 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:20.724546  6395 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:20.734372  1611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
W20260709 13:03:20.740688  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 121971us
I20260709 13:03:20.743059  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.744890  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:20.746260  6380 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:20.747671  6380 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:20.748229  6380 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:20.750237  1533 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:20.752156  1535 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:20.760576  1533 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 18 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:03:20.764021  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.769904  1533 raft_consensus.cc:1275] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:20.776496  1535 raft_consensus.cc:1275] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:03:20.774899  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:20.783690  6867 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:20.790988  1580 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:20.791827  1504 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:20.793967  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.794745  6823 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:20.803828  1535 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:03:20.806948  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 101) took 4014 ms. Trace:
I20260709 13:03:20.807380  1438 rpcz_store.cc:276] 0709 13:03:16.843015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:16.869674 (+ 26659us) service_pool.cc:224] Handling call
0709 13:03:20.806860 (+3937186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14189,"reported_tablets":1}
I20260709 13:03:20.816363  6866 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:20.821700  6866 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:20.750532  6380 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:20.826848  6866 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:20.841297  6722 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:20.848990  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 319826us
I20260709 13:03:20.731326  6864 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:20.850383  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
W20260709 13:03:20.864948  6933 log.cc:927] Time spent T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.197s	user 0.004s	sys 0.000s
I20260709 13:03:20.872340  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:20.874357  6724 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:20.874833  6724 raft_consensus.cc:493] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:20.875181  6724 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:20.714257  6903 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:20.878983  6864 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:20.870121  6722 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.666527  6824 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.187s
W20260709 13:03:20.912577  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44150.4us
I20260709 13:03:20.881253  6866 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:03:20.912425  6750 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:03:20.885860  6823 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:20.917802  6823 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:20.916698  6674 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:20.920790  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:20.920928  6927 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:20.944780  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:20.953946  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:20.932857  6395 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:20.956724  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:20.933104  6453 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:20.960366  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:20.935410  6931 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:03:20.970582  6806 leader_election.cc:290] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.940295  6682 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:03:20.973315  6724 raft_consensus.cc:515] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:20.950129  6938 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:03:20.981609  6727 consensus_queue.cc:1048] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
W20260709 13:03:20.990846  6944 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:03:20.962203  6395 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.012217  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:20.999281  6691 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:03:21.021150  6395 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:20.994292  6623 consensus_queue.cc:1048] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:03:21.030157  6945 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:21.052134  2362 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:03:21.053300  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 262402us
I20260709 13:03:21.054975  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:21.055663  1538 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.056242  1611 raft_consensus.cc:1275] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:03:21.057268  1533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:21.062093  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:21.062641  6776 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:21.063277  6776 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:21.064229  1690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48364 (request call id 2633) took 1058 ms. Trace:
I20260709 13:03:21.064594  1690 rpcz_store.cc:276] 0709 13:03:20.013173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:20.013301 (+   128us) service_pool.cc:224] Handling call
0709 13:03:20.070791 (+ 57490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:20.072351 (+  1560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:20.072376 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:20.768123 (+695747us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b2c00142518. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02d401a11 00007fd02d411372 00007fd02eb43a01 00007fd02eb0843a 00007fd02eb0783e 00007fd033acc419 00007fd02d043bd4 00007fd02d043b62 00007fd02d043a91 00007fd02d043a0c 00007fd02d042cc2
0709 13:03:20.768549 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:03:20.938490 (+169941us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:20.938535 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:20.938608 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:21.042749 (+104141us) raft_consensus.cc:1685] finished
0709 13:03:21.042787 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:21.064141 (+ 21354us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1193,"raft.queue_time_us":9962,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"spinlock_wait_cycles":39233920,"thread_start_us":169538,"threads_started":1,"wal-append.queue_time_us":197239}
I20260709 13:03:21.066800  6784 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:21.000295  6724 leader_election.cc:290] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:21.080821  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49744.8us
I20260709 13:03:21.087133  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67e293fa644844dd93fd078b7ba39692" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:21.088496  1538 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 14.
I20260709 13:03:21.067543  6784 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:21.065130  6428 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:21.111379  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:21.112185  1608 raft_consensus.cc:3060] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:21.073637  6827 consensus_queue.cc:1059] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:03:21.098706  6912 raft_consensus.cc:493] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.136471  6900 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:21.103336  6913 raft_consensus.cc:493] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.100143  6428 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:21.163632  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8967fd754a1f427d8138f7d6380b06c0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:21.164819  2362 raft_consensus.cc:2368] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14.
I20260709 13:03:21.175669  6903 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:21.176373  6903 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.178424  6903 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:21.156284  6428 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.242098  1608 raft_consensus.cc:2468] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 14.
I20260709 13:03:21.153790  6912 raft_consensus.cc:515] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.159652  6890 consensus_queue.cc:1048] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:03:21.158471  6913 raft_consensus.cc:515] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.155748  6900 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:21.235016  6867 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
W20260709 13:03:21.254065  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 164441us
I20260709 13:03:21.278270  1579 leader_election.cc:400] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14.
I20260709 13:03:21.284309  1579 leader_election.cc:403] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:03:21.312940  2329 leader_election.cc:304] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:21.320600  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:21.311549  6969 log.cc:927] Time spent T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:03:21.311671  6827 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.319868  6942 raft_consensus.cc:2804] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:21.316232  6806 raft_consensus.cc:2749] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365) with higher term. Message: Invalid argument: T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a for earlier term 13. Current term is 14.
I20260709 13:03:21.319133  6776 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:03:21.339928  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 155384us
I20260709 13:03:21.310235  6867 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:21.363441  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:21.369207  6957 log.cc:927] Time spent T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.362s	user 0.002s	sys 0.000s
I20260709 13:03:21.377390  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:21.381036  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:21.383661  6853 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:03:21.386260  6965 raft_consensus.cc:493] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.387040  6965 raft_consensus.cc:515] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.406842  6913 leader_election.cc:290] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:21.408375  6912 leader_election.cc:290] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:21.409235  1535 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:21.411646  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:21.415149  6674 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:21.415649  6674 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:21.417016  6674 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.418252  6674 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:21.425194  6900 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:21.363777  6942 raft_consensus.cc:697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 14 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:21.430284  6784 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:21.340605  6827 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.430512  6942 consensus_queue.cc:237] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:21.431614  6952 log.cc:927] Time spent T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.689s	user 0.003s	sys 0.008s
W20260709 13:03:21.432507  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 74302.3us
I20260709 13:03:21.434321  1580 leader_election.cc:304] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:21.435088  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:21.461545  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:21.467895  1608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:21.475303  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:21.389966  6965 leader_election.cc:290] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:21.481877  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:21.454138  6949 log.cc:927] Time spent T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.741s	user 0.004s	sys 0.000s
I20260709 13:03:21.487757  1580 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:21.492503  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:21.493142  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:21.494060  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:21.449564  6776 raft_consensus.cc:2749] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:21.501359  1685 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:03:21.465052  6800 log.cc:927] Time spent T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
I20260709 13:03:21.517199  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:21.517892  1612 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:21.519928  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0872608ab1d42e5b8f77cd6552348b3" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:21.520841  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8b7091c66f14b4ba944785e7c8873b9" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:21.523893  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dad730840e45b68065507815614a40" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:21.522310  6912 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:21.540830  1579 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:21.502491  6972 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.546626  6823 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:21.547269  6965 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:21.536341  6453 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:21.548707  6453 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.550876  6453 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:21.510987  6789 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:03:21.555014  1579 leader_election.cc:304] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:21.522235  6945 raft_consensus.cc:493] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:21.556100  6945 raft_consensus.cc:515] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:21.556797  1579 leader_election.cc:304] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:21.558091  1579 leader_election.cc:304] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:21.558751  6945 leader_election.cc:290] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:21.558859  6965 raft_consensus.cc:2749] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:03:21.560050  6776 raft_consensus.cc:2749] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:21.561123  6867 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:21.561553  6964 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:21.564951  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:21.565748  6893 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:03:21.567198  6955 log.cc:927] Time spent T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.743s	user 0.001s	sys 0.003s
I20260709 13:03:21.567637  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:21.570880  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:21.571660  1687 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:21.522135  6827 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:21.593609  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 58141.9us
I20260709 13:03:21.575459  6885 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:21.576849  6972 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.579707  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:21.624984  1685 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
W20260709 13:03:21.630283  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:21.633841  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:21.585745  6428 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.636904  6428 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:21.639211  6972 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:21.592106  6784 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:21.642071  6784 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.652473  1607 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:21.630568  6885 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:21.655732  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:21.662070  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:21.663489  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 68970.1us
I20260709 13:03:21.685905  1505 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:21.690842  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:21.696323  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e3bb6ac3eb408ba9c57b48de886d65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:21.700179  6800 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:21.701443  6800 tablet_bootstrap.cc:492] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:03:21.702215  6800 ts_tablet_manager.cc:1403] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 1.609s	user 0.054s	sys 0.003s
I20260709 13:03:21.718977  1537 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 15: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
W20260709 13:03:21.685487  6868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.014s	sys 0.015s
I20260709 13:03:21.691958  6824 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:03:21.727489  6868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.014s	sys 0.015s
I20260709 13:03:21.749049  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:21.749930  1610 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:21.730665  6965 raft_consensus.cc:2749] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:21.762108  1615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:21.738144  6824 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:21.817480  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 52852us
I20260709 13:03:21.761756  6755 raft_consensus.cc:3055] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:21.786978  1685 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:03:21.769771  6824 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:21.844883  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 133966us
I20260709 13:03:21.836896  6755 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
W20260709 13:03:21.867873  6981 log.cc:927] Time spent T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:03:21.867725  6755 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:21.869064  6755 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:21.869114  6800 raft_consensus.cc:359] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:21.870235  6800 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:21.870882  6800 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:21.876880  6885 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:21.878557  6824 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:21.911136  6950 log.cc:927] Time spent T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 1.163s	user 0.001s	sys 0.005s
W20260709 13:03:21.957031  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 322663us
W20260709 13:03:21.959867  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 112590us
I20260709 13:03:21.965519  1654 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:21.959583  1504 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:21.971073  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:21.984218  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:21.987072  6453 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:21.994789  6800 ts_tablet_manager.cc:1434] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.292s	user 0.005s	sys 0.006s
W20260709 13:03:22.002471  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 144475us
I20260709 13:03:22.011335  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:22.023243  6453 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:22.023794  6453 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.024310  6453 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:22.029551  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 70463.6us
I20260709 13:03:22.029789  6824 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:22.022589  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51763.7us
I20260709 13:03:22.048756  6920 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:22.051839  2367 raft_consensus.cc:1240] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Rejecting Update request from peer c98c328741aa493d87abafbf08f04944 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:03:22.053421  1536 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:22.115175  6665 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:22.124856  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:22.125504  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-f8464531709643ab8a8fd947089037ef received from {username='slave'} at 127.0.0.1:35722
I20260709 13:03:22.126497  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-f8464531709643ab8a8fd947089037ef on tablet f8464531709643ab8a8fd947089037ef with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:22.132941  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:22.135267  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 47465.1us
W20260709 13:03:22.137326  1653 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:22.125883  1689 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.132982  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:22.165589  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:22.185712  1616 raft_consensus.cc:1275] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:22.151100  6453 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:21.463711   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.219404  6912 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:22.220448  6912 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:22.228367  6912 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:22.238906  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:22.243144  6885 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:22.247578  6665 consensus_queue.cc:1048] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:22.244501  6885 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:22.265156  6784 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:22.268828  6453 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:22.271310  6885 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:22.273447  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:22.276783  1613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57548 (request call id 2822) took 1160 ms. Trace:
I20260709 13:03:22.286039  6951 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:22.282925  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:22.279639  1613 rpcz_store.cc:276] 0709 13:03:21.116593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.117743 (+  1150us) service_pool.cc:224] Handling call
0709 13:03:21.118053 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:21.118367 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:21.118402 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:21.118833 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:03:21.358521 (+239688us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:21.358567 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:21.358638 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:22.273029 (+914391us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b240028a408. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b8a19c4 00007fd02b89facb 00007fd02ba5adc9 00007fd02ba5aa55 00007fd02ba59fb0 00007fd02e6d0488 00007fd02e6d0be8 00007fd02e6a8398 00007fd02e6a376a 00007fd02e6a2bb6
0709 13:03:22.276246 (+  3217us) raft_consensus.cc:1685] finished
0709 13:03:22.276267 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:22.276549 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62905,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8290,"spinlock_wait_cycles":140391680,"thread_start_us":239373,"threads_started":1,"wal-append.queue_time_us":251486}
I20260709 13:03:22.319792  6920 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:22.320473  6920 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.322867  2362 raft_consensus.cc:1217] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
W20260709 13:03:22.318246  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 484660us
I20260709 13:03:22.340286  1437 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.342633  1579 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:22.343829  6967 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.347620  6967 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:22.349139  6967 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:22.354161  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 115506us
I20260709 13:03:22.365862  1437 catalog_manager.cc:5697] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 9 to 10, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.375296  1689 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:22.380100  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e3bb6ac3eb408ba9c57b48de886d65 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:51746
I20260709 13:03:22.381451  6827 raft_consensus.cc:493] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:22.382377  6827 raft_consensus.cc:515] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:22.385327  6827 leader_election.cc:290] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:22.387801  1437 catalog_manager.cc:5697] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 8 to 10, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.389616  1437 catalog_manager.cc:5697] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.391700  1437 catalog_manager.cc:5697] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 14, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.415879  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:22.421610  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:22.422699  1612 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:22.471835  1534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:22.472254  1505 leader_election.cc:304] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:22.477119  7000 raft_consensus.cc:2749] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:22.479517  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
W20260709 13:03:22.481691  1436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 188) took 31268 ms (client timeout 15000 ms). Trace:
I20260709 13:03:22.482900  1580 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:22.484283  6912 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:22.491417  1580 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:22.493394  6806 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:03:22.497506  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:22.498364  1616 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:22.482215  1436 rpcz_store.cc:269] 0709 13:02:51.244663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:51.245086 (+   423us) service_pool.cc:224] Handling call
0709 13:03:22.481386 (+31236300us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:18.702822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:18.703451 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:18.703499 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:03:18.703519 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:18.709927 (+  6408us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:18.710069 (+   142us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:18.710112 (+    43us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:03:18.711670 (+  1558us) tablet.cc:701] Row locks acquired
0709 13:03:18.711694 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:03:18.711904 (+   210us) write_op.cc:270] Start()
0709 13:03:18.712089 (+   185us) write_op.cc:276] Timestamp: P: 1783602198711838 usec, L: 0
0709 13:03:18.712127 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:03:18.713044 (+   917us) log.cc:844] Serialized 7522 byte log entry
0709 13:03:19.359276 (+646232us) op_driver.cc:464] REPLICATION: finished
0709 13:03:19.603206 (+243930us) write_op.cc:301] APPLY: starting
0709 13:03:19.603283 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:19.918724 (+315441us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:19.918895 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:20.591134 (+672239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:20.591467 (+   333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=0,mrs_lookups=0
0709 13:03:20.591514 (+    47us) write_op.cc:312] APPLY: finished
0709 13:03:20.591905 (+   391us) log.cc:844] Serialized 172 byte log entry
0709 13:03:20.625253 (+ 33348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.625487 (+   234us) write_op.cc:454] Released schema lock
0709 13:03:20.625557 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:20.626059 (+   502us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:20.626088 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":662834,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":243309,"apply.run_cpu_time_us":34522,"apply.run_wall_time_us":1022858,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83471,"num_ops":19,"prepare.queue_time_us":83305,"prepare.run_cpu_time_us":106620,"prepare.run_wall_time_us":227186,"raft.queue_time_us":255967,"raft.run_cpu_time_us":65186,"raft.run_wall_time_us":202622,"replication_time_us":632605,"thread_start_us":649430,"threads_started":5,"wal-append.queue_time_us":299148,"wal-append.run_cpu_time_us":77407,"wal-append.run_wall_time_us":2338708}]]}
I20260709 13:03:22.504495  1535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:22.507513  7000 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:22.508392  7000 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:22.510546  7000 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:22.468827  1504 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:22.511476  6920 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:22.512513  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 51189.8us
I20260709 13:03:22.512673  7000 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:22.512895  1536 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 14. Current term is 15. Ops: []
I20260709 13:03:22.514036  6920 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:22.518008  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:22.519690  1532 raft_consensus.cc:3060] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.519814  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:22.524341  1683 raft_consensus.cc:2368] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15.
I20260709 13:03:22.515148  1437 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 9 to 10, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.527698  1612 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:22.529177  1616 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:22.513430  7000 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:22.535778  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:22.541942  1437 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.544103  1504 leader_election.cc:400] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15.
I20260709 13:03:22.544911  1504 leader_election.cc:403] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:22.556209  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:22.562620  1437 catalog_manager.cc:5697] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 9 to 10, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.564769  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 71e3bb6ac3eb408ba9c57b48de886d65 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:22.566421  7000 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:22.568279  1437 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 9 to 10, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.577469  1437 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 13, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 13 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.591949  1437 catalog_manager.cc:5697] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 8 to 11, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.605600  1437 catalog_manager.cc:5697] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 9 to 11, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.607982  1654 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:22.609200  6889 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:22.608722  1437 catalog_manager.cc:5697] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 10 to 11, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.611632  1437 catalog_manager.cc:5697] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 6 to 8, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.613160  1437 catalog_manager.cc:5697] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:22.627853  1532 raft_consensus.cc:2468] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:22.631588  6920 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063) with higher term. Message: Invalid argument: T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15.
I20260709 13:03:22.631388  1437 catalog_manager.cc:5697] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 6 to 9, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.713788  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09947f1336f47c4b5bffef2326f83ee" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:22.718051  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:22.719225  1609 raft_consensus.cc:2368] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15.
I20260709 13:03:22.720383  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "145197b092764852a509770daae94107"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:22.721225  1685 raft_consensus.cc:606] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:22.721356  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:22.688437  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:22.722633  6889 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:22.737432  1505 leader_election.cc:304] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:22.743147  1505 leader_election.cc:400] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963) with higher term. Message: Invalid argument: T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for earlier term 14. Current term is 15.
I20260709 13:03:22.743325  1580 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:22.744390  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:22.740307  7000 raft_consensus.cc:2749] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:22.747439  6885 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:22.752846  1580 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:22.755970  6904 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:22.761648  6750 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:22.765470  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:22.766036  1685 raft_consensus.cc:606] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:22.766343  1685 raft_consensus.cc:614] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:22.764729  1654 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:22.761251  6904 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:03:22.795012  6590 raft_consensus.cc:2804] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:22.796294  6623 raft_consensus.cc:1064] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:03:22.799907  1685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "932266aa19544648a426ac5605e04ff8"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:22.800607  1685 raft_consensus.cc:606] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:22.800961  1685 raft_consensus.cc:614] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:22.805083  6590 raft_consensus.cc:697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:22.823638  1532 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:22.832340  6967 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:03:22.835335  6823 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:22.836103  6823 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:22.838497  6823 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:22.844168  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:22.844223  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:22.845280  1685 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
I20260709 13:03:22.846558  1504 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:22.846819  2362 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:03:22.847597  2362 raft_consensus.cc:606] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:22.847819  6827 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:22.847990  2362 raft_consensus.cc:614] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:22.848452  6827 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:22.848927  6827 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:22.824834  6590 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:22.863857  6806 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:03:22.864457  6806 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:22.865526  6806 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:22.867120  6806 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:22.871961  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8464531709643ab8a8fd947089037ef"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:22.873786  6623 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:22.901073  7013 log.cc:927] Time spent T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:03:22.932379  6827 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:23.026084  1532 raft_consensus.cc:1240] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Rejecting Update request from peer e8eefefed88a4903b423e9f487c4805a for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:03:23.031103  6827 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:23.036072  1689 raft_consensus.cc:606] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:23.059021   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:23.060020  2362 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:23.060829  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:23.061203   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:23.061448  1685 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.074513  6965 consensus_queue.cc:1059] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:23.075531  6806 raft_consensus.cc:3055] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:23.076001  6806 raft_consensus.cc:740] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:23.076329  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:23.082042  6806 consensus_queue.cc:260] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:23.083473  6806 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.091692  1613 raft_consensus.cc:2410] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c98c328741aa493d87abafbf08f04944 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:03:23.112362  1613 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:23.114465  1685 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 16.
I20260709 13:03:23.121296  1688 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:23.122576  6868 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:23.125659  1537 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:03:23.129251  6868 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:03:23.184612  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 55964.7us
I20260709 13:03:23.196650  1610 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:03:23.199676  6920 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:23.234122  6920 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:23.236156  1504 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:23.240965  6920 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:23.241533  6920 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:23.242471  6920 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:23.257968  1438 catalog_manager.cc:5697] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 6 to 7, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:23.287616  6590 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:03:23.310067  1540 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:23.332314  1609 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:03:23.341249  6931 raft_consensus.cc:993] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:23.341974  6931 raft_consensus.cc:1081] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:23.348616  7015 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:23.379586  6590 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:23.380349  6590 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:23.381254  6623 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:23.382172  1438 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55714 (request call id 102) took 2209 ms. Trace:
I20260709 13:03:23.383112  6590 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:23.386149  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:23.391561  2362 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 13: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:03:23.391368  6780 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:23.382648  1438 rpcz_store.cc:276] 0709 13:03:21.172525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:21.172684 (+   159us) service_pool.cc:224] Handling call
0709 13:03:21.382537 (+209853us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b5400002210. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b9e3b71 00007fd02b9e40b2 00007fd03495da89 00007fd0348f5da6 00007fd0348c7088 00007fd0349c537e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc
0709 13:03:23.382098 (+1999561us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:23.321174 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:23.321830 (+   656us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:23.321883 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:03:23.321901 (+    18us) tablet.cc:662] Decoding operations
0709 13:03:23.322286 (+   385us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:23.322369 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:23.322407 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:23.322626 (+   219us) tablet.cc:701] Row locks acquired
0709 13:03:23.322645 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:03:23.322816 (+   171us) write_op.cc:270] Start()
0709 13:03:23.322944 (+   128us) write_op.cc:276] Timestamp: P: 1783602203322770 usec, L: 0
0709 13:03:23.322970 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:03:23.323743 (+   773us) log.cc:844] Serialized 536 byte log entry
0709 13:03:23.351883 (+ 28140us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b1800111040. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd0348e3de1 00007fd0348f05b1 00007fd03253f41d 00007fd03254171a 00007fd0325416a8 00007fd032541628 00007fd0325415e3 00007fd0325407fc 00007fd034973626 00007fd03496ddd8 00007fd02eb14310
0709 13:03:23.351959 (+    76us) op_driver.cc:464] REPLICATION: finished
0709 13:03:23.361574 (+  9615us) write_op.cc:301] APPLY: starting
0709 13:03:23.361679 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:23.362951 (+  1272us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:23.362980 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:23.363742 (+   762us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:23.363929 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 13:03:23.363993 (+    64us) write_op.cc:312] APPLY: finished
0709 13:03:23.364364 (+   371us) log.cc:844] Serialized 25 byte log entry
0709 13:03:23.364553 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.364651 (+    98us) write_op.cc:454] Released schema lock
0709 13:03:23.364694 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:23.365110 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.365142 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15713,"reported_tablets":2,"spinlock_wait_cycles":7487872,"child_traces":[["op",{"apply.queue_time_us":1468,"apply.run_cpu_time_us":3401,"apply.run_wall_time_us":3515,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4176,"num_ops":1,"prepare.queue_time_us":165,"prepare.run_cpu_time_us":2942,"prepare.run_wall_time_us":2942,"replication_time_us":14931,"spinlock_wait_cycles":26639488}]]}
I20260709 13:03:23.402338  1537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "145197b092764852a509770daae94107"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:03:23.403369  1537 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.403793  1537 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.438287  1612 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:23.445518  1532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:23.446332  1532 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:23.450011  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet a93cfc3bb7634fb1b78c60f120616d9d with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:57272
I20260709 13:03:23.453688  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:23.459360  6890 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:23.459836  6890 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:23.451066  1438 catalog_manager.cc:5697] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 12 to 14, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.460568  6890 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:23.461386  1438 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index -1 to 9, term changed from 10 to 11, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195), NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added, now has a pending config: VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193), VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194), VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195), VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:23.479084  1437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 180) took 18866 ms (client timeout 15000 ms). Trace:
W20260709 13:03:23.479763  1437 rpcz_store.cc:269] 0709 13:03:04.612711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:04.613644 (+   933us) service_pool.cc:224] Handling call
0709 13:03:23.478964 (+18865320us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:22.777072 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:22.794510 (+ 17438us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:22.794562 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:03:22.794582 (+    20us) tablet.cc:662] Decoding operations
0709 13:03:22.796060 (+  1478us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:22.796185 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:22.796221 (+    36us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:03:22.797559 (+  1338us) tablet.cc:701] Row locks acquired
0709 13:03:22.797611 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:03:22.797759 (+   148us) write_op.cc:270] Start()
0709 13:03:22.797936 (+   177us) write_op.cc:276] Timestamp: P: 1783602202797698 usec, L: 0
0709 13:03:22.797983 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:03:22.798794 (+   811us) log.cc:844] Serialized 6362 byte log entry
0709 13:03:23.093064 (+294270us) op_driver.cc:464] REPLICATION: finished
0709 13:03:23.128907 (+ 35843us) write_op.cc:301] APPLY: starting
0709 13:03:23.129006 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:23.177636 (+ 48630us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:23.186090 (+  8454us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:23.219505 (+ 33415us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:23.219902 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 13:03:23.219979 (+    77us) write_op.cc:312] APPLY: finished
0709 13:03:23.245359 (+ 25380us) log.cc:844] Serialized 148 byte log entry
0709 13:03:23.247527 (+  2168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.248216 (+   689us) write_op.cc:454] Released schema lock
0709 13:03:23.248313 (+    97us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:23.248856 (+   543us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:23.248896 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":128346,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":35493,"apply.run_cpu_time_us":24412,"apply.run_wall_time_us":119883,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70943,"num_ops":16,"prepare.queue_time_us":102008,"prepare.run_cpu_time_us":28868,"prepare.run_wall_time_us":267943,"raft.queue_time_us":40741,"raft.run_cpu_time_us":4942,"raft.run_wall_time_us":56116,"replication_time_us":294912,"spinlock_wait_cycles":824704,"thread_start_us":376463,"threads_started":4,"wal-append.queue_time_us":230956}]]}
I20260709 13:03:23.512398  1537 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:23.523489  1532 raft_consensus.cc:1240] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:23.519049  1433 catalog_manager.cc:5697] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.537909  6890 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:23.544839  6890 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:23.531124  1433 catalog_manager.cc:5697] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.547824  1433 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:23.549491  1433 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 12 to 13, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.562551  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:23.557679  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:23.559465  1537 leader_election.cc:290] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:23.563477  1612 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.553514  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet a93cfc3bb7634fb1b78c60f120616d9d (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:23.564350  1685 raft_consensus.cc:3055] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:23.564692  1685 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:23.566236  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:23.567023  2362 raft_consensus.cc:2393] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 13: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:03:23.578882  2367 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:23.591359  1612 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 16.
I20260709 13:03:23.602087  1505 leader_election.cc:304] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:23.583240  1685 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:23.605481  1685 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:23.609097  6920 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:23.609753  6920 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:23.610723  6920 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:23.617362  7032 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:23.618076  7032 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:23.625965  7015 raft_consensus.cc:993] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:23.627178  7015 raft_consensus.cc:1081] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:23.637622  1538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:23.639109  1540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8464531709643ab8a8fd947089037ef"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:03:23.640920  1537 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:23.673321  1433 catalog_manager.cc:5697] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 14 to 15, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.676736  7032 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:23.677981  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:23.678951  1688 raft_consensus.cc:2410] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:03:23.678174  1540 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:23.680596  1540 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.701776  1540 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:23.711530  1609 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:03:23.721169  1609 pending_rounds.cc:85] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Aborting all ops after (but not including) 9
I20260709 13:03:23.711597  1433 catalog_manager.cc:5697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.721427  1609 pending_rounds.cc:107] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:03:23.721937  1609 raft_consensus.cc:2889] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:23.723789  6920 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:23.721342  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:23.728423  1685 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 16.
I20260709 13:03:23.724347  1538 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:23.740947  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:23.750510  1688 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:23.750574  7031 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:23.753453  7029 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:23.722573  1433 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.771467  1433 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 13 to 14, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.772912  1654 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:23.782905  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:23.785492  1609 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.787935  6453 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:23.788836  6453 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:23.789846  6453 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:23.787348  1433 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 8 to 11, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:23.801009  1433 catalog_manager.cc:5697] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.798725  1540 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:23.801904  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:23.804564  2367 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.802690  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:23.805202  1689 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:23.805512  1689 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:23.806213  1689 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:23.817476  1689 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:23.829280  2367 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:23.833653  1689 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:23.834892  1504 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:23.835743  7029 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:23.836320  7029 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:23.837414  7029 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:23.868167  1609 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 12.
I20260709 13:03:23.875022  1433 catalog_manager.cc:5697] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 10 to 11, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.885095  1433 catalog_manager.cc:5697] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 11 to 12, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.887151  1433 catalog_manager.cc:5697] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 10 to 11, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:23.905540  1433 catalog_manager.cc:5697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:23.907935  1433 catalog_manager.cc:5697] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 12, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.915231  1433 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.917198  1433 catalog_manager.cc:5697] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.924470  1433 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 12 to 13, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.940829  1433 catalog_manager.cc:5697] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 10 to 11, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.943085  1433 catalog_manager.cc:5697] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.945371  1433 catalog_manager.cc:5697] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:23.946828  1433 catalog_manager.cc:5697] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 11, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:23.949119  1433 catalog_manager.cc:5697] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 10, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:23.951241  1433 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 9 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:23.953227  1433 catalog_manager.cc:5697] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.044531  1610 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:24.056283  6750 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:03:24.098791   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:24.156087  6453 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:24.156759  6453 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:24.159010  6453 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:24.166020  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:24.167189  1610 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:24.174750  1689 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:24.175462  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944" is_pre_election: true
I20260709 13:03:24.176463  1537 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 15: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:24.181198  7029 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:24.184727  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:24.186107  6867 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:24.186609  6867 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:24.186991  6867 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:24.214385  1538 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:24.226703  6890 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:24.268603  6867 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:24.271837  6867 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:24.273265  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:24.294721  1609 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:24.296452  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:24.297421  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:24.298638  1536 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 15: Already voted for candidate c98c328741aa493d87abafbf08f04944 in this term.
I20260709 13:03:24.297416  6890 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:24.299666  6890 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:24.300601  6890 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:24.332930  2367 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:03:24.335577  1607 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:24.337630  6920 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:24.341325  6867 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:24.348704  1689 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:24.350978  6920 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:24.384042  2362 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:24.391119  7029 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:24.400504  6750 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:24.401110  6750 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:24.403313  6750 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:24.408906  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:24.415635  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:24.416846  1610 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 15.
I20260709 13:03:24.436556  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:24.438023  6951 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:24.439043  6951 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:24.443060  6951 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.510207  6951 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:24.525066  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:24.525668  1610 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:24.533327  1610 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 16.
I20260709 13:03:24.536409  6951 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:24.537789  1505 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:24.539228  6750 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:24.539703  6750 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:24.540402  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:24.540627  6750 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:24.572976  1437 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 9 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193), VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194), VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195), VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:24.629675  1437 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 11 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:24.633481  1437 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 11 to 13, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:24.693627  1538 raft_consensus.cc:1240] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Rejecting Update request from peer f6eecf73c1c24b5eb268b5088a3030d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:03:24.700901  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8464531709643ab8a8fd947089037ef"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57272
I20260709 13:03:24.701654  1538 raft_consensus.cc:606] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:03:24.707508  1536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8464531709643ab8a8fd947089037ef"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57272
I20260709 13:03:24.708253  1536 raft_consensus.cc:606] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Received request to transfer leadership
W20260709 13:03:24.711723  1424 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for f8464531709643ab8a8fd947089037ef already in progress [suppressed 14 similar messages]
W20260709 13:03:24.712683  1433 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48036 (request call id 189) took 11945 ms (client timeout 15000 ms). Trace:
I20260709 13:03:24.712723  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet 71e3bb6ac3eb408ba9c57b48de886d65 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:51746
I20260709 13:03:24.726840  6623 consensus_queue.cc:1059] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:03:24.728941  6623 consensus_queue.cc:1243] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Peer c98c328741aa493d87abafbf08f04944 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:03:24.729468  6890 raft_consensus.cc:3055] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:03:24.729984  6890 raft_consensus.cc:740] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:24.731515  6890 consensus_queue.cc:260] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:24.734565  6890 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:24.713325  1433 rpcz_store.cc:269] 0709 13:03:12.766836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.767113 (+   277us) service_pool.cc:224] Handling call
0709 13:03:24.712575 (+11945462us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:24.076253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:24.102712 (+ 26459us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:24.102745 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:03:24.102761 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:24.107543 (+  4782us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:24.107621 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:24.107646 (+    25us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:03:24.172102 (+ 64456us) tablet.cc:701] Row locks acquired
0709 13:03:24.172123 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:03:24.172284 (+   161us) write_op.cc:270] Start()
0709 13:03:24.172401 (+   117us) write_op.cc:276] Timestamp: P: 1783602204172235 usec, L: 0
0709 13:03:24.172424 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:03:24.173033 (+   609us) log.cc:844] Serialized 9854 byte log entry
0709 13:03:24.255473 (+ 82440us) op_driver.cc:464] REPLICATION: finished
0709 13:03:24.383785 (+128312us) write_op.cc:301] APPLY: starting
0709 13:03:24.383898 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:24.465014 (+ 81116us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:24.465149 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:24.548640 (+ 83491us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:24.548979 (+   339us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:03:24.549033 (+    54us) write_op.cc:312] APPLY: finished
0709 13:03:24.549476 (+   443us) log.cc:844] Serialized 220 byte log entry
0709 13:03:24.560529 (+ 11053us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:24.560751 (+   222us) write_op.cc:454] Released schema lock
0709 13:03:24.560816 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:24.571496 (+ 10680us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:24.571529 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33163,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":127988,"apply.run_cpu_time_us":32343,"apply.run_wall_time_us":187675,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108527,"num_ops":25,"prepare.queue_time_us":78527,"prepare.run_cpu_time_us":6497,"prepare.run_wall_time_us":97157,"replication_time_us":82890,"thread_start_us":106121,"threads_started":2}]]}
I20260709 13:03:24.776350  1538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8464531709643ab8a8fd947089037ef"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57272
I20260709 13:03:24.777091  1538 raft_consensus.cc:606] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:03:24.785651  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet 71e3bb6ac3eb408ba9c57b48de886d65 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:24.831099  6920 raft_consensus.cc:993] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: : Instructing follower 9d926c10b90f452ba52d80dab6a50351 to start an election
I20260709 13:03:24.831743  6920 raft_consensus.cc:1081] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Signalling peer 9d926c10b90f452ba52d80dab6a50351 to start an election
I20260709 13:03:24.839188  2367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8464531709643ab8a8fd947089037ef"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
 from {username='slave'} at 127.0.0.1:46612
I20260709 13:03:24.839816  2367 raft_consensus.cc:493] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:24.840232  2367 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:24.848763  1439 catalog_manager.cc:5697] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 11 to 13, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 13 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.858865  2367 raft_consensus.cc:515] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:24.867095  1536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:24.867913  1536 raft_consensus.cc:3055] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:24.868249  1536 raft_consensus.cc:740] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:24.868538  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:24.869275  1612 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:24.869176  1536 consensus_queue.cc:260] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:24.871405  1536 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:24.875414  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8464531709643ab8a8fd947089037ef" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:24.876075  1689 raft_consensus.cc:3060] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:24.874374  2367 leader_election.cc:290] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:24.881929  1612 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
I20260709 13:03:24.892629  1689 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
I20260709 13:03:24.893973  2328 leader_election.cc:304] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:24.898726  7032 raft_consensus.cc:2804] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:24.900022  7032 raft_consensus.cc:697] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:24.901098  7032 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:24.932592  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 58395.6us
I20260709 13:03:24.936758  1536 raft_consensus.cc:2468] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
I20260709 13:03:24.954245  1609 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:24.956221  6920 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:24.959198  1487 auto_rebalancer.cc:893] Removing replace marker failed: Replica c98c328741aa493d87abafbf08f04944 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:24.959648  1487 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f8464531709643ab8a8fd947089037ef already in progress
W20260709 13:03:24.960131  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f8464531709643ab8a8fd947089037ef already in progress
I20260709 13:03:24.964550  1439 catalog_manager.cc:5697] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 4 to 5, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 5 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:24.991480  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet a93cfc3bb7634fb1b78c60f120616d9d with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 6)) from {username='slave'} at 127.0.0.1:57272
I20260709 13:03:25.007788  1437 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 12 to 13, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.028278  1688 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:03:25.028795  1688 pending_rounds.cc:85] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting all ops after (but not including) 10
I20260709 13:03:25.029040  1688 pending_rounds.cc:107] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:03:25.029299  1688 raft_consensus.cc:2889] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:25.036149  7029 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 13:03:25.060570  1439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48034 (request call id 173) took 12584 ms (client timeout 15000 ms). Trace:
W20260709 13:03:25.062072  1434 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 179) took 42175 ms (client timeout 15000 ms). Trace:
I20260709 13:03:25.063685  1435 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 13 to 14, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:25.065088  1434 rpcz_store.cc:269] 0709 13:02:42.887058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:42.887455 (+   397us) service_pool.cc:224] Handling call
0709 13:03:25.061934 (+42174479us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7055,"reported_tablets":54}
I20260709 13:03:25.066324  1435 catalog_manager.cc:5697] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.094594  1435 catalog_manager.cc:5697] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.097191  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet a93cfc3bb7634fb1b78c60f120616d9d (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
W20260709 13:03:25.066606  1439 rpcz_store.cc:269] 0709 13:03:12.476603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:12.476835 (+   232us) service_pool.cc:224] Handling call
0709 13:03:12.648341 (+171506us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540019a0d4. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02ea72090 00007fd02eb10f3a 00007fd0348c71cc 00007fd0349c537e 00007fd032e862a4 00007fd032e86232 00007fd032e86161 00007fd032e860dc 00007fd032e85392 00007fd02ce4348c 00007fd02ce428c6
0709 13:03:25.060509 (+12412168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:24.989866 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:24.990412 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:24.990464 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:03:24.990489 (+    25us) tablet.cc:662] Decoding operations
0709 13:03:24.990962 (+   473us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:24.991034 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:24.991065 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:24.991409 (+   344us) tablet.cc:701] Row locks acquired
0709 13:03:24.991439 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:03:24.991635 (+   196us) write_op.cc:270] Start()
0709 13:03:24.991758 (+   123us) write_op.cc:276] Timestamp: P: 1783602204991579 usec, L: 0
0709 13:03:24.991780 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:03:24.992505 (+   725us) log.cc:844] Serialized 929 byte log entry
0709 13:03:24.994763 (+  2258us) op_driver.cc:464] REPLICATION: finished
0709 13:03:24.995275 (+   512us) write_op.cc:301] APPLY: starting
0709 13:03:24.995364 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:24.996855 (+  1491us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:24.996950 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:24.998402 (+  1452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:24.998631 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 13:03:24.998697 (+    66us) write_op.cc:312] APPLY: finished
0709 13:03:25.000517 (+  1820us) log.cc:844] Serialized 33 byte log entry
0709 13:03:25.000690 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.000782 (+    92us) write_op.cc:454] Released schema lock
0709 13:03:25.000828 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:25.001173 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.001204 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":107978,"reported_tablets":53,"spinlock_wait_cycles":235443072,"child_traces":[["op",{"apply.queue_time_us":270,"apply.run_cpu_time_us":4382,"apply.run_wall_time_us":5866,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8352,"num_ops":2,"prepare.queue_time_us":1913,"prepare.run_cpu_time_us":2934,"prepare.run_wall_time_us":2934,"replication_time_us":2837}]]}
I20260709 13:03:25.101783  1435 catalog_manager.cc:5697] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.103466  1435 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.104888  1435 catalog_manager.cc:5697] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 12 to 16, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.110074  1435 catalog_manager.cc:5697] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.113022  1435 catalog_manager.cc:5697] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.114463  1435 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.116956  1435 catalog_manager.cc:5697] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 13, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.129981  1435 catalog_manager.cc:5697] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.132627  1435 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 14 to 16, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 16 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.144896  1435 catalog_manager.cc:5697] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 7 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.146346  1435 catalog_manager.cc:5697] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.149664  1435 catalog_manager.cc:5697] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.151250  1435 catalog_manager.cc:5697] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.152464  1435 catalog_manager.cc:5697] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.153872  1435 catalog_manager.cc:5697] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.155601  1435 catalog_manager.cc:5697] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.157322  1435 catalog_manager.cc:5697] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 12 to 13, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.158484  1435 catalog_manager.cc:5697] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.159610  1435 catalog_manager.cc:5697] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.161180  1435 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 12 to 13, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.162348  1435 catalog_manager.cc:5697] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 10 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.164150  1435 catalog_manager.cc:5697] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 9 to 10, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:25.265244   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:25.336073  1609 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:25.340975  6752 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:25.349962  1689 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:25.352272  7032 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:25.371784  1538 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:03:25.389624  1435 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48032 (request call id 181) took 3049 ms. Trace:
I20260709 13:03:25.390076  1435 rpcz_store.cc:276] 0709 13:03:22.340971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.342496 (+  1525us) service_pool.cc:224] Handling call
0709 13:03:25.389550 (+3047054us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:25.171399 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:25.171894 (+   495us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:25.171926 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:03:25.171939 (+    13us) tablet.cc:662] Decoding operations
0709 13:03:25.173585 (+  1646us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:25.173635 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:25.173665 (+    30us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:03:25.175541 (+  1876us) tablet.cc:701] Row locks acquired
0709 13:03:25.175555 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:03:25.175700 (+   145us) write_op.cc:270] Start()
0709 13:03:25.175816 (+   116us) write_op.cc:276] Timestamp: P: 1783602205175653 usec, L: 0
0709 13:03:25.175833 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:03:25.176515 (+   682us) log.cc:844] Serialized 9850 byte log entry
0709 13:03:25.179354 (+  2839us) op_driver.cc:464] REPLICATION: finished
0709 13:03:25.179796 (+   442us) write_op.cc:301] APPLY: starting
0709 13:03:25.179869 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:25.199370 (+ 19501us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:25.199456 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:25.278298 (+ 78842us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:25.278628 (+   330us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=0,mrs_lookups=0
0709 13:03:25.278672 (+    44us) write_op.cc:312] APPLY: finished
0709 13:03:25.281690 (+  3018us) log.cc:844] Serialized 220 byte log entry
0709 13:03:25.281894 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.282096 (+   202us) write_op.cc:454] Released schema lock
0709 13:03:25.282158 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:25.282507 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:25.282532 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13868,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":252,"apply.run_cpu_time_us":30034,"apply.run_wall_time_us":102667,"cfile_cache_hit":100,"cfile_cache_hit_bytes":104400,"num_ops":25,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":5396,"prepare.run_wall_time_us":28800,"replication_time_us":3406}]]}
I20260709 13:03:25.382673  1439 catalog_manager.cc:5697] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.397083  1439 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 15 to 16, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.398679  1439 catalog_manager.cc:5697] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.400132  1439 catalog_manager.cc:5697] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.403638  1439 catalog_manager.cc:5697] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.415499  1439 catalog_manager.cc:5697] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.417898  7032 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:25.417568  1439 catalog_manager.cc:5697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 11 to 14, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.426903  1439 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } }
I20260709 13:03:25.454660  2367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d"
dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:43384
I20260709 13:03:25.455502  2367 raft_consensus.cc:606] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:25.481536  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:25.482223  1689 raft_consensus.cc:606] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:25.485221  1689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:25.485836  1689 raft_consensus.cc:606] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:25.486179  1689 raft_consensus.cc:614] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:25.495246  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b07448991374497e87b5636471d14890"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:25.495875  1688 raft_consensus.cc:606] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:25.498643  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba63305badaf4879aab6ec160417462c"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:25.499218  1688 raft_consensus.cc:606] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:25.500490   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:25.508472   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:25.517505  2367 consensus_queue.cc:237] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:25.537269  1688 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:03:25.540127  7059 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:25.540670  1613 raft_consensus.cc:1275] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:03:25.553614  7032 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEADER]: Committing config change with OpId 13.13: config changed from index 10 to 13, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:25.557576  1688 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 10 to 13, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:25.564116  6867 raft_consensus.cc:993] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:25.564872  6453 raft_consensus.cc:1081] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:25.567174  1536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b07448991374497e87b5636471d14890"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:03:25.567833  1536 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.568289  1536 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:25.569022  7059 consensus_queue.cc:1048] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:25.585456  1536 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:25.588846  1613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:25.589103  1536 leader_election.cc:290] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 19 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:25.589459  1613 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:25.598435  1613 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 19.
I20260709 13:03:25.600028  1505 leader_election.cc:304] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:25.604180  6920 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:03:25.604928  6920 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 19 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:25.605823  6920 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:25.614722  1612 raft_consensus.cc:2955] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Committing config change with OpId 13.13: config changed from index 10 to 13, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:25.631222  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:25.631867  1685 raft_consensus.cc:3055] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:03:25.632169  1685 raft_consensus.cc:740] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:25.632932  1685 consensus_queue.cc:260] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:25.634097  1685 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:03:25.643374  6752 raft_consensus.cc:993] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: : Instructing follower e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:25.643877  6752 raft_consensus.cc:1081] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Signalling peer e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:25.650825  1609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:57944
I20260709 13:03:25.651535  1609 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.651911  1609 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:25.654301  1685 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 19.
I20260709 13:03:25.686491  6780 raft_consensus.cc:993] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:25.687036  6780 raft_consensus.cc:1081] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:25.688783  1538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba63305badaf4879aab6ec160417462c"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:03:25.689368  1538 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.689697  1538 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:25.701409  1433 catalog_manager.cc:5697] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 10 to 13, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 13 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:25.721295  1538 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:25.722398  1609 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:25.736219  1423 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8464531709643ab8a8fd947089037ef with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:25.779321  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:25.779989  2367 raft_consensus.cc:3055] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:03:25.780332  2367 raft_consensus.cc:740] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:25.781143  2367 consensus_queue.cc:260] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:25.782124  2367 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:03:25.782151  7031 consensus_queue.cc:1175] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" responder_term: 9 status { last_received { term: 9 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 8 } }
I20260709 13:03:25.784560  1609 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:25.791435  2367 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:03:25.797178  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:25.832423  1689 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:03:25.796937  1439 catalog_manager.cc:5697] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 18 to 19, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:25.798348  1423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 62162.5us
I20260709 13:03:25.800472  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet f8464531709643ab8a8fd947089037ef with delete_type TABLET_DATA_TOMBSTONED (TS c98c328741aa493d87abafbf08f04944 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:57272
I20260709 13:03:25.804173  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:25.813446  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:25.838887  1685 raft_consensus.cc:3055] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:25.839296  1685 raft_consensus.cc:740] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:25.840102  1685 consensus_queue.cc:260] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:25.841373  1685 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:25.847072  1689 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
I20260709 13:03:25.821395  1538 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:25.849128  1579 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:25.865152  6806 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:03:25.866012  6806 raft_consensus.cc:697] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:25.867040  6806 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:25.869172  6780 raft_consensus.cc:993] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:25.869763  6780 raft_consensus.cc:1081] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:25.872777  1537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:03:25.873399  1537 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:25.873772  1537 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:25.849140  1609 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:25.886137  1685 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:25.889772  1504 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:25.891049  6920 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:25.891861  6920 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:25.892886  6920 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:25.902882  1433 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 9 to 10, leader changed from 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 10 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.907011  1609 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:25.919724  7063 tablet_replica.cc:333] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:25.955181  1433 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 13 to 14, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:25.918282  1537 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:26.035413  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:26.036295  1689 raft_consensus.cc:3055] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:26.036723  1689 raft_consensus.cc:740] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:26.037647  1689 consensus_queue.cc:260] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:26.038973  1689 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.050079  1689 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:26.063704  7063 raft_consensus.cc:2243] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:26.064703  7063 raft_consensus.cc:2272] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:26.068385  1537 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:26.071231  2367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:26.071898  2367 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:26.080490  2367 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 14.
I20260709 13:03:26.069990  7063 ts_tablet_manager.cc:1916] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:26.082811  1504 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944; no voters: 
I20260709 13:03:26.094282  6750 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:26.095101  6750 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:26.101329  1689 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 19 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:03:26.102872  6951 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:26.110003  6750 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:26.145066  1609 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 19 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:03:26.232820  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 67833.3us
I20260709 13:03:26.232506  1433 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 13 to 14, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:26.233748  6951 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:03:26.310534  1689 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:26.307256  7063 ts_tablet_manager.cc:1929] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.12
I20260709 13:03:26.325397  7029 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:26.340461  7063 log.cc:1199] T f8464531709643ab8a8fd947089037ef P c98c328741aa493d87abafbf08f04944: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/wals/f8464531709643ab8a8fd947089037ef
I20260709 13:03:26.348310  1612 consensus_queue.cc:237] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:03:26.359764  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 82533.4us
I20260709 13:03:26.377772  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet f8464531709643ab8a8fd947089037ef (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:26.381512  1689 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:26.385823  6806 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:26.409240  1610 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:26.413767  7073 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:03:26.447054  1579 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab24966f65364407bb1fe4072a40c0df. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:26.449008  1688 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:26.449414  2367 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:03:26.451179  7053 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:26.453457  7053 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:26.468415  1537 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:03:26.470325  6806 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:26.480382  6806 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:26.496337  1688 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:26.511288   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:26.560420  1439 catalog_manager.cc:5697] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 6, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:26.584717  1538 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:26.649923  2362 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:26.658805  7072 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:26.711660  1538 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:26.716403  1688 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:03:26.718307  7072 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:26.775377  1683 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:26.775849  1610 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:26.778160  7029 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:26.780227  6951 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:03:26.781734  1504 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 145197b092764852a509770daae94107. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:26.837141  7067 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:26.837718  1612 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:26.853358  1688 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:26.889415  1433 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index -1 to 11, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:26.940907  1688 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:26.951800  1612 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:26.957720  6867 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:03:26.961731  1653 consensus_peers.cc:597] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 70e893ad27ae41db934ba22b14642022. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:26.966017  1536 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:26.968540  6780 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:27.021126  6867 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:27.024148  1536 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:27.019961  7102 ts_tablet_manager.cc:933] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:27.048362  1538 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:27.062039  1439 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 8, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:27.067390  1609 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:27.165316  1612 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:27.167112  7066 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:27.167352  7102 tablet_copy_client.cc:323] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:03:27.183055  1625 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet ab24966f65364407bb1fe4072a40c0df from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:03:27.183786  1625 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet ab24966f65364407bb1fe4072a40c0df from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-ab24966f65364407bb1fe4072a40c0df
I20260709 13:03:27.190845  1688 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:27.196627  7066 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:27.197909  1625 tablet_copy_source_session.cc:215] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:03:27.198014  1504 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23137a56fb91492eb22faa7c97ee9aec. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:27.210979  7102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab24966f65364407bb1fe4072a40c0df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:27.221835  7066 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:27.227083  1688 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:27.227396  1612 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:27.245900  1433 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 7, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 11 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:27.287091  7102 tablet_copy_client.cc:806] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:27.287863  7102 tablet_copy_client.cc:670] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:27.294597  7102 tablet_copy_client.cc:538] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:27.324620  7102 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:27.427114  7108 ts_tablet_manager.cc:933] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:03:27.435695  7102 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:27.436813  7102 tablet_bootstrap.cc:492] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:03:27.451257  7102 ts_tablet_manager.cc:1403] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.127s	user 0.036s	sys 0.000s
I20260709 13:03:27.497258  7108 tablet_copy_client.cc:323] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:35051
I20260709 13:03:27.500142  1551 tablet_copy_service.cc:140] P c98c328741aa493d87abafbf08f04944: Received BeginTabletCopySession request for tablet 145197b092764852a509770daae94107 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:34908)
I20260709 13:03:27.500893  1551 tablet_copy_service.cc:161] P c98c328741aa493d87abafbf08f04944: Beginning new tablet copy session on tablet 145197b092764852a509770daae94107 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:34908: session id = 9d926c10b90f452ba52d80dab6a50351-145197b092764852a509770daae94107
I20260709 13:03:27.516474  7102 raft_consensus.cc:359] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:27.517486  7102 raft_consensus.cc:740] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:27.518035  7102 consensus_queue.cc:260] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:27.530565  7102 ts_tablet_manager.cc:1434] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 13:03:27.531708  7110 ts_tablet_manager.cc:933] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:27.527307  1551 tablet_copy_source_session.cc:215] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:27.541210  7108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145197b092764852a509770daae94107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:27.541397  1625 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-ab24966f65364407bb1fe4072a40c0df received from {username='slave'} at 127.0.0.1:57944
I20260709 13:03:27.542384  1625 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-ab24966f65364407bb1fe4072a40c0df on tablet ab24966f65364407bb1fe4072a40c0df with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:27.561986  7110 tablet_copy_client.cc:323] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:03:27.575539  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet 70e893ad27ae41db934ba22b14642022 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:03:27.576145  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet 70e893ad27ae41db934ba22b14642022 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-70e893ad27ae41db934ba22b14642022
I20260709 13:03:27.587450  1700 tablet_copy_source_session.cc:215] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:27.591503  7110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70e893ad27ae41db934ba22b14642022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:27.608438   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:27.666616  7110 tablet_copy_client.cc:806] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:27.667709  7110 tablet_copy_client.cc:670] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:27.676349  7110 tablet_copy_client.cc:538] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:27.692165  7108 tablet_copy_client.cc:806] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:27.692998  7108 tablet_copy_client.cc:670] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:27.704185  7108 tablet_copy_client.cc:538] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:27.708246  7110 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:27.727370  7108 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:27.735867  7102 ts_tablet_manager.cc:933] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:03:27.761561  7102 tablet_copy_client.cc:323] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:35051
I20260709 13:03:27.763832  1551 tablet_copy_service.cc:140] P c98c328741aa493d87abafbf08f04944: Received BeginTabletCopySession request for tablet 23137a56fb91492eb22faa7c97ee9aec from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:34908)
I20260709 13:03:27.765009  1551 tablet_copy_service.cc:161] P c98c328741aa493d87abafbf08f04944: Beginning new tablet copy session on tablet 23137a56fb91492eb22faa7c97ee9aec from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:34908: session id = 9d926c10b90f452ba52d80dab6a50351-23137a56fb91492eb22faa7c97ee9aec
I20260709 13:03:27.805207  1551 tablet_copy_source_session.cc:215] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:27.809845  7102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23137a56fb91492eb22faa7c97ee9aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:27.885030  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:27.885979  1688 raft_consensus.cc:606] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:27.901970  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70e893ad27ae41db934ba22b14642022"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:27.902588  1688 raft_consensus.cc:606] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:27.905197  1688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94b39a427ff64e86af918d4b96740100"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:27.905732  1688 raft_consensus.cc:606] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Received request to transfer leadership to TS c98c328741aa493d87abafbf08f04944
I20260709 13:03:27.909106  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:27.909647  1683 raft_consensus.cc:606] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:27.913659  1683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798"
dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
mode: GRACEFUL
new_leader_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:60148
I20260709 13:03:27.914247  1683 raft_consensus.cc:606] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Received request to transfer leadership to TS e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:27.916306   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:27.923620   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:27.926504  6867 raft_consensus.cc:993] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:27.927183  6780 raft_consensus.cc:1081] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Signalling peer c98c328741aa493d87abafbf08f04944 to start an election
I20260709 13:03:27.932533  1537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94b39a427ff64e86af918d4b96740100"
dest_uuid: "c98c328741aa493d87abafbf08f04944"
 from {username='slave'} at 127.0.0.1:37906
I20260709 13:03:27.933101  1537 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:27.933385  6867 raft_consensus.cc:993] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:27.934016  7077 raft_consensus.cc:1081] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Signalling peer e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:27.933444  1537 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.937009  1612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:03:27.937722  1612 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:27.938107  1612 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.946090  1612 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:27.949640  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:27.950275  1683 raft_consensus.cc:3055] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:27.950623  1683 raft_consensus.cc:740] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:27.951500  2362 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:27.952198  2362 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.943746  1537 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:27.951463  1683 consensus_queue.cc:260] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:27.954478  1537 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:27.955184  1609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:27.955767  1609 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.959967  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:27.960408  2362 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:27.960768  1688 raft_consensus.cc:3055] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:03:27.961217  1688 raft_consensus.cc:740] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:27.961762  1579 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:27.962085  1688 consensus_queue.cc:260] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:27.962821  6806 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:27.963369  6806 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:27.963657  1688 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:27.964323  6806 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:27.965839  1612 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:27.963383  1609 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:27.954025  1683 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:27.975361  7102 tablet_copy_client.cc:806] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:27.979907  7110 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:27.985767  1505 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:28.000337  7029 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:28.003491  7029 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 13 LEADER]: Becoming Leader. State: Replica: c98c328741aa493d87abafbf08f04944, State: Running, Role: LEADER
I20260709 13:03:28.004426  7029 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:28.019348  1688 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c98c328741aa493d87abafbf08f04944 in term 13.
I20260709 13:03:28.021822  7110 tablet_bootstrap.cc:492] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:03:28.023083  7110 ts_tablet_manager.cc:1403] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.315s	user 0.030s	sys 0.021s
I20260709 13:03:28.002287  7102 tablet_copy_client.cc:670] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:28.036540  6867 raft_consensus.cc:993] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:28.037231  6867 raft_consensus.cc:1081] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Signalling peer e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:28.035722  7110 raft_consensus.cc:359] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:28.039330  7110 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:28.041675  1612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:03:28.044767  1612 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:28.045454  1612 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.075714  1612 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:28.070603  7102 tablet_copy_client.cc:538] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:28.096462  1683 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:28.157583  1433 catalog_manager.cc:5697] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 reported cstate change: term changed from 12 to 13, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to c98c328741aa493d87abafbf08f04944 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.072160  7110 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:28.162993  1612 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:28.167999  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:28.168803  1537 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.238687  1537 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:28.242228  6867 raft_consensus.cc:993] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:28.242226  1439 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 11 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.252898  6780 raft_consensus.cc:1081] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Signalling peer e8eefefed88a4903b423e9f487c4805a to start an election
W20260709 13:03:28.254346  7108 log.cc:927] Time spent T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.095s	user 0.003s	sys 0.000s
I20260709 13:03:28.264472  1612 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70e893ad27ae41db934ba22b14642022"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:03:28.271958  1612 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:28.272807  1612 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:03:28.277848  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 162532us
I20260709 13:03:28.279690  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:28.280283  1683 raft_consensus.cc:3055] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:28.280578  1683 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:28.287240  1683 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:28.315227  7118 log.cc:927] Time spent T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:03:28.318940  1683 raft_consensus.cc:3060] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.332688  7102 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:28.345937  1683 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:28.358510  6780 raft_consensus.cc:993] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: : Instructing follower e8eefefed88a4903b423e9f487c4805a to start an election
I20260709 13:03:28.359100  6780 raft_consensus.cc:1081] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Signalling peer e8eefefed88a4903b423e9f487c4805a to start an election
W20260709 13:03:28.372193  1505 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 136631us
I20260709 13:03:28.374187  1580 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a; no voters: 
I20260709 13:03:28.385483  1612 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:28.399827  1609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa"
dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
 from {username='slave'} at 127.0.0.1:57548
I20260709 13:03:28.400760  1609 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:28.401226  1609 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.419454  1612 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:28.412166  7122 raft_consensus.cc:2804] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:28.434185  1609 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:28.442973  1609 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:28.447610  2362 raft_consensus.cc:1217] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 13:03:28.447026  7122 raft_consensus.cc:697] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:28.457993  7122 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:28.460625  7110 ts_tablet_manager.cc:1434] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.437s	user 0.012s	sys 0.017s
W20260709 13:03:28.470017  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 177407us
I20260709 13:03:28.477893  2362 raft_consensus.cc:1217] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:03:28.479847  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:28.480722  1687 raft_consensus.cc:3055] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:03:28.480949  1689 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:28.481083  1687 raft_consensus.cc:740] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:28.482795  2362 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:28.482054  1687 consensus_queue.cc:260] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:28.488734  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-70e893ad27ae41db934ba22b14642022 received from {username='slave'} at 127.0.0.1:35722
I20260709 13:03:28.489187  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-70e893ad27ae41db934ba22b14642022 on tablet 70e893ad27ae41db934ba22b14642022 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:28.480712  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: true dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:28.489886  1690 raft_consensus.cc:3055] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:03:28.491999  1690 raft_consensus.cc:740] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:28.492923  1690 consensus_queue.cc:260] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:28.494217  1690 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.489343  1687 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.496752  7124 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:28.522161  1690 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:28.528544  1537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:28.529527  1537 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:28.532299  1687 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:28.539845  7108 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:28.541599  7108 tablet_bootstrap.cc:492] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:03:28.542940  7108 ts_tablet_manager.cc:1403] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.816s	user 0.053s	sys 0.025s
I20260709 13:03:28.543941  1579 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:28.543771  7135 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:03:28.548399  1540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c22d7a035bc946478a44cde26ad56efa" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: true dest_uuid: "c98c328741aa493d87abafbf08f04944"
I20260709 13:03:28.549204  1540 raft_consensus.cc:3060] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:28.567476  1540 raft_consensus.cc:2468] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:28.583905  7124 raft_consensus.cc:2804] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:28.579485  1537 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:28.589226  7124 raft_consensus.cc:697] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:28.603271  1690 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:28.585237  1579 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:28.609217  7135 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:28.609807  7135 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:28.610785  7135 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:28.628671  1609 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:28.612066  7124 consensus_queue.cc:237] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:28.627485  7141 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:03:28.649887  6951 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:03:28.744837  7108 raft_consensus.cc:359] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:28.745975  7108 raft_consensus.cc:740] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:28.746779  7108 consensus_queue.cc:260] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:28.807804  7108 ts_tablet_manager.cc:1434] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.264s	user 0.008s	sys 0.003s
I20260709 13:03:28.811699  1551 tablet_copy_service.cc:342] P c98c328741aa493d87abafbf08f04944: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-145197b092764852a509770daae94107 received from {username='slave'} at 127.0.0.1:34908
I20260709 13:03:28.812390  1551 tablet_copy_service.cc:434] P c98c328741aa493d87abafbf08f04944: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-145197b092764852a509770daae94107 on tablet 145197b092764852a509770daae94107 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:28.908078  7120 raft_consensus.cc:1064] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:03:28.911051  7120 consensus_queue.cc:237] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:28.934305  7102 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=2 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:28.937942   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:28.939831  7102 tablet_bootstrap.cc:492] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:03:28.940812  7102 ts_tablet_manager.cc:1403] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.608s	user 0.040s	sys 0.004s
I20260709 13:03:28.947875  1687 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:28.950171  7124 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:28.966123  1540 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:28.970863  2370 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:28.973704  7136 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:28.974779  7124 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:28.981091  1439 catalog_manager.cc:5697] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 11 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.982918  1439 catalog_manager.cc:5697] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 11 to 12, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:28.984474  1685 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:03:28.988670  1439 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 13 to 14, leader changed from f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 14 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:29.000454  7131 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:03:29.088027  1537 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:03:29.092640  7102 raft_consensus.cc:359] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:29.126574  7102 raft_consensus.cc:740] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:29.127549  7102 consensus_queue.cc:260] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:29.148263  7120 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:29.170552  7102 ts_tablet_manager.cc:1434] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.229s	user 0.010s	sys 0.000s
I20260709 13:03:29.196977  1551 tablet_copy_service.cc:342] P c98c328741aa493d87abafbf08f04944: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-23137a56fb91492eb22faa7c97ee9aec received from {username='slave'} at 127.0.0.1:34908
I20260709 13:03:29.197552  1551 tablet_copy_service.cc:434] P c98c328741aa493d87abafbf08f04944: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-23137a56fb91492eb22faa7c97ee9aec on tablet 23137a56fb91492eb22faa7c97ee9aec with peer 9d926c10b90f452ba52d80dab6a50351
W20260709 13:03:29.206004  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 66885.8us
I20260709 13:03:29.208695  2367 raft_consensus.cc:1217] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.10->[16.11-16.11]   Dedup: 16.11->[]
I20260709 13:03:29.290190  2363 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEARNER]: Advancing to term 14
W20260709 13:03:29.299269  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 73926.1us
I20260709 13:03:29.302855  1687 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:29.307386  7124 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:29.321424  1683 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:03:29.332283  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 79194.7us
I20260709 13:03:29.356810  2367 raft_consensus.cc:1217] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.6->[11.7-11.7]   Dedup: 11.7->[]
W20260709 13:03:29.369024  7161 log.cc:927] Time spent T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:03:29.340677  7124 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:03:29.377345  7120 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:29.365381  2363 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:29.385237  2370 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:29.411861  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 52634.3us
I20260709 13:03:29.409081  7124 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:03:29.440330  1538 raft_consensus.cc:1275] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:03:29.472118  1685 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:29.495740  1434 catalog_manager.cc:5697] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index 6 to 7, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:29.572372  7124 raft_consensus.cc:1064] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:03:29.588454  1537 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:29.576655  7124 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:29.578720  1534 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:29.619841  7135 consensus_queue.cc:1048] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:29.643651  1610 consensus_queue.cc:237] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:29.710354  2367 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:29.726936  7066 raft_consensus.cc:1064] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:03:29.735154  1534 raft_consensus.cc:1275] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:29.740849  7122 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:29.756789  7122 consensus_queue.cc:1048] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:29.760183  7066 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:29.762815  7135 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:29.788257  1689 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:29.785020  1535 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:29.788236  2370 raft_consensus.cc:2955] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:29.800343  2367 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:29.802810  1689 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:29.804579  7123 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:29.809710  1610 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:29.808307  7168 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:03:29.846537  2363 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:29.876911  7173 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:29.830125  7141 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:03:29.882329  7165 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:29.892340  1538 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:03:29.926113  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab24966f65364407bb1fe4072a40c0df with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:29.949132  1435 catalog_manager.cc:5697] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 7 to 8, VOTER f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195) evicted. New cstate: current_term: 7 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:29.928015  7136 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:03:29.968528  7123 raft_consensus.cc:1064] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:03:29.997548  7168 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 8 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.001932  2370 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 8 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.026849  1673 tablet_service.cc:1558] Processing DeleteTablet for tablet ab24966f65364407bb1fe4072a40c0df with delete_type TABLET_DATA_TOMBSTONED (TS f6eecf73c1c24b5eb268b5088a3030d4 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:51746
I20260709 13:03:30.031697  1683 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 8 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.040393  7170 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.052804  1687 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.060774  1435 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 8 to 10, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.090467  2370 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:30.146597  7171 log.cc:927] Time spent T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:03:30.179095  7123 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:30.234401  1612 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:30.241083  1439 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.265882  1610 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.291607  7188 tablet_replica.cc:333] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
W20260709 13:03:30.311334  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 170681us
W20260709 13:03:30.313699  1504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 172874us
I20260709 13:03:30.336902   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:30.381356  1689 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:30.383882  7168 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:30.392755  2370 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:03:30.363154  1534 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:30.400354  7124 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.404424  7188 raft_consensus.cc:2243] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.405449  7188 raft_consensus.cc:2272] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.405762  7168 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:30.409518  1613 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:30.413062  7170 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:03:30.425199  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 78348.6us
I20260709 13:03:30.433617  1689 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.453369  2370 raft_consensus.cc:2955] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.488246  7188 ts_tablet_manager.cc:1916] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:30.542362  1433 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 10 to 11, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 14 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.551163  2363 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEARNER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:30.556180  1689 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:03:30.576797  2370 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:30.579690  1689 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:03:30.586812  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 70e893ad27ae41db934ba22b14642022 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:30.589969  1522 tablet_service.cc:1558] Processing DeleteTablet for tablet 70e893ad27ae41db934ba22b14642022 with delete_type TABLET_DATA_TOMBSTONED (TS c98c328741aa493d87abafbf08f04944 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:57272
I20260709 13:03:30.625284  6951 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:30.629968  7137 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:30.632234  7066 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:30.632673  7189 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:03:30.644548   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:03:30.650954   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:30.657657  7199 tablet_replica.cc:333] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:30.659439  7199 raft_consensus.cc:2243] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:30.675379  7188 ts_tablet_manager.cc:1929] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:03:30.675938  7188 log.cc:1199] T ab24966f65364407bb1fe4072a40c0df P f6eecf73c1c24b5eb268b5088a3030d4: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-2-root/wals/ab24966f65364407bb1fe4072a40c0df
I20260709 13:03:30.685917  7199 pending_rounds.cc:70] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Trying to abort 1 pending ops.
I20260709 13:03:30.712162  1689 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.722368  2370 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.686338  7199 pending_rounds.cc:77] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Aborting op as it isn't in flight: id { term: 14 index: 10 } timestamp: 7305634650415452160 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "70e893ad27ae41db934ba22b14642022" old_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } } new_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } } }
I20260709 13:03:30.728019  7199 raft_consensus.cc:2917] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Aborting config change with OpId 14.10: Aborted: Op aborted
I20260709 13:03:30.728228  1423 catalog_manager.cc:5028] TS f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): tablet ab24966f65364407bb1fe4072a40c0df (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:30.728560  7199 raft_consensus.cc:2889] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:03:30.729050  7199 raft_consensus.cc:2272] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:30.668273  7137 raft_consensus.cc:2955] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.777524  1439 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 12 to 13, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 16 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.777947  1683 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.786051  7162 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.819767  2370 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:30.800809  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet 145197b092764852a509770daae94107 with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:48524
I20260709 13:03:30.799928  7199 ts_tablet_manager.cc:1916] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:30.830914  1433 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 7 to 8, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:31.009969  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 145197b092764852a509770daae94107 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:31.012815  7202 tablet_replica.cc:333] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:31.016331  1607 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:31.038686  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 45078.1us
I20260709 13:03:31.039740  7199 ts_tablet_manager.cc:1929] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:03:31.040283  7199 log.cc:1199] T 70e893ad27ae41db934ba22b14642022 P c98c328741aa493d87abafbf08f04944: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-0-root/wals/70e893ad27ae41db934ba22b14642022
I20260709 13:03:31.047446  1424 catalog_manager.cc:5028] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): tablet 70e893ad27ae41db934ba22b14642022 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:31.079562  7202 raft_consensus.cc:2243] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.080700  7202 raft_consensus.cc:2272] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.095276  7202 ts_tablet_manager.cc:1916] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:31.158020  1534 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:31.178179  2370 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:31.183794  1690 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer c98c328741aa493d87abafbf08f04944: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:03:31.183954  7169 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:03:31.193403  7162 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:31.234280  6951 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:31.257861  2370 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:31.264200  1690 raft_consensus.cc:2955] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:31.283285  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 23137a56fb91492eb22faa7c97ee9aec with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:31.295025  1433 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 8 to 9, VOTER e8eefefed88a4903b423e9f487c4805a (127.0.107.194) evicted. New cstate: current_term: 11 leader_uuid: "c98c328741aa493d87abafbf08f04944" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:31.317878  1598 tablet_service.cc:1558] Processing DeleteTablet for tablet 23137a56fb91492eb22faa7c97ee9aec with delete_type TABLET_DATA_TOMBSTONED (TS e8eefefed88a4903b423e9f487c4805a not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:48524
I20260709 13:03:31.356014  7202 ts_tablet_manager.cc:1929] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:03:31.356781  7202 log.cc:1199] T 145197b092764852a509770daae94107 P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/145197b092764852a509770daae94107
I20260709 13:03:31.360122  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet 145197b092764852a509770daae94107 (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:31.361462  7202 tablet_replica.cc:333] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:31.424113  7202 raft_consensus.cc:2243] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:31.425304  7202 raft_consensus.cc:2272] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:31.431969  7202 ts_tablet_manager.cc:1916] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:31.453655  7202 ts_tablet_manager.cc:1929] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:03:31.455693  7202 log.cc:1199] T 23137a56fb91492eb22faa7c97ee9aec P e8eefefed88a4903b423e9f487c4805a: Deleting WAL directory at /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602014598663-431-0/minicluster-data/ts-1-root/wals/23137a56fb91492eb22faa7c97ee9aec
I20260709 13:03:31.457823  1424 catalog_manager.cc:5028] TS e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): tablet 23137a56fb91492eb22faa7c97ee9aec (table test-workload [id=79c221387fd84597bd6c33ed2faa32ec]) successfully deleted
I20260709 13:03:31.652465   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:31.892470   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:31.919377  1654 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:03:31.965248  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45920us
W20260709 13:03:31.983464  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.990595  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.996753  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:31.999429  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.011125  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.019784  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.052425  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.051014  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 45769.3us
W20260709 13:03:32.056419  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.074555  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.183104  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.184405  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 47279.2us
W20260709 13:03:32.182971  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 55039.2us
W20260709 13:03:32.245272  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.243881  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.313946  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.318884  1580 consensus_peers.cc:597] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.370677  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.376521  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.378140  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.401927  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.422839  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.430132  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.430953  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.431598  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.439827  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.486512  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.490842  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.521461   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:32.524658   431 tablet_replica.cc:333] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.527278   431 raft_consensus.cc:2243] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.529390   431 raft_consensus.cc:2272] T 012a311e17a142298db5d9aa2a92c2f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.542008  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.543509   431 tablet_replica.cc:333] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.545765   431 raft_consensus.cc:2243] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:32.553838  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.557420  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.569473  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.570099  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.570618  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.571131  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.574486  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.577011   431 raft_consensus.cc:2272] T 23c94fd76da84decac35ba61e1d5cb3c P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:32.591538  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:32.592345  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.605013   431 tablet_replica.cc:333] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.606289   431 raft_consensus.cc:2243] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:32.612442  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.628451   431 raft_consensus.cc:2272] T d48f4ba9b7ac4684ba28c86536416e65 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.675935   431 tablet_replica.cc:333] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.677001   431 raft_consensus.cc:2243] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.695636   431 raft_consensus.cc:2272] T ba63305badaf4879aab6ec160417462c P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.716267   431 tablet_replica.cc:333] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.717725   431 raft_consensus.cc:2243] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.719094   431 raft_consensus.cc:2272] T 932266aa19544648a426ac5605e04ff8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.722429   431 tablet_replica.cc:333] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.745536   431 raft_consensus.cc:2243] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.756351   431 raft_consensus.cc:2272] T 03ff5e9bb5cd4c7590aecf8720904921 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.781147   431 tablet_replica.cc:333] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.783926   431 raft_consensus.cc:2243] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.791916   431 raft_consensus.cc:2272] T dbc0065dafc14741989730fd503966f0 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.804209   431 tablet_replica.cc:333] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.806653   431 raft_consensus.cc:2243] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.808295   431 raft_consensus.cc:2272] T e0872608ab1d42e5b8f77cd6552348b3 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.812064   431 tablet_replica.cc:333] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.813073   431 raft_consensus.cc:2243] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.827589   431 raft_consensus.cc:2272] T 1fe4d60be9064db2abedb55cb715c172 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.831259   431 tablet_replica.cc:333] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.832352   431 raft_consensus.cc:2243] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.833367   431 raft_consensus.cc:2272] T 91dad730840e45b68065507815614a40 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.846398   431 tablet_replica.cc:333] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.853129   431 raft_consensus.cc:2243] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.854606   431 raft_consensus.cc:2272] T 67e293fa644844dd93fd078b7ba39692 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.858639   431 tablet_replica.cc:333] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.859612   431 raft_consensus.cc:2243] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.875182   431 raft_consensus.cc:2272] T 94b39a427ff64e86af918d4b96740100 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.879230   431 tablet_replica.cc:333] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.880370   431 raft_consensus.cc:2243] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.881980   431 raft_consensus.cc:2272] T f09947f1336f47c4b5bffef2326f83ee P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.884853  1612 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:32.890743  6951 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:32.893478  6951 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:32.895542   431 tablet_replica.cc:333] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.897002   431 raft_consensus.cc:2243] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.907878   431 raft_consensus.cc:2272] T 71e3bb6ac3eb408ba9c57b48de886d65 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.912015   431 tablet_replica.cc:333] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.913388   431 raft_consensus.cc:2243] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.914665   431 raft_consensus.cc:2272] T fbf20d67081f4a66af2b6a3bb0145baf P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.918382   431 tablet_replica.cc:333] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.919466   431 raft_consensus.cc:2243] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.920324   431 raft_consensus.cc:2272] T 8967fd754a1f427d8138f7d6380b06c0 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.925225   431 tablet_replica.cc:333] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.926244   431 raft_consensus.cc:2243] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.927263   431 raft_consensus.cc:2272] T d3d04d35de654d5a8be688548f244d88 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.935352  6951 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:32.941310  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:32.944427   431 tablet_replica.cc:333] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.944737  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2543ffd0824f7ca2b1399af5f3b78d" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:32.945729   431 raft_consensus.cc:2243] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.946817   431 raft_consensus.cc:2272] T a8b7091c66f14b4ba944785e7c8873b9 P c98c328741aa493d87abafbf08f04944 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.950491   431 tablet_replica.cc:333] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.950603  1504 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:32.951614   431 raft_consensus.cc:2243] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:32.958091   431 raft_consensus.cc:2272] T 23137a56fb91492eb22faa7c97ee9aec P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.959247  6951 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:32.961203   431 tablet_replica.cc:333] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:32.962282  6951 raft_consensus.cc:493] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:32.962975  6951 raft_consensus.cc:515] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:32.966302  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:32.966943  1579 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 469f8c03f4924f809435141a09c976fa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:32.968772  1690 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:03:32.970750  7211 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:32.976541  7169 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:32.977160  7169 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:32.979403  7169 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:32.983672   431 raft_consensus.cc:2243] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:32.984894   431 raft_consensus.cc:2272] T 5c75c8e4f95149fba99bb9728c2f21d8 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:32.993381  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:32.995220  7066 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:32.995865  7066 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:32.997879  7066 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:32.996762  7131 raft_consensus.cc:2955] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.000989  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab24966f65364407bb1fe4072a40c0df" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.001380  7066 raft_consensus.cc:493] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:33.001706   431 tablet_replica.cc:333] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.002058  7066 raft_consensus.cc:515] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:33.001726  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.002770   431 raft_consensus.cc:2243] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.003988  7066 leader_election.cc:290] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.005333   431 raft_consensus.cc:2272] T 266184feaae1425bb1318e53e4b7d584 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.008971   431 tablet_replica.cc:333] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.009958   431 raft_consensus.cc:2243] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.010785  1505 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:33.011287   431 raft_consensus.cc:2272] T b07448991374497e87b5636471d14890 P c98c328741aa493d87abafbf08f04944 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.012837  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.012427  6951 leader_election.cc:290] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.014493  6951 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:33.024197  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2ec497bce574477bc2b2cc694aa0637" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.024753  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.028098  7169 raft_consensus.cc:493] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:33.028836  7169 raft_consensus.cc:515] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:33.031234  7169 leader_election.cc:290] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:33.034317  1504 leader_election.cc:304] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.035847  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f13a8325fe104b2582f097044dcef93c" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.036247  7169 raft_consensus.cc:2749] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:33.037467  1504 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.038704  1504 leader_election.cc:304] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.039458  6951 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:32.999787  1690 raft_consensus.cc:2955] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.044788  7169 raft_consensus.cc:493] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:33.047271  6951 raft_consensus.cc:493] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:33.050752  6951 raft_consensus.cc:515] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:33.052079  1607 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:33.053081  6951 leader_election.cc:290] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.045697  7169 raft_consensus.cc:515] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:33.057214  7169 leader_election.cc:290] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:33.063328  1434 catalog_manager.cc:5697] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index -1 to 8, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 13 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:33.078558  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.073177   431 tablet_replica.cc:333] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.075762  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84c11953e2154a45af2433ff69b8c3ca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.079921  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:33.076372  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f38d50e761f346b8b9b49b532d70e057" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.077836  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.079363  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "151c008abeca49c386849be63d874dca" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:33.086036  6951 raft_consensus.cc:2749] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:03:33.076560  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.087610  6951 raft_consensus.cc:493] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:33.088431  6951 raft_consensus.cc:515] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:33.089668  7066 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:33.090690  1504 leader_election.cc:304] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.091012  7066 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:33.091564  6951 leader_election.cc:290] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:33.083168   431 raft_consensus.cc:2243] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.092275  7169 raft_consensus.cc:2749] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.092923  7066 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:33.095757  7214 raft_consensus.cc:670] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:03:33.097795   431 raft_consensus.cc:2272] T 6d8196c0532243f8ba687a00d2857d80 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.100744  1504 leader_election.cc:304] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.101404  1505 leader_election.cc:304] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.102622  7066 raft_consensus.cc:2749] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:33.104802  7214 raft_consensus.cc:2749] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:33.106789  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.109223  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
W20260709 13:03:33.110126  1579 consensus_peers.cc:597] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3d04d35de654d5a8be688548f244d88. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.111002  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4fad2168ccb42729f2409fbb0a88116" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.111614  1689 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:03:33.115105  7131 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:33.120366  7217 raft_consensus.cc:493] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:33.128999  7217 raft_consensus.cc:515] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:33.127219   431 tablet_replica.cc:333] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944: stopping tablet replica
W20260709 13:03:33.128360  1580 consensus_peers.cc:597] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.133788   431 raft_consensus.cc:2243] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.134351  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.135267  7214 raft_consensus.cc:493] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:33.136405  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.137199  7214 raft_consensus.cc:515] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:33.132076  7217 leader_election.cc:290] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.139511   431 raft_consensus.cc:2272] T ab24966f65364407bb1fe4072a40c0df P c98c328741aa493d87abafbf08f04944 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.145717  7214 leader_election.cc:290] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:33.147368  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68971e7ff2b548529978ee5a5d55a724" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.148273  1504 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.151373   431 tablet_replica.cc:333] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.151801  1504 leader_election.cc:304] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.154973  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.153083  7131 raft_consensus.cc:2955] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 LEADER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.161914  7217 raft_consensus.cc:2749] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:03:33.156229   431 raft_consensus.cc:2243] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.165213   431 raft_consensus.cc:2272] T 84c11953e2154a45af2433ff69b8c3ca P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.155227  1689 raft_consensus.cc:2955] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Committing config change with OpId 16.10: config changed from index -1 to 10, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.166302  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c7a933e3e84bcfb3f8de277043f0ab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:33.153487  7214 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:33.176789   431 tablet_replica.cc:333] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.181169   431 raft_consensus.cc:2243] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.189390  1504 leader_election.cc:304] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.190578  7066 raft_consensus.cc:2706] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Received pre-election callback for term 16 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:03:33.192430  1504 leader_election.cc:304] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:33.191313  7214 raft_consensus.cc:493] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:33.194620  7066 raft_consensus.cc:2749] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:33.194450  7214 raft_consensus.cc:515] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:33.193488  1690 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:33.197234   431 raft_consensus.cc:2272] T 68971e7ff2b548529978ee5a5d55a724 P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.197464  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.201195  7214 leader_election.cc:290] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:33.202708  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752aab0c230943e5a7d35d3d2ff9e555" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:33.204682  7214 raft_consensus.cc:493] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:33.204793  1504 leader_election.cc:304] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:33.204821   431 tablet_replica.cc:333] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.206004  7217 raft_consensus.cc:2749] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:33.205706  7214 raft_consensus.cc:515] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:33.206926   431 raft_consensus.cc:2243] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.207580   431 raft_consensus.cc:2272] T 151c008abeca49c386849be63d874dca P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.212908   431 tablet_replica.cc:333] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.215140  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.219166   431 raft_consensus.cc:2243] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.219966   431 raft_consensus.cc:2272] T 7137e5b424304fc6a6513886dd9dc135 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.223038   431 tablet_replica.cc:333] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944: stopping tablet replica
W20260709 13:03:33.225908  1653 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8ff3d30394041dd91e5470bfd077bab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.233297   431 raft_consensus.cc:2243] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.234728  1616 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:33.236167   431 raft_consensus.cc:2272] T f13a8325fe104b2582f097044dcef93c P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.239203   431 tablet_replica.cc:333] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.240139   431 raft_consensus.cc:2243] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.245347  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fd446bc21be451c86d30ee76d6e6137" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:33.240674  7214 leader_election.cc:290] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:33.245797   431 raft_consensus.cc:2272] T f2157e4514164aedb7c5dc22acfb5ca6 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.249500   431 tablet_replica.cc:333] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.250324   431 raft_consensus.cc:2243] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.251530   431 raft_consensus.cc:2272] T 72c7a933e3e84bcfb3f8de277043f0ab P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.253584  1504 leader_election.cc:304] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:33.261597  7214 raft_consensus.cc:2749] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:33.268090   431 tablet_replica.cc:333] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.267812  7217 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:03:33.269239   431 raft_consensus.cc:2243] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.268972  7217 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:33.270135   431 raft_consensus.cc:2272] T f38d50e761f346b8b9b49b532d70e057 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.271569  7217 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.273226  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.274121  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.277988  1504 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.280738  7066 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:33.288203  7214 raft_consensus.cc:493] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:33.288878  7174 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:33.289047  7214 raft_consensus.cc:515] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:33.291441  7214 leader_election.cc:290] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:33.292660   431 tablet_replica.cc:333] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.300477  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.281170  7217 raft_consensus.cc:493] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9d926c10b90f452ba52d80dab6a50351)
I20260709 13:03:33.302273  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08378fd70b734734992a8174ab0ecfc8" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:33.302948  7217 raft_consensus.cc:515] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:33.300925   431 raft_consensus.cc:2243] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.305763  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.308152   431 raft_consensus.cc:2272] T c22d7a035bc946478a44cde26ad56efa P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:33.313227  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.307044  1504 leader_election.cc:304] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.316857  7214 raft_consensus.cc:2749] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:33.316901  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "423e376b43454bf396ca57e6aad172f5" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:33.319438  7217 leader_election.cc:290] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:33.321139   431 tablet_replica.cc:333] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.322098   431 raft_consensus.cc:2243] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.323449   431 raft_consensus.cc:2272] T 788938c376a646979b8eee973560dc65 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.326107  1504 leader_election.cc:304] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:33.334452  7217 raft_consensus.cc:2749] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:33.336517  7217 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:33.343793  7217 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:33.346042  7217 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.346254  7174 raft_consensus.cc:2955] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.356904  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.358705  1607 raft_consensus.cc:2955] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.365473  1434 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 10, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 16 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.376914  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8ff3d30394041dd91e5470bfd077bab" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.378850  7217 raft_consensus.cc:493] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:33.379498  7217 raft_consensus.cc:515] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:33.382012  7217 leader_election.cc:290] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.382764  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:33.355003   431 tablet_replica.cc:333] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.385880  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ead97901a6414b8541e2d33f5078ac" candidate_uuid: "c98c328741aa493d87abafbf08f04944" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:33.387614  1504 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.388441  7217 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:03:33.388880  1504 leader_election.cc:304] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c98c328741aa493d87abafbf08f04944; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.389626  7217 raft_consensus.cc:2749] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:03:33.386718   431 raft_consensus.cc:2243] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.391160   431 raft_consensus.cc:2272] T 4fd446bc21be451c86d30ee76d6e6137 P c98c328741aa493d87abafbf08f04944 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.409245  1439 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index -1 to 11, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.419654   431 tablet_replica.cc:333] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.422174   431 raft_consensus.cc:2243] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.424719   431 raft_consensus.cc:2272] T 752aab0c230943e5a7d35d3d2ff9e555 P c98c328741aa493d87abafbf08f04944 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.438525  1612 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:33.443838   431 tablet_replica.cc:333] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.444905   431 raft_consensus.cc:2243] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.461953   431 raft_consensus.cc:2272] T a8ff3d30394041dd91e5470bfd077bab P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:33.465318  1579 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365): Couldn't send request to peer 9d926c10b90f452ba52d80dab6a50351. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e0015d06d436447fb3ebe76172dc1798. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.465838   431 tablet_replica.cc:333] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.466913   431 raft_consensus.cc:2243] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.470433  1689 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:33.472191  7205 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:03:33.473812   431 raft_consensus.cc:2272] T 90b90f8e722a4f1ebab12217cf2171e1 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.482056   431 tablet_replica.cc:333] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
W20260709 13:03:33.502743  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:33.506809   431 raft_consensus.cc:2243] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.511621   431 raft_consensus.cc:2272] T 12cfcd1acccf48648cff7c74ca7f4964 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.523674  1690 raft_consensus.cc:2955] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.525370   431 tablet_replica.cc:333] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.526280   431 raft_consensus.cc:2243] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.527244   431 raft_consensus.cc:2272] T b3ead97901a6414b8541e2d33f5078ac P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.519541  7227 ts_tablet_manager.cc:933] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:33.518838  7210 raft_consensus.cc:2955] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index -1 to 10, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.554525   431 tablet_replica.cc:333] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.555575   431 raft_consensus.cc:2243] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.557165  7205 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:33.557829  7205 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:33.563376  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:33.567880  1580 leader_election.cc:336] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:03:33.568421  1580 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:33.569222  7131 raft_consensus.cc:2749] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:03:33.569728   431 raft_consensus.cc:2272] T 469f8c03f4924f809435141a09c976fa P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.559980  7205 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.574319   431 tablet_replica.cc:333] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.575214   431 raft_consensus.cc:2243] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.576213   431 raft_consensus.cc:2272] T 08378fd70b734734992a8174ab0ecfc8 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.590457   431 tablet_replica.cc:333] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.591326   431 raft_consensus.cc:2243] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.594468   431 raft_consensus.cc:2272] T 7d86302e0fce4e1585ef0f1cbc65dc7a P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.594405  7227 tablet_copy_client.cc:323] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:03:33.602136   431 tablet_replica.cc:333] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.603052   431 raft_consensus.cc:2243] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.603775   431 raft_consensus.cc:2272] T e0015d06d436447fb3ebe76172dc1798 P c98c328741aa493d87abafbf08f04944 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.607861  1625 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet 469f8c03f4924f809435141a09c976fa from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:03:33.608632  1625 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet 469f8c03f4924f809435141a09c976fa from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-469f8c03f4924f809435141a09c976fa
I20260709 13:03:33.605532  1439 catalog_manager.cc:5697] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index -1 to 10, NON_VOTER 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) added. New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } }
I20260709 13:03:33.621464   431 tablet_replica.cc:333] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.622483   431 raft_consensus.cc:2243] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.624733   431 raft_consensus.cc:2272] T 145197b092764852a509770daae94107 P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.635135   431 tablet_replica.cc:333] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.635919   431 raft_consensus.cc:2243] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.636726   431 raft_consensus.cc:2272] T c2ec497bce574477bc2b2cc694aa0637 P c98c328741aa493d87abafbf08f04944 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.639953   431 tablet_replica.cc:333] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.640697   431 raft_consensus.cc:2243] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.641801   431 raft_consensus.cc:2272] T 0a2543ffd0824f7ca2b1399af5f3b78d P c98c328741aa493d87abafbf08f04944 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.644981   431 tablet_replica.cc:333] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.645673   431 raft_consensus.cc:2243] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.646435   431 raft_consensus.cc:2272] T 423e376b43454bf396ca57e6aad172f5 P c98c328741aa493d87abafbf08f04944 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.649987   431 tablet_replica.cc:333] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.650676   431 raft_consensus.cc:2243] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:33.651965   431 raft_consensus.cc:2272] T 2e50d062d07e4a4eac4206ea9ec136cd P c98c328741aa493d87abafbf08f04944 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.655511   431 tablet_replica.cc:333] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.656272   431 raft_consensus.cc:2243] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.656925   431 raft_consensus.cc:2272] T d4fad2168ccb42729f2409fbb0a88116 P c98c328741aa493d87abafbf08f04944 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.659811   431 tablet_replica.cc:333] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944: stopping tablet replica
I20260709 13:03:33.669725  1625 tablet_copy_source_session.cc:215] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:33.672390   431 raft_consensus.cc:2243] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:33.686205   431 raft_consensus.cc:2272] T 5853661a3b2948fbb9b9483e9e4176a3 P c98c328741aa493d87abafbf08f04944 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:33.697741  7227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 469f8c03f4924f809435141a09c976fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:33.748764  7227 tablet_copy_client.cc:806] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:33.763075  7227 tablet_copy_client.cc:670] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:33.779348  7227 tablet_copy_client.cc:538] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:33.813726  7230 ts_tablet_manager.cc:933] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:33.843003  7230 tablet_copy_client.cc:323] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:03:33.850015  7229 ts_tablet_manager.cc:933] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:33.860438  7227 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:33.866782  7229 tablet_copy_client.cc:323] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:38063
I20260709 13:03:34.311328  7227 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:34.312668  7227 tablet_bootstrap.cc:492] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:03:34.313831  7227 ts_tablet_manager.cc:1403] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.454s	user 0.029s	sys 0.017s
I20260709 13:03:34.317713  7227 raft_consensus.cc:359] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:34.318713  7227 raft_consensus.cc:740] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:34.319507  7227 consensus_queue.cc:260] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:34.322443  7227 ts_tablet_manager.cc:1434] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:03:34.330466  7234 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.331583  7234 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:34.336891  7234 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.348675  7205 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.349385  7205 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.351679  7205 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.440383  7205 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.441118  7205 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.443414  7205 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.471110  1625 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet d3d04d35de654d5a8be688548f244d88 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:03:34.472144  1625 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet d3d04d35de654d5a8be688548f244d88 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-d3d04d35de654d5a8be688548f244d88
I20260709 13:03:34.467033  7240 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.499569  7240 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.526278  7240 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.533984  1626 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-469f8c03f4924f809435141a09c976fa received from {username='slave'} at 127.0.0.1:57944
I20260709 13:03:34.534632  1626 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-469f8c03f4924f809435141a09c976fa on tablet 469f8c03f4924f809435141a09c976fa with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:34.545058  7237 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.545830  7237 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.546496  7239 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.547124  7239 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.549672  7239 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.553035  1625 tablet_copy_source_session.cc:215] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:34.558826  7250 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.559612  7250 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:34.562336  7250 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:34.564195  7244 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:03:34.573968  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 108489us
I20260709 13:03:34.574878  7237 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:34.564980  1580 connection.cc:769] client connection to 127.0.107.193:35051 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:03:34.576417  7246 ts_tablet_manager.cc:933] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:34.578708  1507 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1434) could send its response
I20260709 13:03:34.571043  7251 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.579998  2363 raft_consensus.cc:1217] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 13:03:34.579972  7251 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.584614  7251 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.574508  7244 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.573770  7243 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.601753  7243 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.602630  7244 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.602979  7254 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.563892  7240 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.603684  7254 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.604466  7240 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:34.589799  1507 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1435) could send its response
I20260709 13:03:34.608533  7245 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:03:34.609225  1507 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1436) could send its response
I20260709 13:03:34.609128  7245 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:34.610288  1507 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1437) could send its response
I20260709 13:03:34.607620  7230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3d04d35de654d5a8be688548f244d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:34.612924  7250 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:03:34.613649  1507 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1438) could send its response
I20260709 13:03:34.613508  7250 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:34.614522  1507 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1439) could send its response
W20260709 13:03:34.615960  1654 connection.cc:769] client connection to 127.0.107.193:35051 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:03:34.611397  7245 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.618280  7248 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.624572  7248 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.627339  7248 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.611441  7243 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.621456  7240 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:34.615373  1507 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1440) could send its response
I20260709 13:03:34.606004  7254 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.661006  7250 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:03:34.661448  7243 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.663093  7245 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.663010  7243 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.663503  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.664213  1690 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:34.663818  7245 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.665751  7243 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.668769  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:34.669523  2370 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:34.671655  7245 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:34.680581  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 104986us
I20260709 13:03:34.680604  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.684494  7240 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.684960  1683 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 19.
I20260709 13:03:34.685228  7240 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.686638  7246 tablet_copy_client.cc:323] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:43963
I20260709 13:03:34.688226  7240 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.692895  7240 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.693262  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.695987  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.696776  1687 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:03:34.693585  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.697938  1579 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.698712  1686 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 16.
I20260709 13:03:34.699014  7248 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:34.698004  1683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.700887  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.699842  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.702102  1689 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:34.700270  1683 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:34.700548  1653 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.701689  1690 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 10.
W20260709 13:03:34.704672   431 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1428) could send its response
I20260709 13:03:34.695982  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:34.708431   431 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1429) could send its response
W20260709 13:03:34.711866   431 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1430) could send its response
W20260709 13:03:34.712452   431 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1431) could send its response
W20260709 13:03:34.713194   431 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34908 (request call id 1432) could send its response
W20260709 13:03:34.713439  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 97052.7us
W20260709 13:03:34.713644   431 connection.cc:466] server connection from 127.0.0.1:34908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34908 (request call id 1433) could send its response
I20260709 13:03:34.709524  1688 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 16.
I20260709 13:03:34.722740  1700 tablet_copy_service.cc:140] P f6eecf73c1c24b5eb268b5088a3030d4: Received BeginTabletCopySession request for tablet a8ff3d30394041dd91e5470bfd077bab from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:35722)
I20260709 13:03:34.704083  7240 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.723402  1700 tablet_copy_service.cc:161] P f6eecf73c1c24b5eb268b5088a3030d4: Beginning new tablet copy session on tablet a8ff3d30394041dd91e5470bfd077bab from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:35722: session id = 9d926c10b90f452ba52d80dab6a50351-a8ff3d30394041dd91e5470bfd077bab
I20260709 13:03:34.725214  7240 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.707674  7249 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:03:34.726498  7249 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 19 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.699494  7248 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.729231  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.703231  7250 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.709857  7243 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:03:34.726912  7249 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:34.741226  7243 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.732959  7248 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:34.753818  7250 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.765362  7250 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.772917  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:34.774331  1610 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:34.761313  7243 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:34.779359  1700 tablet_copy_source_session.cc:215] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:03:34.786136  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 73379.3us
I20260709 13:03:34.791393  1625 tablet_copy_service.cc:140] P e8eefefed88a4903b423e9f487c4805a: Received BeginTabletCopySession request for tablet e0015d06d436447fb3ebe76172dc1798 from peer 9d926c10b90f452ba52d80dab6a50351 ({username='slave'} at 127.0.0.1:57944)
I20260709 13:03:34.792014  1625 tablet_copy_service.cc:161] P e8eefefed88a4903b423e9f487c4805a: Beginning new tablet copy session on tablet e0015d06d436447fb3ebe76172dc1798 from peer 9d926c10b90f452ba52d80dab6a50351 at {username='slave'} at 127.0.0.1:57944: session id = 9d926c10b90f452ba52d80dab6a50351-e0015d06d436447fb3ebe76172dc1798
I20260709 13:03:34.794582  7131 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.795118  7131 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.797107  7131 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.797560  7131 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.797958  7131 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.799191  7230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:46602 (request call id 624) took 1080 ms. Trace:
I20260709 13:03:34.799562  7131 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.800736  1625 tablet_copy_source_session.cc:215] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:34.799758  7230 rpcz_store.cc:276] 0709 13:03:33.718794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.718959 (+   165us) service_pool.cc:224] Handling call
0709 13:03:33.814169 (+ 95210us) ts_tablet_manager.cc:934] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
0709 13:03:34.606123 (+791954us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:34.760360 (+154237us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:34.760495 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:34.798318 (+ 37823us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:34.798666 (+   348us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:34.799010 (+   344us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:34.799081 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":15674,"tablet-copy.queue_time_us":94191,"thread_start_us":91731,"threads_started":2}
I20260709 13:03:34.801450  7238 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.804006  7238 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:34.801872  2329 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.806210  7238 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.806849  7249 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.802886  1579 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.810379  7246 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0015d06d436447fb3ebe76172dc1798. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:34.810005  7248 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.789952  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.811252  7250 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:34.811658  7250 raft_consensus.cc:493] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.812081  7250 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:34.817494  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:34.817737  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:34.818184  1607 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:34.817998  7243 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:34.818467  1616 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:03:34.819160  1688 raft_consensus.cc:2393] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 12: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:34.819677  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:34.820370  1612 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:03:34.821302  1607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:34.822093  1607 raft_consensus.cc:2393] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 20: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:34.822860  7243 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:34.824294  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:34.824916  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.825865  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.824929  2370 raft_consensus.cc:3060] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:03:34.826201  7131 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:34.826748  7131 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.827158  7131 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.826052  7247 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:03:34.828666  7247 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.829068  7247 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:34.829288  7249 leader_election.cc:290] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 20 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.826749  7261 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:34.832154  7261 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.832525  7261 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:34.833236  7248 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.834466  7230 tablet_copy_client.cc:806] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:34.835063  7230 tablet_copy_client.cc:670] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:34.835906  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
W20260709 13:03:34.838125  1580 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:34.844230  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 50172.1us
I20260709 13:03:34.844587  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:34.845592  1612 raft_consensus.cc:2393] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 15: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:34.850382  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.853024  2370 raft_consensus.cc:2468] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:03:34.855860  2328 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:34.857275  1653 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.857786  7264 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:03:34.858194  7243 raft_consensus.cc:2804] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:03:34.858788  7243 raft_consensus.cc:697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:34.859594  7250 raft_consensus.cc:515] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.859805  7243 consensus_queue.cc:237] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:34.857432  7229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8ff3d30394041dd91e5470bfd077bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:34.862857  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:34.826748  1579 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.877398  1612 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 16.
I20260709 13:03:34.877825  7248 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:34.878376  7248 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.878814  7248 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:34.881809  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 48932us
W20260709 13:03:34.884264  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 57585.8us
I20260709 13:03:34.885135  1579 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.886015  7249 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:03:34.886466  7249 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.843958  7261 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.886878  7249 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:34.843202  7131 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:34.892911  1580 leader_election.cc:336] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.893240  1434 catalog_manager.cc:5697] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 11 to 12, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.863435  7247 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.893989  1610 raft_consensus.cc:2393] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 13: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:34.903729  7131 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.901930  1579 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.917485  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.917723  7247 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.918113  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07448991374497e87b5636471d14890" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:34.918429  7247 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:34.918891  1689 raft_consensus.cc:3060] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:03:34.929695  7247 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.902118  7250 leader_election.cc:290] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.919001  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:34.919549  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:03:34.906004  1580 leader_election.cc:336] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.923728  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba63305badaf4879aab6ec160417462c" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:34.933851  1685 raft_consensus.cc:3060] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:34.924163  7243 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.925648  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:34.936543  1687 raft_consensus.cc:3060] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.936455  7243 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.937784  1690 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 12.
I20260709 13:03:34.938979  7243 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:34.928989  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "266184feaae1425bb1318e53e4b7d584" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:34.899164  7249 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.926431  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932266aa19544648a426ac5605e04ff8" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:34.940471  1686 raft_consensus.cc:3060] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:34.940479  1610 raft_consensus.cc:2393] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 17: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:34.941747  7249 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.928328  7257 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.922268  7248 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.930950  7247 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:34.944465  7257 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:34.945700  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.947146  7257 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:34.947213  1580 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.928967  7253 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
W20260709 13:03:34.948488  1580 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.948170  7253 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:34.953819  7248 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.953627  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b39a427ff64e86af918d4b96740100" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:34.954660  1690 raft_consensus.cc:3060] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:03:34.950312  1688 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
I20260709 13:03:34.955930  7253 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:34.961200  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:34.961886  2370 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:03:34.962292  1689 raft_consensus.cc:2468] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 20.
W20260709 13:03:34.963194  1580 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:34.967612  1580 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:34.970052  2329 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.969595  1685 raft_consensus.cc:2468] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:03:34.970676  2329 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:34.971750  7074 raft_consensus.cc:2749] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:34.966603  1690 raft_consensus.cc:2468] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 14.
W20260709 13:03:34.974390  1580 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.965261  1653 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.972896  1579 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:34.978592  1580 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:34.979218  1580 leader_election.cc:336] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.979663  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cfcd1acccf48648cff7c74ca7f4964" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:34.979665  1580 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:34.980504  1690 raft_consensus.cc:3060] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:34.905000  7261 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:34.982820  1686 raft_consensus.cc:2468] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:03:34.983170  7131 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:03:34.983636  7131 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.984081  7131 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:34.983999  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.985616  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "012a311e17a142298db5d9aa2a92c2f5" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:34.986275  1612 raft_consensus.cc:3060] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:03:34.977231  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:03:34.986840  1580 leader_election.cc:336] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:34.986349  1579 leader_election.cc:304] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:34.988492  7253 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:34.997848  7249 raft_consensus.cc:2804] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:03:34.998517  7249 raft_consensus.cc:697] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 20 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:34.998257  7253 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:34.998785  1612 raft_consensus.cc:2468] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:03:34.999624  7249 consensus_queue.cc:237] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.000793  7253 leader_election.cc:290] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:34.985525  7257 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:34.990371  7243 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:35.001569  7257 raft_consensus.cc:493] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:35.001677  7243 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:35.002125  7257 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:35.002226  7243 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:03:35.002856  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:35.003441  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:34.992110  7242 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:03:35.003690  1690 raft_consensus.cc:2468] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 11.
I20260709 13:03:35.004731  7242 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:35.005288  7242 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:34.993759  7241 raft_consensus.cc:2749] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:35.007705  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:03:34.994174  7230 tablet_copy_client.cc:538] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:34.994108  7247 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:34.988160  1687 raft_consensus.cc:2468] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 17.
I20260709 13:03:34.995471  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.018708  7253 raft_consensus.cc:2764] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:03:35.023030  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.014263  7246 tablet_copy_client.cc:806] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:35.025897  7246 tablet_copy_client.cc:670] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:34.996984  1579 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.028344  7239 raft_consensus.cc:2804] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:35.028923  7239 raft_consensus.cc:697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:35.030036  7239 consensus_queue.cc:237] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.035040  1579 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.037973  7253 raft_consensus.cc:2764] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:03:35.039021  7247 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:35.039358  1580 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.029265  7229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53388 (request call id 702) took 1265 ms. Trace:
I20260709 13:03:35.043332  7229 rpcz_store.cc:276] 0709 13:03:33.763526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.763805 (+   279us) service_pool.cc:224] Handling call
0709 13:03:33.850510 (+ 86705us) ts_tablet_manager.cc:934] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: Initiating tablet copy from peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
0709 13:03:34.855593 (+1005083us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:34.902866 (+ 47273us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:34.902987 (+   121us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:35.028491 (+125504us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:35.028804 (+   313us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:35.029112 (+   308us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:35.029188 (+    76us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":2556,"tablet-copy.queue_time_us":83887,"thread_start_us":49976,"threads_started":2}
I20260709 13:03:35.045228  7247 raft_consensus.cc:2804] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:03:35.044973  7243 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.045933  7247 raft_consensus.cc:697] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:35.047094  7247 consensus_queue.cc:237] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:35.049923  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:35.050518  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.036206  7257 raft_consensus.cc:515] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:35.054116  7242 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:35.050961  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.052177  7229 tablet_copy_client.cc:806] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:35.056320  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d86302e0fce4e1585ef0f1cbc65dc7a" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:03:35.057322  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.057407  2363 raft_consensus.cc:3060] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:35.057813  1579 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.063330  7241 raft_consensus.cc:2804] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:35.064168  7241 raft_consensus.cc:697] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:35.064504  7250 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:35.064934  7250 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:35.065320  7250 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.065258  7241 consensus_queue.cc:237] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.058298  7229 tablet_copy_client.cc:670] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:35.072005  2363 raft_consensus.cc:2468] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:03:35.073256  7229 tablet_copy_client.cc:538] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:35.073450  1653 leader_election.cc:304] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.074417  7253 raft_consensus.cc:2804] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:35.075358  7253 raft_consensus.cc:697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:35.076435  7253 consensus_queue.cc:237] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:35.060333  7243 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:35.061904  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.049202  7131 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.081439  1579 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.085121  7257 leader_election.cc:290] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:03:35.085361  7131 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:35.088377  7249 raft_consensus.cc:2804] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:35.088971  7230 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:35.089232  7249 raft_consensus.cc:697] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:35.090318  7249 consensus_queue.cc:237] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.087311  1579 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.102574  7242 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:35.100627  7131 raft_consensus.cc:2804] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:35.087103  1654 leader_election.cc:304] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.104902  7131 raft_consensus.cc:697] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 17 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
W20260709 13:03:35.106952  1654 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.113487  1690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
W20260709 13:03:35.114548  1654 leader_election.cc:336] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.118724  1687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:35.119563  1687 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 15: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:03:35.120483  7264 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:35.121151  7264 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:35.123318  1580 leader_election.cc:336] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.123672  7264 leader_election.cc:290] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:35.110013  7245 raft_consensus.cc:2804] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:03:35.129462  7245 raft_consensus.cc:697] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:35.130498  7245 consensus_queue.cc:237] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:35.116881  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.125902  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:35.133939  1685 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 16.
I20260709 13:03:35.108942  7243 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:35.135637  2328 leader_election.cc:304] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.136078  7243 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.137140  1685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:35.137756  1685 raft_consensus.cc:3060] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:03:35.138238  7243 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:35.139130  1689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:35.139910  1689 raft_consensus.cc:3060] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:03:35.087049  7250 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:35.141115  1654 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.118522  7131 consensus_queue.cc:237] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.144085  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:35.140133  7246 tablet_copy_client.cc:538] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:03:35.150048  1654 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.150281  1690 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e8eefefed88a4903b423e9f487c4805a in current term 17: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
W20260709 13:03:35.151894  1654 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.153793  1654 leader_election.cc:336] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.154556  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:35.155237  1654 leader_election.cc:336] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.155377  1685 raft_consensus.cc:2468] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 13.
I20260709 13:03:35.155679  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:35.157568  7252 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:35.142854  7264 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:03:35.160575  1654 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.162444  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:35.161258  7243 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:03:35.170154  7243 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:03:35.183048  1433 catalog_manager.cc:5697] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 19 to 20, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 20 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:35.184959  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.193409  1689 raft_consensus.cc:2468] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
I20260709 13:03:35.162106  7264 raft_consensus.cc:493] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:35.204773  7264 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:35.269307  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:35.278854  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 65950.4us
W20260709 13:03:35.279935  2329 leader_election.cc:336] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.284021  1580 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.285972  1580 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.286680  1580 leader_election.cc:336] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.287397  1580 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.289616  7229 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:35.291177  7250 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:03:35.300161  1580 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.300993  1580 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.301517  1580 leader_election.cc:336] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.301990  1580 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.304865  1579 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:03:35.314566  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.319382  1579 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:35.315919  7240 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:03:35.346786  7239 raft_consensus.cc:2804] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:03:35.347694  7239 raft_consensus.cc:697] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:35.348935  7239 consensus_queue.cc:237] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.352733  1579 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:35.353668  7240 raft_consensus.cc:2804] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:03:35.354189  7240 raft_consensus.cc:697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:35.355115  7240 consensus_queue.cc:237] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:35.359930  1579 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:35.385948  7131 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:35.420334  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 105173us
W20260709 13:03:35.420982  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:35.422169  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 261619us
W20260709 13:03:35.422820  1654 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.421725  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.441404  7205 raft_consensus.cc:1064] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
W20260709 13:03:35.448434  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 53146us
W20260709 13:03:35.451215  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:35.451664  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 105057us
W20260709 13:03:35.452139  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.452363  7205 consensus_queue.cc:237] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:35.463131  1686 raft_consensus.cc:1275] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:03:35.466259  7246 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap starting.
I20260709 13:03:35.466667  1686 raft_consensus.cc:1275] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 20 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:03:35.471413  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.482254  7264 raft_consensus.cc:515] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:35.516543  2392 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6ce0 after lost signal to thread 434
W20260709 13:03:35.517992  2392 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7d40 after lost signal to thread 1473
W20260709 13:03:35.519724  2392 debug-util.cc:398] Leaking SignalData structure 0x7b08002e23e0 after lost signal to thread 1640
W20260709 13:03:35.521080  2392 debug-util.cc:398] Leaking SignalData structure 0x7b0800106be0 after lost signal to thread 1714
W20260709 13:03:35.522429  2392 debug-util.cc:398] Leaking SignalData structure 0x7b080020c980 after lost signal to thread 2395
W20260709 13:03:35.525815  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.534577  7272 consensus_queue.cc:1048] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:35.539752  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:35.549063  1610 raft_consensus.cc:2393] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 15: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:35.551363  1616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90b90f8e722a4f1ebab12217cf2171e1" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:35.551404  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "788938c376a646979b8eee973560dc65" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:35.556829  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145197b092764852a509770daae94107" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:35.557804  1686 raft_consensus.cc:3060] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:03:35.539615  7264 leader_election.cc:290] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:35.560297  1433 catalog_manager.cc:5697] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 14 to 15, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.569198  1433 catalog_manager.cc:5697] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 10 to 11, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.576311  1686 raft_consensus.cc:2468] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 17.
I20260709 13:03:35.578065  2328 leader_election.cc:304] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.553651  7248 consensus_queue.cc:1048] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:03:35.626027  1687 raft_consensus.cc:1275] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:03:35.626446  1685 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:35.627336  7234 raft_consensus.cc:2804] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:35.632504  2370 raft_consensus.cc:1275] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:03:35.627928  7234 raft_consensus.cc:697] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 17 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:03:35.647625  7131 consensus_queue.cc:1048] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:35.650002  7131 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:03:35.662185  1687 raft_consensus.cc:1275] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:03:35.664229  1684 raft_consensus.cc:1275] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:03:35.664918  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.665815  2329 leader_election.cc:336] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.668232  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.670058  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.670805  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.669167  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:35.661612  1434 catalog_manager.cc:5697] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 13 to 14, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 14 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.675652  7131 consensus_queue.cc:1048] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:03:35.676919  1434 catalog_manager.cc:5697] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 16 to 17, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 17 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.694711  1434 catalog_manager.cc:5697] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 12 to 13, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 13 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.703058  1434 catalog_manager.cc:5697] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 14 to 15, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 15 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.706435  1434 catalog_manager.cc:5697] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 12 to 13, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 13 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.709473  1434 catalog_manager.cc:5697] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 10 to 11, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 11 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.705821  7248 consensus_queue.cc:1048] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:03:35.714562  7234 consensus_queue.cc:237] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:35.719105  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.719822  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:35.720510  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.720976  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:35.711177  1434 catalog_manager.cc:5697] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 14 to 15, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 15 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:35.729544  7240 consensus_queue.cc:1048] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:03:35.742580  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a" is_pre_election: true
I20260709 13:03:35.743264  1610 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 16.
I20260709 13:03:35.748016  1612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:35.749048  1612 raft_consensus.cc:2393] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 17: Already voted for candidate e8eefefed88a4903b423e9f487c4805a in this term.
I20260709 13:03:35.767139  1685 raft_consensus.cc:1275] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:03:35.782006   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:35.790805  1654 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.791554  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:35.794005  1654 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.795275  7291 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:03:35.812222  1654 leader_election.cc:336] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.783399  7248 consensus_queue.cc:1048] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:03:35.834474  1439 catalog_manager.cc:5697] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 16 to 17, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:35.838546  7284 raft_consensus.cc:2955] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:35.856925  2370 raft_consensus.cc:1275] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:03:35.859766  2370 raft_consensus.cc:1275] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:03:35.860852  7291 consensus_queue.cc:1048] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:03:35.861127  7253 consensus_queue.cc:1048] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:03:35.835808  1685 raft_consensus.cc:2955] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:35.871796  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:35.885407  7292 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:03:35.892311  7292 raft_consensus.cc:493] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c98c328741aa493d87abafbf08f04944)
I20260709 13:03:35.892782  7292 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:35.906826  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:35.969981  1654 leader_election.cc:336] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.972432  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:35.986625  7230 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:35.987514  7279 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:03:35.988927  1654 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:35.989755  1654 leader_election.cc:336] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:35.990180  1654 leader_election.cc:304] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:03:35.987812  7230 tablet_bootstrap.cc:492] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
W20260709 13:03:36.002537  1654 leader_election.cc:336] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:36.003732  1654 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:36.004778  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:36.016901  1612 raft_consensus.cc:1275] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:03:36.017119  7245 raft_consensus.cc:2749] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:03:36.033490  7230 ts_tablet_manager.cc:1403] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 0.945s	user 0.035s	sys 0.034s
I20260709 13:03:36.023734  7293 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:03:36.066008  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 62300.5us
W20260709 13:03:36.066690  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.067121  1654 leader_election.cc:336] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:36.071656  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.072276  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.072650  1654 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:36.072990  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:03:36.073809  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.080008  7245 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:03:36.143607  7302 log.cc:927] Time spent T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:03:36.140995  7292 raft_consensus.cc:515] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:36.166112  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 103377us
I20260709 13:03:36.171262  1684 raft_consensus.cc:1275] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:03:36.187999  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.188923  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 114653us
W20260709 13:03:36.322943  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.323446  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 133857us
W20260709 13:03:36.323967  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.348261  1684 raft_consensus.cc:1275] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:03:36.376125  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 65964.9us
I20260709 13:03:36.387305  7292 leader_election.cc:290] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:03:36.390756  7229 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:36.392470  7230 raft_consensus.cc:359] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:36.393378  7230 raft_consensus.cc:740] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:36.394014  7230 consensus_queue.cc:260] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:03:36.409248  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:36.412391  7308 log.cc:927] Time spent T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.274s	user 0.004s	sys 0.001s
I20260709 13:03:36.391868  7229 tablet_bootstrap.cc:492] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:03:36.422544  7229 ts_tablet_manager.cc:1403] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 1.133s	user 0.049s	sys 0.018s
I20260709 13:03:36.424633  7230 ts_tablet_manager.cc:1434] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.362s	user 0.009s	sys 0.000s
I20260709 13:03:36.425973  7229 raft_consensus.cc:359] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:36.428864  7229 raft_consensus.cc:740] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:36.429554  2370 raft_consensus.cc:2955] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:36.431634  7229 consensus_queue.cc:260] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:03:36.432420  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 198497us
I20260709 13:03:36.434944  1684 raft_consensus.cc:1275] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:03:36.449535  7293 consensus_queue.cc:1048] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:36.450081  7229 ts_tablet_manager.cc:1434] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:36.482263  7249 consensus_queue.cc:1048] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:36.449543  7325 consensus_queue.cc:1048] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:03:36.466007  2367 raft_consensus.cc:1217] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:03:36.488025  1437 catalog_manager.cc:5697] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a reported cstate change: config changed from index 8 to 9, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:36.497432  7246 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:03:36.502519  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.511076  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.514669  1654 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:36.515228  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:03:36.516296  7254 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:36.517860  7246 tablet_bootstrap.cc:492] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: Bootstrap complete.
I20260709 13:03:36.518766  7246 ts_tablet_manager.cc:1403] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: Time spent bootstrapping tablet: real 1.053s	user 0.033s	sys 0.029s
I20260709 13:03:36.520744  7321 consensus_queue.cc:1048] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:03:36.521528  1610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e50d062d07e4a4eac4206ea9ec136cd" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e8eefefed88a4903b423e9f487c4805a"
I20260709 13:03:36.525331  1610 raft_consensus.cc:3060] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:03:36.545230  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.554251  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.555214  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:36.542985  7246 raft_consensus.cc:359] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
I20260709 13:03:36.555513  1625 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-d3d04d35de654d5a8be688548f244d88 received from {username='slave'} at 127.0.0.1:57944
I20260709 13:03:36.557037  7246 raft_consensus.cc:740] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Initialized, Role: LEARNER
I20260709 13:03:36.557158  1625 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-d3d04d35de654d5a8be688548f244d88 on tablet d3d04d35de654d5a8be688548f244d88 with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:36.557837  7246 consensus_queue.cc:260] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } }
W20260709 13:03:36.556550  1654 leader_election.cc:336] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:36.560731  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:36.555819  1610 raft_consensus.cc:2468] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 17.
W20260709 13:03:36.566360  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:36.562425  7246 ts_tablet_manager.cc:1434] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:03:36.570420  2363 raft_consensus.cc:1217] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.9->[16.10-16.10]   Dedup: 16.10->[]
I20260709 13:03:36.571456  2370 raft_consensus.cc:1217] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:03:36.582926  1654 leader_election.cc:304] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:36.608438  7332 raft_consensus.cc:2804] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:03:36.609018  7332 raft_consensus.cc:697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:03:36.609917  7332 consensus_queue.cc:237] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:36.618338  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.628749  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.604933  2328 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 62551.3us
I20260709 13:03:36.633127  1700 tablet_copy_service.cc:342] P f6eecf73c1c24b5eb268b5088a3030d4: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-a8ff3d30394041dd91e5470bfd077bab received from {username='slave'} at 127.0.0.1:35722
I20260709 13:03:36.633627  1700 tablet_copy_service.cc:434] P f6eecf73c1c24b5eb268b5088a3030d4: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-a8ff3d30394041dd91e5470bfd077bab on tablet a8ff3d30394041dd91e5470bfd077bab with peer 9d926c10b90f452ba52d80dab6a50351
I20260709 13:03:36.655954  1625 tablet_copy_service.cc:342] P e8eefefed88a4903b423e9f487c4805a: Request end of tablet copy session 9d926c10b90f452ba52d80dab6a50351-e0015d06d436447fb3ebe76172dc1798 received from {username='slave'} at 127.0.0.1:57944
I20260709 13:03:36.656582  1625 tablet_copy_service.cc:434] P e8eefefed88a4903b423e9f487c4805a: ending tablet copy session 9d926c10b90f452ba52d80dab6a50351-e0015d06d436447fb3ebe76172dc1798 on tablet e0015d06d436447fb3ebe76172dc1798 with peer 9d926c10b90f452ba52d80dab6a50351
W20260709 13:03:36.752413  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44373.3us
W20260709 13:03:36.782553   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1562)
I20260709 13:03:36.786998  1437 catalog_manager.cc:5697] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 16 to 17, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } }
W20260709 13:03:36.866164  1580 consensus_peers.cc:597] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:36.923691  1654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111) [suppressed 360 similar messages]
W20260709 13:03:36.966434  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:37.039242  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:37.041498  7205 raft_consensus.cc:1064] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:03:37.045776  7205 consensus_queue.cc:237] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:37.057353  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.070364  7326 raft_consensus.cc:1064] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:03:37.073581  7326 consensus_queue.cc:237] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:37.088948  7241 raft_consensus.cc:1064] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: attempting to promote NON_VOTER 9d926c10b90f452ba52d80dab6a50351 to VOTER
I20260709 13:03:37.091953  7241 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 8, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:37.131949  2370 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 LEARNER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:37.145785  1688 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:37.145785  2370 raft_consensus.cc:1275] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:03:37.147994  7240 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:37.149787  7320 consensus_queue.cc:1048] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:37.137745  7254 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
W20260709 13:03:37.171603  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.181910  1612 raft_consensus.cc:1275] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:03:37.184288  1610 raft_consensus.cc:1275] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:03:37.193565  7205 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.194471  7205 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:37.197497  7205 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:37.198818  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:37.199803  1686 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 17.
I20260709 13:03:37.198750  7293 consensus_queue.cc:1048] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:37.201370  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:37.201856  7293 consensus_queue.cc:1048] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:03:37.204134  1579 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:03:37.205842  7320 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:03:37.206368  7320 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.206807  7320 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:37.231631  1580 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:37.313447  7320 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:37.407254  7345 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:03:37.435819  7346 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:03:37.452855  7348 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:03:37.460167  7320 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 18 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:37.475239  7320 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.475739  2363 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 LEARNER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:37.475749  7320 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:37.483700  7349 log.cc:927] Time spent T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:03:37.487811  7351 log.cc:927] Time spent T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:03:37.489454  7272 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:37.490381  7320 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:37.493673  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.494464  1580 consensus_peers.cc:597] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:37.504024  1580 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:37.510866  2367 raft_consensus.cc:2955] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:37.512940  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49582.6us
I20260709 13:03:37.508816  7205 raft_consensus.cc:2955] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:37.557792  1580 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:37.563575  1437 catalog_manager.cc:5697] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 10 to 11, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:37.613500  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 65369.5us
I20260709 13:03:37.661695  1688 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:03:37.671662  1688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbc0065dafc14741989730fd503966f0" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:37.672525  1688 raft_consensus.cc:3060] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:03:37.687882  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.690143  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:37.697129  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:37.698041  1686 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 15.
W20260709 13:03:37.739310  7360 log.cc:927] Time spent T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
W20260709 13:03:37.784072   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:37.806622  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 161416us
W20260709 13:03:37.833535  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:37.837623  1688 raft_consensus.cc:2468] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 18.
W20260709 13:03:37.854336  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.856451  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.865252  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.866148  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.869499  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:37.873718  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:37.891867  1686 raft_consensus.cc:2955] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:37.936147  7374 raft_consensus.cc:2955] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:37.955261  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:37.970726  7241 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:37.980782  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 53265.1us
I20260709 13:03:38.001636  1579 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:03:38.014861  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:38.024304  7241 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:03:38.024806  7241 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.025147  7241 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:03:38.030638  2363 raft_consensus.cc:2955] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:38.041115  1434 catalog_manager.cc:5697] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:38.044840  7241 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:03:38.047511  7241 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 election: Requested vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:03:38.068022  1579 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
W20260709 13:03:38.079562  1580 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:38.104441  7272 raft_consensus.cc:2804] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:03:38.113914  7272 raft_consensus.cc:697] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 18 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:38.115072  7272 consensus_queue.cc:237] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:38.124485  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:38.130514  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:38.131253  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:38.139120  7325 raft_consensus.cc:2955] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:38.140491  1612 raft_consensus.cc:2955] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:38.154314  1684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2157e4514164aedb7c5dc22acfb5ca6" candidate_uuid: "e8eefefed88a4903b423e9f487c4805a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:03:38.155149  1684 raft_consensus.cc:3060] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:03:38.165064  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:38.180124  1684 raft_consensus.cc:2468] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8eefefed88a4903b423e9f487c4805a in term 16.
I20260709 13:03:38.179490  1688 raft_consensus.cc:2955] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
I20260709 13:03:38.187070  1579 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944
I20260709 13:03:38.197355  7373 raft_consensus.cc:2804] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:03:38.221911  7373 raft_consensus.cc:697] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 16 LEADER]: Becoming Leader. State: Replica: e8eefefed88a4903b423e9f487c4805a, State: Running, Role: LEADER
I20260709 13:03:38.227998  7373 consensus_queue.cc:237] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:03:38.250712  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51348.8us
W20260709 13:03:38.252872  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.260492  1434 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: config changed from index 10 to 11, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:38.265472  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:38.271152  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:38.266337  1437 catalog_manager.cc:5697] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 16 to 18, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 18 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.279670  2367 raft_consensus.cc:2955] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index 10 to 11, 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:38.317483  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:38.327893  1434 catalog_manager.cc:5697] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a reported cstate change: term changed from 14 to 16, leader changed from c98c328741aa493d87abafbf08f04944 (127.0.107.193) to e8eefefed88a4903b423e9f487c4805a (127.0.107.194). New cstate: current_term: 16 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:38.351404  1612 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:03:38.361090  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:38.363400  2367 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:38.365200  1688 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:03:38.392539  7373 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:03:38.396652  7325 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:03:38.414162  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.453193  7320 raft_consensus.cc:2955] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:38.479518  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:38.480301  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:38.503723  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 67390.2us
W20260709 13:03:38.508589  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:38.511492  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 66012us
W20260709 13:03:38.521108  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.532963  2367 raft_consensus.cc:2955] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:38.535167  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:38.519455  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:38.550604  1686 raft_consensus.cc:2955] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 11 to 12, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:38.570724  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:38.570137  1434 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: config changed from index 11 to 12, VOTER c98c328741aa493d87abafbf08f04944 (127.0.107.193) evicted. New cstate: current_term: 16 leader_uuid: "e8eefefed88a4903b423e9f487c4805a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } } }
W20260709 13:03:38.571578  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:38.578440  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:03:38.623828  1690 raft_consensus.cc:1275] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:03:38.627630  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:38.641086  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 49849us
W20260709 13:03:38.645905  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:38.646555  1580 consensus_peers.cc:597] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:38.655970  7373 consensus_queue.cc:1048] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:03:38.660226  1424 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3d04d35de654d5a8be688548f244d88 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:03:38.678151  1424 catalog_manager.cc:4755] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d3d04d35de654d5a8be688548f244d88: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:38.729332  1686 raft_consensus.cc:1275] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Refusing update from remote peer e8eefefed88a4903b423e9f487c4805a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:03:38.730968  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:38.734512  7272 consensus_queue.cc:1048] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:03:38.758833  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:38.768728  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:38.784952   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:38.823455  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:38.938627  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:38.982065  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:39.037560  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.038517  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:39.071489  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:39.072355  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:39.123687  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:39.364840  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:39.627693  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 47411.6us
W20260709 13:03:39.722419  1653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38365, user_credentials={real_user=slave}} blocked reactor thread for 131727us
W20260709 13:03:39.736958  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:39.741128  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.785619   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:39.903328  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:39.951275  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.012743  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.041620  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.047719  1424 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 46992.3us
W20260709 13:03:40.054598  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.058176  1424 catalog_manager.cc:4755] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d3d04d35de654d5a8be688548f244d88: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:40.085446  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.140743  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.183084  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.257171  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:40.262995  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.313180  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.358402  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.366611  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.379377  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.434731  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.552245  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.581931  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.624667  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.656821  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.721333  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.739162  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.769275  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.771713  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.786293   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:40.836987  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:40.847187  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:40.863168  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:40.863751  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:40.881979  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:40.893042  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:40.947659  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:40.986346  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.090735  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.092278  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:41.115962  1580 consensus_peers.cc:597] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:41.117074  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.157332  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.180627  1424 catalog_manager.cc:4755] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d3d04d35de654d5a8be688548f244d88: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:41.191085  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.260216  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.386981  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.443095  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.447924  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.495951  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.501685  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:41.519371  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.523948  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.762226  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.772784  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.787039   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:41.848567  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:41.930967  1654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111) [suppressed 503 similar messages]
W20260709 13:03:42.128444  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.239670  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:42.396430  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.439877  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.494942  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.639058  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.652395  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.653919  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.669142  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.687201  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.788669   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:42.791517  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.868875  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:42.879387  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.936995  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.943939  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:42.950773  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.007591  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.106173  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.137552  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.148157  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.178754  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.208261  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.333720  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.350948  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49308.8us
W20260709 13:03:43.370069  1424 catalog_manager.cc:4755] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d3d04d35de654d5a8be688548f244d88: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:43.379192  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.381471  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.382483  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.403338  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.428679  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.429759  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.436972  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.458472  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.459712  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.506544  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.537305  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.538018  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:43.586261  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.631670  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.712512  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.750610  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:43.789232   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:43.803728  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.810673  1580 consensus_peers.cc:597] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:03:43.823449  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.929463  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.948817  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:43.959050  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:44.100266  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:44.157728  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:44.165169  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:44.185382  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:44.405256  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:44.628865  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 198286us
W20260709 13:03:44.673662  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:44.789773   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:44.807320  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:44.927214  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.007961  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.037241  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.067193  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.086555  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.119305  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.180668  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.200331  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.267493  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.314857  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.358436  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.389333  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.401137  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.568310  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:45.574599  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.578779  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080039a4c0 after lost signal to thread 434
W20260709 13:03:45.580377  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae1a0 after lost signal to thread 1473
W20260709 13:03:45.582099  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08000553a0 after lost signal to thread 1640
W20260709 13:03:45.583467  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08002d7a80 after lost signal to thread 1714
W20260709 13:03:45.584918  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8520 after lost signal to thread 2395
W20260709 13:03:45.590204  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:45.630725  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:45.637010  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.648526  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:45.653796  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.659639  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.733342  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:45.790311   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:45.866161  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.011629  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 126965us
W20260709 13:03:46.032660  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 44651.7us
W20260709 13:03:46.090606  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.106359  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.093888  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.149200  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.156569  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 49074.2us
W20260709 13:03:46.172111  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.162374  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.170619  1580 consensus_peers.cc:597] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:46.196254  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.217590  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.262842  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 44498.3us
W20260709 13:03:46.265949  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.267539  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.330523  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.349491  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.351593  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:03:46.356874  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.357388  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.393623  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.416824  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.427181  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.571460  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.617784  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:46.793159   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:46.816478  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.845857  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:46.933899  1580 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111) [suppressed 497 similar messages]
W20260709 13:03:46.961953  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:47.075964  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:47.410696  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.413966  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.472352  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 58449.8us
W20260709 13:03:47.472600  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 51573.7us
W20260709 13:03:47.490450  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:47.525609  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:47.536518  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.546586  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.547070  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.611456  1424 catalog_manager.cc:4755] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d3d04d35de654d5a8be688548f244d88: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:47.659132  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.704702  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.757627  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.793676   431 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:47.877579  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:47.932821  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.003976  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.043787  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.046679  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.076365  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:48.099541  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:48.116251  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.172238  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.174808  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.180526  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.181332  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.206455  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.287829  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.316363  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.332860  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.400776  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.413487  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:48.441270  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.484932  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.507370  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.510120  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.522313  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.536399  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.656098  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.685600  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.693940  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.712736  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.747195  1580 consensus_peers.cc:597] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:03:48.794206   431 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:48.876935  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:48.883559  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:48.896564  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.067487  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.108212  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:49.114364  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:49.119017  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:49.317691  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:49.425824  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:49.465267  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:49.499851  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:49.794786   431 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:49.855028  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:49.942113  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:49.974701  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.017900  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.018615  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.087797  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.106205  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.305119  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.394428  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:50.423777  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.434602  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:50.467717  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.595986  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.600244  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.709496  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.707304  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.730850  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:50.752730  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:50.754873  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:50.768973  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.762434  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.781812  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.795548   431 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:50.836781  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:50.841382  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:50.885442  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.029529  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.144925  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:51.147698  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.148324  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.163532  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.173615  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.174234  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.203589  1580 consensus_peers.cc:597] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:51.209127  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:03:51.210362  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.217756  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.301160  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.331280  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.331801  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.349267  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.371917  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.402920  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.419004  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.595798  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.717926  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.750188  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.797456  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:51.797499   431 thread.cc:527] Waited for 17000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:51.880326  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:51.939386  2329 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111) [suppressed 496 similar messages]
W20260709 13:03:52.034292  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:52.068885  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:52.323596  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:52.411849  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:52.672070  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 45264.2us
W20260709 13:03:52.754207  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:52.800539   431 thread.cc:527] Waited for 18000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:52.822774  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 64632.3us
W20260709 13:03:52.832415  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:52.866308  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:52.877053  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:52.896973  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:52.904951  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:52.918195  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:52.945024  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.053750  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:53.089407  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:53.092361  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.101432  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:53.142743  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.164003  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:53.224114  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:53.285102  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.290915  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.342190  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:53.359483  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.397801  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.398715  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.417901  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.462384  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.471395  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.517182  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:53.551966  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080036dc40 after lost signal to thread 434
W20260709 13:03:53.553781  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800148ea0 after lost signal to thread 1473
W20260709 13:03:53.556792  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2960 after lost signal to thread 1640
W20260709 13:03:53.559837  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800107ca0 after lost signal to thread 1714
W20260709 13:03:53.561885  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080010ea60 after lost signal to thread 2395
W20260709 13:03:53.638003  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.691900  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.716462  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:53.745066  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.754041  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:53.767246  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.801110   431 thread.cc:527] Waited for 19000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:53.812063  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:53.817752  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:53.837431  1580 consensus_peers.cc:597] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:53.901405  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:03:53.928862  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:53.988380  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:54.024008  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:54.107968  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:54.267032  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:54.310812  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:54.370368  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:54.415829  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:54.498594  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:54.542129  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003af3e0 after lost signal to thread 434
W20260709 13:03:54.543586  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080014cdc0 after lost signal to thread 1473
W20260709 13:03:54.545275  1637 debug-util.cc:398] Leaking SignalData structure 0x7b0800304f80 after lost signal to thread 1640
W20260709 13:03:54.546687  1637 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5a00 after lost signal to thread 1714
W20260709 13:03:54.550053  1637 debug-util.cc:398] Leaking SignalData structure 0x7b080029dcc0 after lost signal to thread 2395
W20260709 13:03:54.641059  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:54.679229  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:54.690833  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:54.751077  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:54.801607   431 thread.cc:527] Waited for 20000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:54.931685  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:55.050405  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.056278  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.072363  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.099546  1579 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:38063, user_credentials={real_user=slave}} blocked reactor thread for 72559us
W20260709 13:03:55.182296  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.211863  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:55.332213  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 95527.2us
W20260709 13:03:55.398198  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:55.431931  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.463536  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.469043  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.469957  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.578890  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:55.608341  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:55.635756  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.640729  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.662460  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.721393  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.723775  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.802124   431 thread.cc:527] Waited for 21000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:55.849740  1424 catalog_manager.cc:4755] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d3d04d35de654d5a8be688548f244d88: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:03:55.870253  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.902052  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.913465  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.928746  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:55.929859  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:55.940286  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:55.966928  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:56.004452  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:56.034742  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:56.074785  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:56.086159  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:56.097743  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:56.271893  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:56.300173  1580 consensus_peers.cc:597] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:56.334546  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:56.340018  1580 consensus_peers.cc:597] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:56.400782  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:56.411540  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:56.515859  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 54421.1us
W20260709 13:03:56.529793  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:03:56.790916  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:56.802783   431 thread.cc:527] Waited for 22000ms trying to join with diag-logger (tid 1562)
W20260709 13:03:56.833140  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:57.257045  1654 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111) [suppressed 451 similar messages]
W20260709 13:03:57.262753  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:57.399758  1580 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 771175us
W20260709 13:03:57.467676  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:57.471544  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:57.499615  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:57.503994  1580 consensus_peers.cc:597] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:57.513005  1580 consensus_peers.cc:597] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:57.715128  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:57.775396  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:57.781160  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:57.781462  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:57.795136  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:57.805790  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:57.915050  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:57.924086  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:57.929140  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:58.700534  1580 consensus_peers.cc:597] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:58.716446  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080025a400 after lost signal to thread 434
W20260709 13:03:58.717950  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800362880 after lost signal to thread 1473
W20260709 13:03:58.719638  1711 debug-util.cc:398] Leaking SignalData structure 0x7b0800352180 after lost signal to thread 1640
W20260709 13:03:58.724010  1711 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7bc0 after lost signal to thread 1714
W20260709 13:03:58.726572  1711 debug-util.cc:398] Leaking SignalData structure 0x7b080032e080 after lost signal to thread 2395
W20260709 13:03:58.773983  1580 consensus_peers.cc:597] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:58.774981  1580 consensus_peers.cc:597] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:58.856913  2329 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:35051, user_credentials={real_user=slave}} blocked reactor thread for 100103us
I20260709 13:03:58.908553  7487 raft_consensus.cc:493] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:03:58.909650  7487 raft_consensus.cc:515] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:03:58.914721  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23137a56fb91492eb22faa7c97ee9aec" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:03:58.917491  7487 leader_election.cc:290] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:03:58.920121  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:58.920840  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:58.893723  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:58.926306  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:58.963639  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:58.965286  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:58.974679  2329 leader_election.cc:336] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:03:58.980266  2329 leader_election.cc:304] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:03:58.981294  7479 raft_consensus.cc:2749] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:03:59.019200   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:59.051981  1580 consensus_peers.cc:597] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:59.052948  1580 consensus_peers.cc:597] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.075740  1580 consensus_peers.cc:597] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.131911  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:03:59.185050   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:59.200487  1580 consensus_peers.cc:597] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:59.216120  1580 consensus_peers.cc:597] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.203261  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.255906  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800175460 after lost signal to thread 434
W20260709 13:03:59.257256  1470 debug-util.cc:398] Leaking SignalData structure 0x7b08003049c0 after lost signal to thread 1473
W20260709 13:03:59.258680  1470 debug-util.cc:398] Leaking SignalData structure 0x7b080039a1a0 after lost signal to thread 1640
W20260709 13:03:59.259949  1470 debug-util.cc:398] Leaking SignalData structure 0x7b08001019c0 after lost signal to thread 1714
W20260709 13:03:59.261500  1470 debug-util.cc:398] Leaking SignalData structure 0x7b0800323640 after lost signal to thread 2395
W20260709 13:03:59.270028  1580 consensus_peers.cc:597] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.291667  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.343192  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.372072  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.380722  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.386011  2329 consensus_peers.cc:597] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.391912  2329 consensus_peers.cc:597] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.395565  1580 consensus_peers.cc:597] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:59.420779  1580 consensus_peers.cc:597] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:59.422814  1580 consensus_peers.cc:597] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.445313  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:59.464725  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.466056  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.466804  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.467435  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.468075  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.468776  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.480912  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.481917  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:03:59.482434  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.483485  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.484262  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.484887  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.485479  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.486116  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.486733  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.490067  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:03:59.502727   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:59.506428  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.507933   431 tablet_replica.cc:333] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.509446   431 raft_consensus.cc:2243] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.514719   431 raft_consensus.cc:2272] T 70e893ad27ae41db934ba22b14642022 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.515564  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.521552   431 tablet_replica.cc:333] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.545269   431 raft_consensus.cc:2243] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.555876   431 raft_consensus.cc:2272] T 23c94fd76da84decac35ba61e1d5cb3c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.563264   431 tablet_replica.cc:333] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.564606   431 raft_consensus.cc:2243] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.568881   431 raft_consensus.cc:2272] T f8464531709643ab8a8fd947089037ef P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.576924   431 tablet_replica.cc:333] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.578018   431 raft_consensus.cc:2243] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.586258   431 raft_consensus.cc:2272] T 012a311e17a142298db5d9aa2a92c2f5 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.595304   431 tablet_replica.cc:333] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.598487   431 raft_consensus.cc:2243] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:03:59.605015  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:59.609093  1580 consensus_peers.cc:597] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:59.611644   431 raft_consensus.cc:2272] T ba63305badaf4879aab6ec160417462c P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.623983  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.624940   431 tablet_replica.cc:333] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
W20260709 13:03:59.624943  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.629202  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.629483   431 raft_consensus.cc:2243] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.634518   431 raft_consensus.cc:2272] T a93cfc3bb7634fb1b78c60f120616d9d P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.657119   431 tablet_replica.cc:333] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.658114   431 raft_consensus.cc:2243] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.659060   431 raft_consensus.cc:2272] T 1fe4d60be9064db2abedb55cb715c172 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.662423   431 tablet_replica.cc:333] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.663450   431 raft_consensus.cc:2243] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.664840   431 raft_consensus.cc:2272] T 7c93bc5462474ec6bb7155abd2e93aac P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.668633   431 tablet_replica.cc:333] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.670845   431 raft_consensus.cc:2243] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.675107   431 raft_consensus.cc:2272] T 932266aa19544648a426ac5605e04ff8 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.677698  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:03:59.683595   431 tablet_replica.cc:333] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.684993   431 raft_consensus.cc:2243] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.686578   431 raft_consensus.cc:2272] T 03ff5e9bb5cd4c7590aecf8720904921 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.689236  2329 consensus_peers.cc:597] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.692204  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:59.693131  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:59.696779   431 tablet_replica.cc:333] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.698406   431 raft_consensus.cc:2243] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.700881   431 raft_consensus.cc:2272] T dbc0065dafc14741989730fd503966f0 P e8eefefed88a4903b423e9f487c4805a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.704480   431 tablet_replica.cc:333] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.706233   431 raft_consensus.cc:2243] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.707171   431 raft_consensus.cc:2272] T e0872608ab1d42e5b8f77cd6552348b3 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.710559   431 tablet_replica.cc:333] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.711694   431 raft_consensus.cc:2243] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.714603   431 raft_consensus.cc:2272] T 67e293fa644844dd93fd078b7ba39692 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.717868   431 tablet_replica.cc:333] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.718590   431 raft_consensus.cc:2243] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.719485   431 raft_consensus.cc:2272] T 91dad730840e45b68065507815614a40 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.722672   431 tablet_replica.cc:333] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.723589   431 raft_consensus.cc:2243] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.724500   431 raft_consensus.cc:2272] T 5c75c8e4f95149fba99bb9728c2f21d8 P e8eefefed88a4903b423e9f487c4805a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.727727   431 tablet_replica.cc:333] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.737632   431 raft_consensus.cc:2243] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.739274   431 raft_consensus.cc:2272] T 94b39a427ff64e86af918d4b96740100 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.742507   431 tablet_replica.cc:333] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.743458   431 raft_consensus.cc:2243] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.744855   431 raft_consensus.cc:2272] T d3d04d35de654d5a8be688548f244d88 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.747514   431 tablet_replica.cc:333] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.748214   431 raft_consensus.cc:2243] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.748984   431 raft_consensus.cc:2272] T a8b7091c66f14b4ba944785e7c8873b9 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.751843   431 tablet_replica.cc:333] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.752718   431 raft_consensus.cc:2243] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.754427   431 raft_consensus.cc:2272] T e0015d06d436447fb3ebe76172dc1798 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.756819   431 tablet_replica.cc:333] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.757516   431 raft_consensus.cc:2243] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.758584   431 raft_consensus.cc:2272] T 266184feaae1425bb1318e53e4b7d584 P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.760751   431 tablet_replica.cc:333] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.761554   431 raft_consensus.cc:2243] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.762416   431 raft_consensus.cc:2272] T fbf20d67081f4a66af2b6a3bb0145baf P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.765640   431 tablet_replica.cc:333] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.766677   431 raft_consensus.cc:2243] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.767477   431 raft_consensus.cc:2272] T 8967fd754a1f427d8138f7d6380b06c0 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.770900   431 tablet_replica.cc:333] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.771989   431 raft_consensus.cc:2243] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.772704   431 raft_consensus.cc:2272] T 16ec23ffe82f42bfad9cca928a92d9ab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.780936   431 tablet_replica.cc:333] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.781957   431 raft_consensus.cc:2243] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.782809   431 raft_consensus.cc:2272] T f09947f1336f47c4b5bffef2326f83ee P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.785765   431 tablet_replica.cc:333] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.786629   431 raft_consensus.cc:2243] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.787513   431 raft_consensus.cc:2272] T 71e3bb6ac3eb408ba9c57b48de886d65 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.790467   431 tablet_replica.cc:333] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.791402   431 raft_consensus.cc:2243] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.792281   431 raft_consensus.cc:2272] T 68971e7ff2b548529978ee5a5d55a724 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.796357   431 tablet_replica.cc:333] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.797212   431 raft_consensus.cc:2243] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.798058   431 raft_consensus.cc:2272] T f13a8325fe104b2582f097044dcef93c P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.800840   431 tablet_replica.cc:333] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.801680   431 raft_consensus.cc:2243] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.802938   431 raft_consensus.cc:2272] T f2157e4514164aedb7c5dc22acfb5ca6 P e8eefefed88a4903b423e9f487c4805a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.805720   431 tablet_replica.cc:333] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.806573   431 raft_consensus.cc:2243] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.807978   431 raft_consensus.cc:2272] T 0843e83eb535425fa9bfac75ce544e73 P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.811075   431 tablet_replica.cc:333] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.811915   431 raft_consensus.cc:2243] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.813153   431 raft_consensus.cc:2272] T 336b1cd3c29f40b094a733c275aecd2d P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.815752   431 tablet_replica.cc:333] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.816587   431 raft_consensus.cc:2243] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.817696   431 raft_consensus.cc:2272] T a8ff3d30394041dd91e5470bfd077bab P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.820663   431 tablet_replica.cc:333] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.821472   431 raft_consensus.cc:2243] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.822153   431 raft_consensus.cc:2272] T 71514c8580924feb8600dfd3daef60d8 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.825133   431 tablet_replica.cc:333] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.830204   431 raft_consensus.cc:2243] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.834789   431 raft_consensus.cc:2272] T 90b90f8e722a4f1ebab12217cf2171e1 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.842757  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.850103  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:03:59.852485  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:59.850243   431 tablet_replica.cc:333] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.856859   431 raft_consensus.cc:2243] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:03:59.867133  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:03:59.874590   431 raft_consensus.cc:2272] T b3ead97901a6414b8541e2d33f5078ac P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.878026   431 tablet_replica.cc:333] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.879048   431 raft_consensus.cc:2243] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.882417   431 raft_consensus.cc:2272] T 469f8c03f4924f809435141a09c976fa P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.886794  1580 consensus_peers.cc:597] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:03:59.896891  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:03:59.897578   431 tablet_replica.cc:333] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.903414   431 raft_consensus.cc:2243] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.904788   431 raft_consensus.cc:2272] T 12cfcd1acccf48648cff7c74ca7f4964 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.908162   431 tablet_replica.cc:333] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.920686   431 raft_consensus.cc:2243] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.924461   431 raft_consensus.cc:2272] T 84c11953e2154a45af2433ff69b8c3ca P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.927874   431 tablet_replica.cc:333] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.928798   431 raft_consensus.cc:2243] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.930183   431 raft_consensus.cc:2272] T 6d8196c0532243f8ba687a00d2857d80 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.933125   431 tablet_replica.cc:333] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.934010   431 raft_consensus.cc:2243] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.935384   431 raft_consensus.cc:2272] T ab24966f65364407bb1fe4072a40c0df P e8eefefed88a4903b423e9f487c4805a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.941707   431 tablet_replica.cc:333] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.942641   431 raft_consensus.cc:2243] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.944082   431 raft_consensus.cc:2272] T b07448991374497e87b5636471d14890 P e8eefefed88a4903b423e9f487c4805a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.947256   431 tablet_replica.cc:333] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.948128   431 raft_consensus.cc:2243] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.949379   431 raft_consensus.cc:2272] T 0a2543ffd0824f7ca2b1399af5f3b78d P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.952306   431 tablet_replica.cc:333] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.953112   431 raft_consensus.cc:2243] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.953796   431 raft_consensus.cc:2272] T 423e376b43454bf396ca57e6aad172f5 P e8eefefed88a4903b423e9f487c4805a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.956826   431 tablet_replica.cc:333] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.957614   431 raft_consensus.cc:2243] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.958334   431 raft_consensus.cc:2272] T 2e50d062d07e4a4eac4206ea9ec136cd P e8eefefed88a4903b423e9f487c4805a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.961148   431 tablet_replica.cc:333] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.961964   431 raft_consensus.cc:2243] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.963218   431 raft_consensus.cc:2272] T 5853661a3b2948fbb9b9483e9e4176a3 P e8eefefed88a4903b423e9f487c4805a [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:59.970990  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:03:59.971794   431 tablet_replica.cc:333] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.972741   431 raft_consensus.cc:2243] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.973501   431 raft_consensus.cc:2272] T c2ec497bce574477bc2b2cc694aa0637 P e8eefefed88a4903b423e9f487c4805a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.984441   431 tablet_replica.cc:333] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.985410   431 raft_consensus.cc:2243] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:59.986270   431 raft_consensus.cc:2272] T 72c7a933e3e84bcfb3f8de277043f0ab P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:59.989467   431 tablet_replica.cc:333] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:03:59.990347   431 raft_consensus.cc:2243] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:03:59.991689   431 raft_consensus.cc:2272] T c22d7a035bc946478a44cde26ad56efa P e8eefefed88a4903b423e9f487c4805a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:00.000980   431 tablet_replica.cc:333] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:04:00.001849   431 raft_consensus.cc:2243] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:00.003159   431 raft_consensus.cc:2272] T 788938c376a646979b8eee973560dc65 P e8eefefed88a4903b423e9f487c4805a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:00.006397   431 tablet_replica.cc:333] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:04:00.007381   431 raft_consensus.cc:2243] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:00.008117   431 raft_consensus.cc:2272] T 4fd446bc21be451c86d30ee76d6e6137 P e8eefefed88a4903b423e9f487c4805a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:00.011004   431 tablet_replica.cc:333] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a: stopping tablet replica
I20260709 13:04:00.011794   431 raft_consensus.cc:2243] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:00.012887   431 raft_consensus.cc:2272] T 752aab0c230943e5a7d35d3d2ff9e555 P e8eefefed88a4903b423e9f487c4805a [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:00.190428  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:00.439729  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:00.653896  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:00.675832  7509 raft_consensus.cc:493] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.676625  7509 raft_consensus.cc:515] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:00.678970  7509 leader_election.cc:290] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:00.694255  7473 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.694990  7473 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.697342  7473 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:00.700591  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:04:00.704319  2329 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.705502  2328 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:00.707434  7478 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:00.712648  7500 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.713330  7500 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.717806  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:04:00.718716  2363 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 14.
I20260709 13:04:00.720793  1653 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:04:00.721693  7470 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:00.722078  7470 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.722417  7470 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:00.715934  7500 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:00.777020  7478 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.777632  7478 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.781776  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:04:00.779960  7478 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:04:00.785808  2329 leader_election.cc:336] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.786478  2329 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:00.788628  7478 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:00.798192  1654 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:00.802261  7509 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.810061  7512 raft_consensus.cc:493] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.810304  7509 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.814025  7470 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.810910  7512 raft_consensus.cc:515] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:00.818385  7470 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:00.818882  7503 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.819809  7503 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.824522  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:04:00.825508  1686 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
W20260709 13:04:00.825887  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:00.826526  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:00.828858  7512 leader_election.cc:290] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:00.828832  7509 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:04:00.835222  1654 leader_election.cc:336] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.836725  1654 leader_election.cc:304] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:00.836167  7512 raft_consensus.cc:493] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.837700  7512 raft_consensus.cc:515] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:04:00.840736  2329 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.840914  7512 leader_election.cc:290] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:00.842361  7514 raft_consensus.cc:2749] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:04:00.850435  2329 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:00.851022  2329 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:00.844198  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70e893ad27ae41db934ba22b14642022" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:04:00.846773  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:04:00.834118  7503 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:00.852418  2363 raft_consensus.cc:3060] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:00.852010  7478 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:00.853341  2370 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:04:00.857080  7514 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.857789  7514 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.860273  2363 raft_consensus.cc:2468] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
I20260709 13:04:00.871210  7515 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.871909  7514 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:00.872745  7515 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:00.875134  1654 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.876718  7503 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.882668  7515 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:00.883533  7515 raft_consensus.cc:493] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.884334  7515 raft_consensus.cc:515] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:00.888245  7515 leader_election.cc:290] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:04:00.894853  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:00.877489  7503 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:00.903996  1654 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:00.904791  1654 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:00.905359  1654 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.905494  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
W20260709 13:04:00.906291  1654 leader_election.cc:336] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.906769  1686 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 7.
I20260709 13:04:00.908934  2328 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:04:00.909693  7515 raft_consensus.cc:493] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.909950  7478 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:00.910729  7478 raft_consensus.cc:493] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.910578  7515 raft_consensus.cc:515] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:00.911288  7478 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:00.913748  7515 leader_election.cc:290] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:00.919006  7514 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.923463  7514 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.931037  7514 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
W20260709 13:04:00.921161  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:00.932449  7503 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:04:00.933290  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:00.934089  1654 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:00.934716  1654 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:04:00.936236  1654 leader_election.cc:336] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:00.936841  1654 leader_election.cc:304] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:00.937340  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:04:00.937812  7515 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:00.938185  2363 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 15.
W20260709 13:04:00.938256  1654 leader_election.cc:336] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:00.938634  7515 raft_consensus.cc:2749] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:00.938823  1654 leader_election.cc:304] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:04:00.940182  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:00.940107  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:04:00.941350  7515 raft_consensus.cc:2749] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:04:00.946692  1654 leader_election.cc:336] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:00.947557  1654 leader_election.cc:336] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:00.948275  1654 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.948915  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:04:00.950409  1653 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:00.953933  1653 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:00.955201  7514 raft_consensus.cc:2804] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:00.955363  7515 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:00.955890  7514 raft_consensus.cc:697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:04:00.956064  7515 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:00.957659  7514 consensus_queue.cc:237] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.958595  7515 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:00.963865  1654 leader_election.cc:336] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:00.964488  1654 leader_election.cc:304] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:00.965304  7470 raft_consensus.cc:2749] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:00.972563  7478 raft_consensus.cc:515] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:00.976382  7503 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:04:00.977213  1654 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:00.993713  7503 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:00.995791  1654 leader_election.cc:336] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:00.993074  1434 catalog_manager.cc:5697] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 14 to 15, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:00.997093  1654 leader_election.cc:304] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:00.998144  7470 raft_consensus.cc:2749] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:00.998610  1654 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:00.998719  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:04:00.999446  1654 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, c98c328741aa493d87abafbf08f04944
I20260709 13:04:01.000519  7470 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:01.002278  7503 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:01.003439  2363 raft_consensus.cc:2393] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f6eecf73c1c24b5eb268b5088a3030d4 in current term 8: Already voted for candidate 9d926c10b90f452ba52d80dab6a50351 in this term.
I20260709 13:04:01.007077  1653 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: 9d926c10b90f452ba52d80dab6a50351, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.008278  7470 raft_consensus.cc:3060] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.011943  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93cfc3bb7634fb1b78c60f120616d9d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4"
I20260709 13:04:01.016741  7478 leader_election.cc:290] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:00.984788  7515 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:01.020306  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:01.022797  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:01.026715  1654 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.037806  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c93bc5462474ec6bb7155abd2e93aac" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:04:01.038762  2363 raft_consensus.cc:3060] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:04:01.040268  2329 leader_election.cc:336] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.051267  7514 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.052467  7514 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:01.055028  7514 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.055281  2363 raft_consensus.cc:2468] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 16.
I20260709 13:04:01.065336  1653 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:04:01.058287  7515 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:01.061290  7514 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.066475  7509 raft_consensus.cc:2804] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:01.067078  7509 raft_consensus.cc:697] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:04:01.066804  7514 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:01.060827  2329 leader_election.cc:336] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.069433  2329 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:01.059228  7470 raft_consensus.cc:2749] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:01.069985  7514 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:01.070767  7478 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:01.068332  7509 consensus_queue.cc:237] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:01.072177  2329 leader_election.cc:336] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.076620  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:04:01.077641  2370 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 12.
I20260709 13:04:01.081060  1653 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
W20260709 13:04:01.081732  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:01.082840  7514 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:01.083315  7514 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.083699  7514 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:01.087667  1686 raft_consensus.cc:2468] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 8.
I20260709 13:04:01.087924  7512 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.089032  7512 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:01.091275  7512 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
W20260709 13:04:01.088287  1654 leader_election.cc:336] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.094075  7514 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.099128  2328 leader_election.cc:304] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.101261  7478 raft_consensus.cc:2804] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:01.102022  7478 raft_consensus.cc:697] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Becoming Leader. State: Replica: 9d926c10b90f452ba52d80dab6a50351, State: Running, Role: LEADER
I20260709 13:04:01.103678  7478 consensus_queue.cc:237] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:01.114949  1654 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:04:01.116778  1654 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.117280  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.121199  7512 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:01.132071  7514 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:01.133158  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0843e83eb535425fa9bfac75ce544e73" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:04:01.134253  2363 raft_consensus.cc:3060] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:01.144142  7478 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.144861  7478 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.144970  7503 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.146018  7503 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.147362  7478 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.156971  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:04:01.160127  7514 raft_consensus.cc:493] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.160717  7512 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.161700  7512 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.160774  7514 raft_consensus.cc:515] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:01.166592  7514 leader_election.cc:290] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.169822  7512 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:01.174165  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:04:01.174886  2370 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 10.
I20260709 13:04:01.177088  1653 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:04:01.178166  7509 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:01.178566  7509 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.178952  7509 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:01.181270  7503 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:01.181900  7503 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.182427  7503 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.184311  7514 raft_consensus.cc:493] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.184988  7514 raft_consensus.cc:515] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:01.187798  7514 leader_election.cc:290] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.189541  7509 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.191825  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:04:01.192854  1686 raft_consensus.cc:2393] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9d926c10b90f452ba52d80dab6a50351 in current term 11: Already voted for candidate f6eecf73c1c24b5eb268b5088a3030d4 in this term.
I20260709 13:04:01.193746  2370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "336b1cd3c29f40b094a733c275aecd2d" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:04:01.194527  2370 raft_consensus.cc:3060] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:01.200214  7503 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:04:01.201527  1654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43963, user_credentials={real_user=slave}} blocked reactor thread for 71270.6us
I20260709 13:04:01.206125  2370 raft_consensus.cc:2468] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 11.
I20260709 13:04:01.207599  1653 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:04:01.212841  7509 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:01.218396  7509 raft_consensus.cc:2804] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:01.220326  7509 raft_consensus.cc:697] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:04:01.222128  7470 raft_consensus.cc:493] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.222749  7470 raft_consensus.cc:515] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:01.226110  7470 leader_election.cc:290] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.221398  7509 consensus_queue.cc:237] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:01.231644  1654 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:01.239882  2363 raft_consensus.cc:2468] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 13.
I20260709 13:04:01.243389  1653 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:04:01.245262  7512 raft_consensus.cc:2804] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:01.246286  7512 raft_consensus.cc:697] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:04:01.247627  7512 consensus_queue.cc:237] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.253728  7509 raft_consensus.cc:493] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.254860  7509 raft_consensus.cc:515] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:04:01.261188  2329 leader_election.cc:336] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:04:01.263921  1654 leader_election.cc:336] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.265466  1654 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.265991  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.267097  7514 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:01.266317  1437 catalog_manager.cc:5697] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 reported cstate change: term changed from 7 to 8, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "9d926c10b90f452ba52d80dab6a50351" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:01.270778  7509 leader_election.cc:290] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.275638  7514 raft_consensus.cc:493] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.276453  7514 raft_consensus.cc:515] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:01.281248  7503 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.282099  7503 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.284417  7515 raft_consensus.cc:493] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.284693  7470 raft_consensus.cc:493] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.285336  7515 raft_consensus.cc:515] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:01.285826  7470 raft_consensus.cc:515] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:01.287547  7515 leader_election.cc:290] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.288863  7514 leader_election.cc:290] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.290547  7470 leader_election.cc:290] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:01.290684  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "469f8c03f4924f809435141a09c976fa" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:04:01.291407  1686 raft_consensus.cc:2468] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 13.
I20260709 13:04:01.291587  7470 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.292243  7470 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.293485  7503 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:04:01.300297  2329 leader_election.cc:336] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.300909  2329 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.301666  7503 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:01.302624  2329 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.303300  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351" is_pre_election: true
I20260709 13:04:01.305584  2363 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 16.
I20260709 13:04:01.305938  7470 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:01.307088  2329 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:01.307192  1653 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:04:01.309408  7503 raft_consensus.cc:2749] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:01.309810  7509 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:04:01.310387  7509 raft_consensus.cc:493] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:01.310832  7509 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:04:01.316425  1654 leader_election.cc:336] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.317612  1654 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.318354  1654 leader_election.cc:336] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.319303  1654 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.319833  1654 leader_election.cc:336] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.321400  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:01.323127  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:01.323809  2329 leader_election.cc:336] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.324261  2329 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:01.325039  7516 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:01.330883  7512 raft_consensus.cc:493] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
W20260709 13:04:01.330909  2329 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:01.332085  7512 raft_consensus.cc:515] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:04:01.333254  2329 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.333762  2329 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.334524  7516 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:01.334604  7512 leader_election.cc:290] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051)
I20260709 13:04:01.340767  1437 catalog_manager.cc:5697] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 15 to 16, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.343112  1437 catalog_manager.cc:5697] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 10 to 11, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.346864  1437 catalog_manager.cc:5697] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 12 to 13, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.361281  7509 raft_consensus.cc:515] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:01.377839  2363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3d04d35de654d5a8be688548f244d88" candidate_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "9d926c10b90f452ba52d80dab6a50351"
I20260709 13:04:01.378548  2363 raft_consensus.cc:3060] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:04:01.386868  2363 raft_consensus.cc:2468] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6eecf73c1c24b5eb268b5088a3030d4 in term 17.
W20260709 13:04:01.374223  1654 leader_election.cc:336] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:01.389827  1654 leader_election.cc:304] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.387439  7509 leader_election.cc:290] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: Requested vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), 9d926c10b90f452ba52d80dab6a50351 (127.0.107.196:38365)
I20260709 13:04:01.391722  1653 leader_election.cc:304] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: 
I20260709 13:04:01.393122  7470 raft_consensus.cc:2749] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:04:01.394661  7470 raft_consensus.cc:2804] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:04:01.395211  7470 raft_consensus.cc:697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 LEADER]: Becoming Leader. State: Replica: f6eecf73c1c24b5eb268b5088a3030d4, State: Running, Role: LEADER
I20260709 13:04:01.396255  7470 consensus_queue.cc:237] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:01.403920  1654 leader_election.cc:336] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:01.404798  1654 leader_election.cc:304] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:04:01.406613  1654 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:01.407163  7509 raft_consensus.cc:2749] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:01.424685  1437 catalog_manager.cc:5697] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 reported cstate change: term changed from 16 to 17, leader changed from e8eefefed88a4903b423e9f487c4805a (127.0.107.194) to f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:01.424669  1654 leader_election.cc:336] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.428697  1654 leader_election.cc:304] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.429839  7470 raft_consensus.cc:2749] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:01.431298  1654 leader_election.cc:336] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.441605  1654 leader_election.cc:336] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:01.442234  1654 leader_election.cc:304] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.443131  7470 raft_consensus.cc:2749] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:01.446966  1654 leader_election.cc:336] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:04:01.447609  1654 leader_election.cc:336] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:04:01.448127  1654 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:04:01.457361  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:01.457623  2363 raft_consensus.cc:1275] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:04:01.458667  1654 leader_election.cc:336] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.459343  1654 leader_election.cc:304] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
W20260709 13:04:01.460592  1654 leader_election.cc:336] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.461109  7470 raft_consensus.cc:2749] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:01.460335  7509 consensus_queue.cc:1048] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:01.461076  1654 leader_election.cc:304] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.475046  7509 raft_consensus.cc:2749] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:01.478673  1654 leader_election.cc:336] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.479410  1654 leader_election.cc:304] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.480568  7509 raft_consensus.cc:2749] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:01.482383  1654 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.485577  1654 leader_election.cc:336] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:01.495759  1686 raft_consensus.cc:1275] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Refusing update from remote peer 9d926c10b90f452ba52d80dab6a50351: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:01.497493  7503 consensus_queue.cc:1048] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:04:01.531271  1654 leader_election.cc:336] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:01.531805  1654 leader_election.cc:304] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:01.532626  7470 raft_consensus.cc:2749] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:04:01.539443  1654 leader_election.cc:336] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:01.540656  1654 consensus_peers.cc:597] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.556721  2329 consensus_peers.cc:597] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.561342  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:01.562187  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:04:01.562253  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.566608  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:01.577965  2370 raft_consensus.cc:1275] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:01.581566  7514 consensus_queue.cc:1048] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:04:01.635625  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.657270  1654 consensus_peers.cc:597] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.671835  1654 consensus_peers.cc:597] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.672601  1654 consensus_peers.cc:597] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.679196  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:01.679822  2370 raft_consensus.cc:1275] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:04:01.680153  1654 consensus_peers.cc:597] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:01.681483  7514 consensus_queue.cc:1048] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:04:01.713913  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.727281  1654 consensus_peers.cc:597] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.745467  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.798996  1654 consensus_peers.cc:597] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.823993  2329 consensus_peers.cc:597] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.824499  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:01.836387  2370 raft_consensus.cc:1275] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:01.840459  7515 consensus_queue.cc:1048] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:01.843709  2370 raft_consensus.cc:1275] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 17 FOLLOWER]: Refusing update from remote peer f6eecf73c1c24b5eb268b5088a3030d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:04:01.851418  7512 consensus_queue.cc:1048] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:04:01.864778  2329 consensus_peers.cc:597] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.884792  1654 consensus_peers.cc:597] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:01.893007  1654 consensus_peers.cc:597] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.924815  2329 consensus_peers.cc:597] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.949534  1654 consensus_peers.cc:597] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.958242  1654 consensus_peers.cc:597] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:01.964639  1654 consensus_peers.cc:597] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:01.983888  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.040978  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.042161  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:02.050621  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.058887  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.117522  1654 consensus_peers.cc:597] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.139794  1654 consensus_peers.cc:597] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.160092  2329 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:04:02.169744  1654 consensus_peers.cc:597] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.175601  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.185987  1654 consensus_peers.cc:597] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:02.210422  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.213335  2329 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:02.213907  2329 consensus_peers.cc:597] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:02.227279  1654 consensus_peers.cc:597] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:02.231730  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.258534  2329 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111) [suppressed 609 similar messages]
I20260709 13:04:02.262140   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:04:02.278360  1654 consensus_peers.cc:597] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:04:02.278503  2329 consensus_peers.cc:597] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.352515  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:02.390618  1654 consensus_peers.cc:597] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:02.442016  1654 consensus_peers.cc:597] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 13:04:02.448443  7516 raft_consensus.cc:493] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:02.449303  7516 raft_consensus.cc:515] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:02.484723  7516 leader_election.cc:290] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:02.491629   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:04:02.496937  1686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0015d06d436447fb3ebe76172dc1798" candidate_uuid: "9d926c10b90f452ba52d80dab6a50351" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" is_pre_election: true
I20260709 13:04:02.509392  1686 raft_consensus.cc:2468] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d926c10b90f452ba52d80dab6a50351 in term 12.
W20260709 13:04:02.515108  2329 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
W20260709 13:04:02.522996  2329 leader_election.cc:336] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:02.523458  2329 leader_election.cc:304] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351, f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:02.532676  7478 raft_consensus.cc:2749] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:02.546067  2328 consensus_peers.cc:597] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.628417  1654 consensus_peers.cc:597] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:02.628824  2328 consensus_peers.cc:597] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.629372  1654 consensus_peers.cc:597] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:02.658540  1654 consensus_peers.cc:597] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:04:02.677683  7538 raft_consensus.cc:493] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:02.678714  7538 raft_consensus.cc:515] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
W20260709 13:04:02.685567  2328 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.683913  7538 leader_election.cc:290] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:02.689450   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:02.691895  1654 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:02.693397   431 tablet_replica.cc:333] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
W20260709 13:04:02.694989  1654 leader_election.cc:336] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:02.695461  1654 leader_election.cc:304] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:02.695899   431 raft_consensus.cc:2243] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.696342  7538 raft_consensus.cc:2749] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:02.699707   431 raft_consensus.cc:2272] T 23c94fd76da84decac35ba61e1d5cb3c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.704674  2328 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.708287   431 tablet_replica.cc:333] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.709597   431 raft_consensus.cc:2243] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.711818   431 raft_consensus.cc:2272] T 012a311e17a142298db5d9aa2a92c2f5 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.715660   431 tablet_replica.cc:333] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.716965   431 raft_consensus.cc:2243] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.720403   431 raft_consensus.cc:2272] T 70e893ad27ae41db934ba22b14642022 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.723873   431 tablet_replica.cc:333] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.725186   431 raft_consensus.cc:2243] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.726219   431 raft_consensus.cc:2272] T d48f4ba9b7ac4684ba28c86536416e65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.730163   431 tablet_replica.cc:333] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.731186   431 raft_consensus.cc:2243] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.732882   431 raft_consensus.cc:2272] T f8464531709643ab8a8fd947089037ef P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.736522   431 tablet_replica.cc:333] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.737331   431 raft_consensus.cc:2243] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.738158   431 raft_consensus.cc:2272] T ba63305badaf4879aab6ec160417462c P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.741842   431 tablet_replica.cc:333] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.742743   431 raft_consensus.cc:2243] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.743783   431 raft_consensus.cc:2272] T 03ff5e9bb5cd4c7590aecf8720904921 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.746344  1654 consensus_peers.cc:597] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:04:02.747354   431 tablet_replica.cc:333] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.748302   431 raft_consensus.cc:2243] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.749045   431 raft_consensus.cc:2272] T 932266aa19544648a426ac5605e04ff8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.751533   431 tablet_replica.cc:333] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.752275   431 raft_consensus.cc:2243] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.754030   431 raft_consensus.cc:2272] T a93cfc3bb7634fb1b78c60f120616d9d P f6eecf73c1c24b5eb268b5088a3030d4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.757198   431 tablet_replica.cc:333] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.758437   431 raft_consensus.cc:2243] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.761190   431 raft_consensus.cc:2272] T 1fe4d60be9064db2abedb55cb715c172 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.765720   431 tablet_replica.cc:333] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.766813   431 raft_consensus.cc:2243] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.769156   431 raft_consensus.cc:2272] T 7c93bc5462474ec6bb7155abd2e93aac P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.772742   431 tablet_replica.cc:333] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.773789   431 raft_consensus.cc:2243] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.774911   431 raft_consensus.cc:2272] T dbc0065dafc14741989730fd503966f0 P f6eecf73c1c24b5eb268b5088a3030d4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.777971   431 tablet_replica.cc:333] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.778964   431 raft_consensus.cc:2243] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.780776   431 raft_consensus.cc:2272] T 67e293fa644844dd93fd078b7ba39692 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.785041   431 tablet_replica.cc:333] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.786024   431 raft_consensus.cc:2243] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.787897   431 raft_consensus.cc:2272] T e0872608ab1d42e5b8f77cd6552348b3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.791676   431 tablet_replica.cc:333] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.792681   431 raft_consensus.cc:2243] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.794627   431 raft_consensus.cc:2272] T 91dad730840e45b68065507815614a40 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.794672  2328 consensus_peers.cc:597] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.799217   431 tablet_replica.cc:333] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.800352   431 raft_consensus.cc:2243] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.802785   431 raft_consensus.cc:2272] T fbf20d67081f4a66af2b6a3bb0145baf P f6eecf73c1c24b5eb268b5088a3030d4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.806486   431 tablet_replica.cc:333] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.807616   431 raft_consensus.cc:2243] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.811614   431 raft_consensus.cc:2272] T d3d04d35de654d5a8be688548f244d88 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.815716   431 tablet_replica.cc:333] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.816807   431 raft_consensus.cc:2243] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.818583   431 raft_consensus.cc:2272] T a8b7091c66f14b4ba944785e7c8873b9 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.822079   431 tablet_replica.cc:333] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.824997   431 raft_consensus.cc:2243] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.828536   431 raft_consensus.cc:2272] T 23137a56fb91492eb22faa7c97ee9aec P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.829712  2328 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.832115   431 tablet_replica.cc:333] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.833272   431 raft_consensus.cc:2243] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.834379   431 raft_consensus.cc:2272] T 94b39a427ff64e86af918d4b96740100 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.837875   431 tablet_replica.cc:333] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
W20260709 13:04:02.838505  2328 consensus_peers.cc:597] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.838655   431 raft_consensus.cc:2243] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.840521   431 raft_consensus.cc:2272] T 16ec23ffe82f42bfad9cca928a92d9ab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.844276   431 tablet_replica.cc:333] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.844286  7538 raft_consensus.cc:493] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:02.845506   431 raft_consensus.cc:2243] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.845161  7538 raft_consensus.cc:515] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } }
I20260709 13:04:02.847585  7538 leader_election.cc:290] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:02.850642   431 raft_consensus.cc:2272] T f09947f1336f47c4b5bffef2326f83ee P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.854985   431 tablet_replica.cc:333] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
W20260709 13:04:02.856155  1654 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:02.856652   431 raft_consensus.cc:2243] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.860443   431 raft_consensus.cc:2272] T 68971e7ff2b548529978ee5a5d55a724 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.862763  1654 leader_election.cc:336] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:02.863385  1654 leader_election.cc:304] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f6eecf73c1c24b5eb268b5088a3030d4; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:02.864122  7538 raft_consensus.cc:2749] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:02.866146   431 tablet_replica.cc:333] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.867352   431 raft_consensus.cc:2243] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.868754   431 raft_consensus.cc:2272] T 151c008abeca49c386849be63d874dca P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.872464   431 tablet_replica.cc:333] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.873349   431 raft_consensus.cc:2243] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.875304   431 raft_consensus.cc:2272] T 0843e83eb535425fa9bfac75ce544e73 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.878724   431 tablet_replica.cc:333] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.879691   431 raft_consensus.cc:2243] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.881426   431 raft_consensus.cc:2272] T 7137e5b424304fc6a6513886dd9dc135 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.885039   431 tablet_replica.cc:333] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.885947   431 raft_consensus.cc:2243] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.887202   431 raft_consensus.cc:2272] T 6d8196c0532243f8ba687a00d2857d80 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.890507   431 tablet_replica.cc:333] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.891438   431 raft_consensus.cc:2243] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.892534   431 raft_consensus.cc:2272] T 266184feaae1425bb1318e53e4b7d584 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.895862   431 tablet_replica.cc:333] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.896785   431 raft_consensus.cc:2243] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.898377   431 raft_consensus.cc:2272] T f13a8325fe104b2582f097044dcef93c P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.901494   431 tablet_replica.cc:333] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.902377   431 raft_consensus.cc:2243] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.903141   431 raft_consensus.cc:2272] T f2157e4514164aedb7c5dc22acfb5ca6 P f6eecf73c1c24b5eb268b5088a3030d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.910044   431 tablet_replica.cc:333] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.910997   431 raft_consensus.cc:2243] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.911900   431 raft_consensus.cc:2272] T b07448991374497e87b5636471d14890 P f6eecf73c1c24b5eb268b5088a3030d4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.915663   431 tablet_replica.cc:333] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.916580   431 raft_consensus.cc:2243] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.918550   431 raft_consensus.cc:2272] T 84c11953e2154a45af2433ff69b8c3ca P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.921680   431 tablet_replica.cc:333] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.922528   431 raft_consensus.cc:2243] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.924592   431 raft_consensus.cc:2272] T f38d50e761f346b8b9b49b532d70e057 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.927959   431 tablet_replica.cc:333] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.928776   431 raft_consensus.cc:2243] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.929795  7516 raft_consensus.cc:493] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:02.931089  7516 raft_consensus.cc:515] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:02.935379   431 raft_consensus.cc:2272] T c22d7a035bc946478a44cde26ad56efa P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.939123   431 tablet_replica.cc:333] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.940268   431 raft_consensus.cc:2243] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.940412  7516 leader_election.cc:290] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963)
I20260709 13:04:02.941530   431 raft_consensus.cc:2272] T 788938c376a646979b8eee973560dc65 P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.946185   431 tablet_replica.cc:333] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.947072   431 raft_consensus.cc:2243] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:02.948949  2328 consensus_peers.cc:597] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:02.949163  2329 leader_election.cc:336] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:02.949638   431 raft_consensus.cc:2272] T 08378fd70b734734992a8174ab0ecfc8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:02.950135  2329 leader_election.cc:336] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:02.950630  2329 leader_election.cc:304] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, e8eefefed88a4903b423e9f487c4805a
I20260709 13:04:02.954667   431 tablet_replica.cc:333] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.954025  7478 raft_consensus.cc:2749] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:02.955735   431 raft_consensus.cc:2243] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.957337   431 raft_consensus.cc:2272] T 7d86302e0fce4e1585ef0f1cbc65dc7a P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.960893   431 tablet_replica.cc:333] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.961833   431 raft_consensus.cc:2243] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.963766   431 raft_consensus.cc:2272] T 336b1cd3c29f40b094a733c275aecd2d P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.967214   431 tablet_replica.cc:333] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.968168   431 raft_consensus.cc:2243] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.970641   431 raft_consensus.cc:2272] T a8ff3d30394041dd91e5470bfd077bab P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.974085   431 tablet_replica.cc:333] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.974886   431 raft_consensus.cc:2243] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.975853   431 raft_consensus.cc:2272] T 71514c8580924feb8600dfd3daef60d8 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.978747   431 tablet_replica.cc:333] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.979548   431 raft_consensus.cc:2243] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.980358   431 raft_consensus.cc:2272] T 90b90f8e722a4f1ebab12217cf2171e1 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.983381   431 tablet_replica.cc:333] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.984127   431 raft_consensus.cc:2243] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:02.984973   431 raft_consensus.cc:2272] T 12cfcd1acccf48648cff7c74ca7f4964 P f6eecf73c1c24b5eb268b5088a3030d4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.987916   431 tablet_replica.cc:333] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.988744   431 raft_consensus.cc:2243] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:02.990222   431 raft_consensus.cc:2272] T b3ead97901a6414b8541e2d33f5078ac P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.993155   431 tablet_replica.cc:333] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:02.993988   431 raft_consensus.cc:2243] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:02.994195  2328 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:02.995498   431 raft_consensus.cc:2272] T 469f8c03f4924f809435141a09c976fa P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:02.999145   431 tablet_replica.cc:333] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:03.000002   431 raft_consensus.cc:2243] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.000814   431 raft_consensus.cc:2272] T 0a2543ffd0824f7ca2b1399af5f3b78d P f6eecf73c1c24b5eb268b5088a3030d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.003863   431 tablet_replica.cc:333] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:03.004609   431 raft_consensus.cc:2243] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.006094   431 raft_consensus.cc:2272] T 2e50d062d07e4a4eac4206ea9ec136cd P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.009179   431 tablet_replica.cc:333] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:03.009990   431 raft_consensus.cc:2243] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.010802   431 raft_consensus.cc:2272] T d4fad2168ccb42729f2409fbb0a88116 P f6eecf73c1c24b5eb268b5088a3030d4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.013798   431 tablet_replica.cc:333] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:03.014572   431 raft_consensus.cc:2243] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.015712   431 raft_consensus.cc:2272] T 5853661a3b2948fbb9b9483e9e4176a3 P f6eecf73c1c24b5eb268b5088a3030d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.019024   431 tablet_replica.cc:333] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:03.019747   431 raft_consensus.cc:2243] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:03.021124   431 raft_consensus.cc:2272] T c2ec497bce574477bc2b2cc694aa0637 P f6eecf73c1c24b5eb268b5088a3030d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.023824   431 tablet_replica.cc:333] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:03.024518   431 raft_consensus.cc:2243] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.025743   431 raft_consensus.cc:2272] T e0015d06d436447fb3ebe76172dc1798 P f6eecf73c1c24b5eb268b5088a3030d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:03.028807   431 tablet_replica.cc:333] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4: stopping tablet replica
I20260709 13:04:03.029423   431 raft_consensus.cc:2243] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:03.031188   431 raft_consensus.cc:2272] T 145197b092764852a509770daae94107 P f6eecf73c1c24b5eb268b5088a3030d4 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:03.085692  2328 consensus_peers.cc:597] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 -> Peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Couldn't send request to peer f6eecf73c1c24b5eb268b5088a3030d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:03.091064  2329 consensus_peers.cc:597] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 13:04:03.134262  2329 consensus_peers.cc:597] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:04:03.213653  2329 consensus_peers.cc:597] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:04:03.283955  2329 consensus_peers.cc:597] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:04:03.307811  7516 raft_consensus.cc:493] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e8eefefed88a4903b423e9f487c4805a)
I20260709 13:04:03.308861  7516 raft_consensus.cc:515] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } attrs { replace: true } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
W20260709 13:04:03.320662  2328 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38063: connect: Connection refused (error 111)
W20260709 13:04:03.321547  2329 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:03.322029  2329 leader_election.cc:304] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:03.322311  7516 leader_election.cc:290] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:03.322908  7478 raft_consensus.cc:2749] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:03.323941  2329 leader_election.cc:336] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:03.350718  2329 consensus_peers.cc:597] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:04:03.423566  2329 consensus_peers.cc:597] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:04:03.570173  2329 consensus_peers.cc:597] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:04:03.592231  2329 consensus_peers.cc:597] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
W20260709 13:04:03.811923  2329 consensus_peers.cc:597] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 -> Peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Couldn't send request to peer c98c328741aa493d87abafbf08f04944. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111). This is attempt 61: this message will repeat every 5th retry.
I20260709 13:04:03.832125  7478 raft_consensus.cc:493] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:04:03.832899  7478 raft_consensus.cc:515] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:03.839471  7478 leader_election.cc:290] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:04:03.840003  2329 leader_election.cc:336] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:03.840786  2328 leader_election.cc:336] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38063: connect: Connection refused (error 111)
I20260709 13:04:03.841238  2328 leader_election.cc:304] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:03.841972  7478 raft_consensus.cc:2749] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:03.869240   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:03.910359  7540 raft_consensus.cc:493] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:04:03.911234  7540 raft_consensus.cc:515] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:03.914892  7540 leader_election.cc:290] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:04:03.919883  2328 leader_election.cc:336] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38063: connect: Connection refused (error 111)
W20260709 13:04:03.921370  2329 leader_election.cc:336] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:03.921854  2329 leader_election.cc:304] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:03.922703  7540 raft_consensus.cc:2749] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:03.987318   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:04:04.021083  7478 raft_consensus.cc:493] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:04:04.023994  7478 raft_consensus.cc:515] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } attrs { replace: true } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:04.033751  7478 leader_election.cc:290] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:04:04.037667  2329 leader_election.cc:336] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
W20260709 13:04:04.039915  2328 leader_election.cc:336] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38063: connect: Connection refused (error 111)
I20260709 13:04:04.040457  2328 leader_election.cc:304] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:04.042968  7516 raft_consensus.cc:2749] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:04:04.046077  2329 consensus_peers.cc:597] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 -> Peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Couldn't send request to peer e8eefefed88a4903b423e9f487c4805a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:04.047520  2329 leader_election.cc:336] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:04.079432   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:04.080724   431 tablet_replica.cc:333] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.082159   431 raft_consensus.cc:2243] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.083247   431 raft_consensus.cc:2272] T 469f8c03f4924f809435141a09c976fa P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.087487   431 tablet_replica.cc:333] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.088624   431 raft_consensus.cc:2243] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.089273   431 raft_consensus.cc:2272] T d3d04d35de654d5a8be688548f244d88 P 9d926c10b90f452ba52d80dab6a50351 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.093262   431 tablet_replica.cc:333] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.094354   431 raft_consensus.cc:2243] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.094594  7516 raft_consensus.cc:493] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:04:04.095336  7516 raft_consensus.cc:515] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:04.096096   431 raft_consensus.cc:2272] T 23137a56fb91492eb22faa7c97ee9aec P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.097426  7516 leader_election.cc:290] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:04.100513   431 tablet_replica.cc:333] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
W20260709 13:04:04.101799  2329 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:04.101826   431 raft_consensus.cc:2243] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:04.103060  2328 leader_election.cc:336] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38063: connect: Connection refused (error 111)
I20260709 13:04:04.103390   431 raft_consensus.cc:2272] T e0015d06d436447fb3ebe76172dc1798 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.103536  2328 leader_election.cc:304] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:04.104359  7516 raft_consensus.cc:2749] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:04:04.106525   431 tablet_replica.cc:333] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.107340   431 raft_consensus.cc:2243] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.108754   431 raft_consensus.cc:2272] T 145197b092764852a509770daae94107 P 9d926c10b90f452ba52d80dab6a50351 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.111548   431 tablet_replica.cc:333] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.112202   431 raft_consensus.cc:2243] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.113090   431 raft_consensus.cc:2272] T d4fad2168ccb42729f2409fbb0a88116 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.115253   431 tablet_replica.cc:333] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.115978   431 raft_consensus.cc:2243] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEARNER]: Raft consensus shutting down.
I20260709 13:04:04.116535   431 pending_rounds.cc:70] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Trying to abort 1 pending ops.
I20260709 13:04:04.116881   431 pending_rounds.cc:77] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351: Aborting op as it isn't in flight: id { term: 9 index: 8 } timestamp: 7305634496566657024 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "5853661a3b2948fbb9b9483e9e4176a3" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } } new_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } attrs { replace: true } } peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: true } } } }
I20260709 13:04:04.118106   431 raft_consensus.cc:2917] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEARNER]: Aborting config change with OpId 9.8: Aborted: Op aborted
I20260709 13:04:04.118675   431 raft_consensus.cc:2889] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351 [term 9 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:04:04.119071   431 raft_consensus.cc:2272] T 5853661a3b2948fbb9b9483e9e4176a3 P 9d926c10b90f452ba52d80dab6a50351 [term 9 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:04:04.122252   431 tablet_replica.cc:333] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.122939   431 raft_consensus.cc:2243] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.123831   431 raft_consensus.cc:2272] T 08378fd70b734734992a8174ab0ecfc8 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.126592   431 tablet_replica.cc:333] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.127331   431 raft_consensus.cc:2243] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.128093   431 raft_consensus.cc:2272] T 7d86302e0fce4e1585ef0f1cbc65dc7a P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.131224   431 tablet_replica.cc:333] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.132095   431 raft_consensus.cc:2243] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.133141   431 raft_consensus.cc:2272] T 16ec23ffe82f42bfad9cca928a92d9ab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.135442   431 tablet_replica.cc:333] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.136070   431 raft_consensus.cc:2243] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.137113   431 raft_consensus.cc:2272] T 71e3bb6ac3eb408ba9c57b48de886d65 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.139946   431 tablet_replica.cc:333] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.140858   431 raft_consensus.cc:2243] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.141703   431 raft_consensus.cc:2272] T ab24966f65364407bb1fe4072a40c0df P 9d926c10b90f452ba52d80dab6a50351 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.144451   431 tablet_replica.cc:333] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.145030   431 raft_consensus.cc:2243] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.145936   431 raft_consensus.cc:2272] T a93cfc3bb7634fb1b78c60f120616d9d P 9d926c10b90f452ba52d80dab6a50351 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.148250   431 tablet_replica.cc:333] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.148818   431 raft_consensus.cc:2243] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.149678   431 raft_consensus.cc:2272] T f8464531709643ab8a8fd947089037ef P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.152757   431 tablet_replica.cc:333] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.153343   431 raft_consensus.cc:2243] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.154253   431 raft_consensus.cc:2272] T 151c008abeca49c386849be63d874dca P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.156654   431 tablet_replica.cc:333] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.157226   431 raft_consensus.cc:2243] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.158243   431 raft_consensus.cc:2272] T 72c7a933e3e84bcfb3f8de277043f0ab P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.160353   431 tablet_replica.cc:333] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.160871   431 raft_consensus.cc:2243] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.161696   431 raft_consensus.cc:2272] T f38d50e761f346b8b9b49b532d70e057 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.163758   431 tablet_replica.cc:333] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.164342   431 raft_consensus.cc:2243] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.164785   431 raft_consensus.cc:2272] T 336b1cd3c29f40b094a733c275aecd2d P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.165426  7516 raft_consensus.cc:493] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:04:04.166235  7516 raft_consensus.cc:515] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e8eefefed88a4903b423e9f487c4805a" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43963 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:04.167253   431 tablet_replica.cc:333] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.167984   431 raft_consensus.cc:2243] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.169142   431 raft_consensus.cc:2272] T 71514c8580924feb8600dfd3daef60d8 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.169174  7516 leader_election.cc:290] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
I20260709 13:04:04.173070   431 tablet_replica.cc:333] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
W20260709 13:04:04.173125  2329 leader_election.cc:336] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e8eefefed88a4903b423e9f487c4805a (127.0.107.194:43963): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43963: connect: Connection refused (error 111)
I20260709 13:04:04.174266   431 raft_consensus.cc:2243] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 LEADER]: Raft consensus shutting down.
W20260709 13:04:04.174687  2328 leader_election.cc:336] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38063: connect: Connection refused (error 111)
I20260709 13:04:04.175135  2328 leader_election.cc:304] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: e8eefefed88a4903b423e9f487c4805a, f6eecf73c1c24b5eb268b5088a3030d4
I20260709 13:04:04.175912  7516 raft_consensus.cc:2749] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:04.175979   431 raft_consensus.cc:2272] T 5c75c8e4f95149fba99bb9728c2f21d8 P 9d926c10b90f452ba52d80dab6a50351 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.179857   431 tablet_replica.cc:333] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.180826   431 raft_consensus.cc:2243] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.181810   431 raft_consensus.cc:2272] T a8ff3d30394041dd91e5470bfd077bab P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.185364   431 tablet_replica.cc:333] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.186131   431 raft_consensus.cc:2243] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.187373   431 raft_consensus.cc:2272] T d48f4ba9b7ac4684ba28c86536416e65 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.190698   431 tablet_replica.cc:333] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.191546   431 raft_consensus.cc:2243] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.192234   431 raft_consensus.cc:2272] T 7c93bc5462474ec6bb7155abd2e93aac P 9d926c10b90f452ba52d80dab6a50351 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.195446   431 tablet_replica.cc:333] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.196362   431 raft_consensus.cc:2243] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.197016   431 raft_consensus.cc:2272] T 0843e83eb535425fa9bfac75ce544e73 P 9d926c10b90f452ba52d80dab6a50351 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.200313   431 tablet_replica.cc:333] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.201210   431 raft_consensus.cc:2243] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.202279   431 raft_consensus.cc:2272] T 70e893ad27ae41db934ba22b14642022 P 9d926c10b90f452ba52d80dab6a50351 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.204536  7516 raft_consensus.cc:493] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f6eecf73c1c24b5eb268b5088a3030d4)
I20260709 13:04:04.205120  7516 raft_consensus.cc:515] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c98c328741aa493d87abafbf08f04944" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35051 } } peers { permanent_uuid: "f6eecf73c1c24b5eb268b5088a3030d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 38063 } } peers { permanent_uuid: "9d926c10b90f452ba52d80dab6a50351" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38365 } attrs { promote: false } }
I20260709 13:04:04.206079   431 tablet_replica.cc:333] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.206939   431 raft_consensus.cc:2243] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:04.207743   431 raft_consensus.cc:2272] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.208215  7516 leader_election.cc:290] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051), f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063)
W20260709 13:04:04.210428  2329 leader_election.cc:336] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:04.211573   431 tablet_replica.cc:333] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
W20260709 13:04:04.212512  2328 leader_election.cc:336] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f6eecf73c1c24b5eb268b5088a3030d4 (127.0.107.195:38063): Network error: Client connection negotiation failed: client connection to 127.0.107.195:38063: connect: Connection refused (error 111)
I20260709 13:04:04.212531   431 raft_consensus.cc:2243] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.212951  2328 leader_election.cc:304] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d926c10b90f452ba52d80dab6a50351; no voters: c98c328741aa493d87abafbf08f04944, f6eecf73c1c24b5eb268b5088a3030d4
W20260709 13:04:04.213515  2328 raft_consensus.cc:2686] T 7137e5b424304fc6a6513886dd9dc135 P 9d926c10b90f452ba52d80dab6a50351: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:04:04.214035   431 raft_consensus.cc:2272] T 752aab0c230943e5a7d35d3d2ff9e555 P 9d926c10b90f452ba52d80dab6a50351 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.217312   431 tablet_replica.cc:333] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.218026   431 raft_consensus.cc:2243] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.219247   431 raft_consensus.cc:2272] T 423e376b43454bf396ca57e6aad172f5 P 9d926c10b90f452ba52d80dab6a50351 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.222326   431 tablet_replica.cc:333] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.223003   431 raft_consensus.cc:2243] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.224280   431 raft_consensus.cc:2272] T 4fd446bc21be451c86d30ee76d6e6137 P 9d926c10b90f452ba52d80dab6a50351 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.227397   431 tablet_replica.cc:333] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351: stopping tablet replica
I20260709 13:04:04.228019   431 raft_consensus.cc:2243] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:04:04.229287   431 raft_consensus.cc:2272] T 8967fd754a1f427d8138f7d6380b06c0 P 9d926c10b90f452ba52d80dab6a50351 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:04.503873   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:04:04.577014   431 master.cc:562] Master@127.0.107.254:33773 shutting down...
W20260709 13:04:04.633288  1487 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:04:04.633713  1487 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:04:04.633939  1487 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:04:12.249435  1424 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111) [suppressed 196 similar messages]
W20260709 13:04:12.253285  1424 catalog_manager.cc:4755] TS c98c328741aa493d87abafbf08f04944 (127.0.107.193:35051): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet d3d04d35de654d5a8be688548f244d88: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35051: connect: Connection refused (error 111)
I20260709 13:04:13.365828   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:13.366961   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:13.367283   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P bd598697ff644162909af62351a1ef0b: stopping tablet replica
I20260709 13:04:13.569983   431 master.cc:584] Master@127.0.107.254:33773 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (214563 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:04:13.715680   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:33985
I20260709 13:04:13.717479   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:13.725291  7545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:13.725468  7546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:13.726293  7548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:13.727531   431 server_base.cc:1061] running on GCE node
I20260709 13:04:13.731050   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:13.731256   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:13.731456   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602253731441 us; error 0 us; skew 500 ppm
I20260709 13:04:13.732115   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:13.734702   431 webserver.cc:533] Webserver started at http://127.0.107.254:44637/ using document root <none> and password file <none>
I20260709 13:04:13.735229   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:13.735430   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:13.735719   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:13.737130   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/master-0-root/instance:
uuid: "d190d2b02b9244a7b2a41036d32bfe70"
format_stamp: "Formatted at 2026-07-09 13:04:13 on dist-test-slave-smzk"
I20260709 13:04:13.741892   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:04:13.745775  7553 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:13.746749   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:04:13.747118   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/master-0-root
uuid: "d190d2b02b9244a7b2a41036d32bfe70"
format_stamp: "Formatted at 2026-07-09 13:04:13 on dist-test-slave-smzk"
I20260709 13:04:13.747380   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:13.770959   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:13.772290   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:13.821240   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:33985
I20260709 13:04:13.821375  7604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:33985 every 8 connection(s)
I20260709 13:04:13.826138  7605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:13.839430  7605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70: Bootstrap starting.
I20260709 13:04:13.845170  7605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:13.850464  7605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70: No bootstrap required, opened a new log
I20260709 13:04:13.853056  7605 raft_consensus.cc:359] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d190d2b02b9244a7b2a41036d32bfe70" member_type: VOTER }
I20260709 13:04:13.853559  7605 raft_consensus.cc:385] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:13.853744  7605 raft_consensus.cc:740] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d190d2b02b9244a7b2a41036d32bfe70, State: Initialized, Role: FOLLOWER
I20260709 13:04:13.854446  7605 consensus_queue.cc:260] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d190d2b02b9244a7b2a41036d32bfe70" member_type: VOTER }
I20260709 13:04:13.854949  7605 raft_consensus.cc:399] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:13.855166  7605 raft_consensus.cc:493] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:13.855396  7605 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:13.860605  7605 raft_consensus.cc:515] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d190d2b02b9244a7b2a41036d32bfe70" member_type: VOTER }
I20260709 13:04:13.861196  7605 leader_election.cc:304] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d190d2b02b9244a7b2a41036d32bfe70; no voters: 
I20260709 13:04:13.862489  7605 leader_election.cc:290] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:13.863086  7608 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:13.864822  7608 raft_consensus.cc:697] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 1 LEADER]: Becoming Leader. State: Replica: d190d2b02b9244a7b2a41036d32bfe70, State: Running, Role: LEADER
I20260709 13:04:13.865610  7608 consensus_queue.cc:237] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d190d2b02b9244a7b2a41036d32bfe70" member_type: VOTER }
I20260709 13:04:13.866117  7605 sys_catalog.cc:565] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:13.873193  7609 sys_catalog.cc:455] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d190d2b02b9244a7b2a41036d32bfe70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d190d2b02b9244a7b2a41036d32bfe70" member_type: VOTER } }
I20260709 13:04:13.873956  7609 sys_catalog.cc:458] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:13.873395  7610 sys_catalog.cc:455] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d190d2b02b9244a7b2a41036d32bfe70. Latest consensus state: current_term: 1 leader_uuid: "d190d2b02b9244a7b2a41036d32bfe70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d190d2b02b9244a7b2a41036d32bfe70" member_type: VOTER } }
I20260709 13:04:13.874356  7610 sys_catalog.cc:458] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:13.876406  7615 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:13.882270  7615 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:13.886499   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:13.892694  7615 catalog_manager.cc:1383] Generated new cluster ID: a0315bb7687c44389ee17449aad953ff
I20260709 13:04:13.893002  7615 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:13.922442  7615 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:13.924081  7615 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:13.940433  7615 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70: Generated new TSK 0
I20260709 13:04:13.941164  7615 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:13.954126   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:13.963030  7626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:13.964149  7627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:13.966351  7629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:13.967648   431 server_base.cc:1061] running on GCE node
I20260709 13:04:13.970319   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:13.970593   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:13.970782   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602253970752 us; error 0 us; skew 500 ppm
I20260709 13:04:13.971379   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:13.974438   431 webserver.cc:533] Webserver started at http://127.0.107.193:34843/ using document root <none> and password file <none>
I20260709 13:04:13.975037   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:13.975272   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:13.975571   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:13.977049   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root/instance:
uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
format_stamp: "Formatted at 2026-07-09 13:04:13 on dist-test-slave-smzk"
I20260709 13:04:13.982617   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:04:13.987248  7634 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:13.988318   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:13.988735   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
format_stamp: "Formatted at 2026-07-09 13:04:13 on dist-test-slave-smzk"
I20260709 13:04:13.989046   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:14.001593   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:14.002802   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:14.004374   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:14.006908   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:14.007114   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.007437   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:14.007601   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.055143   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39365
I20260709 13:04:14.055287  7696 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39365 every 8 connection(s)
I20260709 13:04:14.061290   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:14.070333  7701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:14.071075  7702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:14.075773  7705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:14.076216   431 server_base.cc:1061] running on GCE node
I20260709 13:04:14.077781  7697 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33985
I20260709 13:04:14.078295  7697 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:14.079254  7697 heartbeater.cc:507] Master 127.0.107.254:33985 requested a full tablet report, sending...
I20260709 13:04:14.079268   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:14.079779   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:14.080013   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602254079992 us; error 0 us; skew 500 ppm
I20260709 13:04:14.080860   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:14.081885  7570 ts_manager.cc:194] Registered new tserver with Master: 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:14.083814   431 webserver.cc:533] Webserver started at http://127.0.107.194:40645/ using document root <none> and password file <none>
I20260709 13:04:14.084419   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:14.084438  7570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33702
I20260709 13:04:14.084656   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:14.085000   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:14.086527   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-1-root/instance:
uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
format_stamp: "Formatted at 2026-07-09 13:04:14 on dist-test-slave-smzk"
I20260709 13:04:14.091629   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:04:14.095683  7709 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.096845   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:14.097211   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-1-root
uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
format_stamp: "Formatted at 2026-07-09 13:04:14 on dist-test-slave-smzk"
I20260709 13:04:14.097509   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:14.109987   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:14.111470   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:14.113307   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:14.115861   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:14.116146   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:14.116395   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:14.116568   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.164391   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:43589
I20260709 13:04:14.164564  7771 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:43589 every 8 connection(s)
I20260709 13:04:14.169639   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:14.177632  7775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:14.180186  7776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:14.183336   431 server_base.cc:1061] running on GCE node
W20260709 13:04:14.184608  7778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:14.186051   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:14.186196  7772 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33985
W20260709 13:04:14.186429   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:14.186939   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602254186914 us; error 0 us; skew 500 ppm
I20260709 13:04:14.186952  7772 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:14.187800   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:14.188050  7772 heartbeater.cc:507] Master 127.0.107.254:33985 requested a full tablet report, sending...
I20260709 13:04:14.190930  7570 ts_manager.cc:194] Registered new tserver with Master: 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:14.191211   431 webserver.cc:533] Webserver started at http://127.0.107.195:35923/ using document root <none> and password file <none>
I20260709 13:04:14.191972   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:14.192256   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:14.192627   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:14.193213  7570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33712
I20260709 13:04:14.194783   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-2-root/instance:
uuid: "7873a3a04f1f4097ac2435c017ca346a"
format_stamp: "Formatted at 2026-07-09 13:04:14 on dist-test-slave-smzk"
I20260709 13:04:14.200950   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:04:14.205226  7783 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.206233   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:04:14.206518   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-2-root
uuid: "7873a3a04f1f4097ac2435c017ca346a"
format_stamp: "Formatted at 2026-07-09 13:04:14 on dist-test-slave-smzk"
I20260709 13:04:14.206795   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:14.228978   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:14.230224   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:14.231789   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:14.234318   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:14.234501   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.234824   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:14.234983   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.283381   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44219
I20260709 13:04:14.283735  7845 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44219 every 8 connection(s)
I20260709 13:04:14.288605   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:14.297638  7849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:14.300419  7850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:14.301512   431 server_base.cc:1061] running on GCE node
W20260709 13:04:14.301898  7852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:14.303232   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:14.303562   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:14.303791   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602254303771 us; error 0 us; skew 500 ppm
I20260709 13:04:14.304677   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:14.305943  7846 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33985
I20260709 13:04:14.306548  7846 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:14.307402  7846 heartbeater.cc:507] Master 127.0.107.254:33985 requested a full tablet report, sending...
I20260709 13:04:14.310038  7570 ts_manager.cc:194] Registered new tserver with Master: 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:14.310572   431 webserver.cc:533] Webserver started at http://127.0.107.196:36707/ using document root <none> and password file <none>
I20260709 13:04:14.311371   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:14.311662   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:14.312023   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:14.312326  7570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33720
I20260709 13:04:14.314543   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-3-root/instance:
uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
format_stamp: "Formatted at 2026-07-09 13:04:14 on dist-test-slave-smzk"
I20260709 13:04:14.320926   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:04:14.325906  7857 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.326994   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:04:14.327519   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-3-root
uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
format_stamp: "Formatted at 2026-07-09 13:04:14 on dist-test-slave-smzk"
I20260709 13:04:14.327915   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:14.348737   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:14.350629   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:14.352200   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:14.354820   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:14.355082   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.355347   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:14.355537   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:14.409951   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:38377
I20260709 13:04:14.410087  7919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:38377 every 8 connection(s)
I20260709 13:04:14.427428  7920 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33985
I20260709 13:04:14.427932  7920 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:14.428953  7920 heartbeater.cc:507] Master 127.0.107.254:33985 requested a full tablet report, sending...
I20260709 13:04:14.431512  7570 ts_manager.cc:194] Registered new tserver with Master: cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:14.432581   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018183386s
I20260709 13:04:14.433487  7570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33732
I20260709 13:04:14.464771  7570 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33740:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:04:14.747324  7662 tablet_service.cc:1511] Processing CreateTablet for tablet c5d149138d084c9db0b0266c1877f04f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:14.749616  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d149138d084c9db0b0266c1877f04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.749125  7660 tablet_service.cc:1511] Processing CreateTablet for tablet 598a30719fa04ef1b9c9486bacdf0e39 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:14.751480  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598a30719fa04ef1b9c9486bacdf0e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.753876  7661 tablet_service.cc:1511] Processing CreateTablet for tablet f5a5ed5a8b8146bba4818317966c6707 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:14.755900  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a5ed5a8b8146bba4818317966c6707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.769043  7883 tablet_service.cc:1511] Processing CreateTablet for tablet dca217a028ce41ac86f47980a41103f6 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:14.770678  7883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca217a028ce41ac86f47980a41103f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.770381  7884 tablet_service.cc:1511] Processing CreateTablet for tablet 598a30719fa04ef1b9c9486bacdf0e39 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:14.771708  7884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598a30719fa04ef1b9c9486bacdf0e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.769095  7885 tablet_service.cc:1511] Processing CreateTablet for tablet c5d149138d084c9db0b0266c1877f04f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:14.773263  7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d149138d084c9db0b0266c1877f04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.783275  7811 tablet_service.cc:1511] Processing CreateTablet for tablet c5d149138d084c9db0b0266c1877f04f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:14.789026  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5d149138d084c9db0b0266c1877f04f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.789937  7737 tablet_service.cc:1511] Processing CreateTablet for tablet f5a5ed5a8b8146bba4818317966c6707 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:14.791555  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a5ed5a8b8146bba4818317966c6707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.794215  7659 tablet_service.cc:1511] Processing CreateTablet for tablet e5c6a31a382c47888fc962c7a1a27921 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:14.785399  7810 tablet_service.cc:1511] Processing CreateTablet for tablet f5a5ed5a8b8146bba4818317966c6707 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:14.794554  7808 tablet_service.cc:1511] Processing CreateTablet for tablet e5c6a31a382c47888fc962c7a1a27921 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:14.787348  7809 tablet_service.cc:1511] Processing CreateTablet for tablet dca217a028ce41ac86f47980a41103f6 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:14.796998  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c6a31a382c47888fc962c7a1a27921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.799765  7882 tablet_service.cc:1511] Processing CreateTablet for tablet bb3bf96c4c6049efa4ec3725c681de10 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:14.800845  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5a5ed5a8b8146bba4818317966c6707. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.801364  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3bf96c4c6049efa4ec3725c681de10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.802433  7658 tablet_service.cc:1511] Processing CreateTablet for tablet bb3bf96c4c6049efa4ec3725c681de10 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:14.804149  7658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3bf96c4c6049efa4ec3725c681de10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.804790  7808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c6a31a382c47888fc962c7a1a27921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.807906  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca217a028ce41ac86f47980a41103f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.808449  7807 tablet_service.cc:1511] Processing CreateTablet for tablet 4cf6e495d139410392594c5345bd5306 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:14.811335  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf6e495d139410392594c5345bd5306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.814363  7736 tablet_service.cc:1511] Processing CreateTablet for tablet 598a30719fa04ef1b9c9486bacdf0e39 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:14.816025  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598a30719fa04ef1b9c9486bacdf0e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.860373  7881 tablet_service.cc:1511] Processing CreateTablet for tablet 4cf6e495d139410392594c5345bd5306 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:14.861517  7735 tablet_service.cc:1511] Processing CreateTablet for tablet dca217a028ce41ac86f47980a41103f6 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:14.862459  7881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf6e495d139410392594c5345bd5306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.863658  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dca217a028ce41ac86f47980a41103f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.866125  7940 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:14.874912  7734 tablet_service.cc:1511] Processing CreateTablet for tablet e5c6a31a382c47888fc962c7a1a27921 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:14.883105  7734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5c6a31a382c47888fc962c7a1a27921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.885941  7657 tablet_service.cc:1511] Processing CreateTablet for tablet 4cf6e495d139410392594c5345bd5306 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:14.887447  7657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cf6e495d139410392594c5345bd5306. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:14.889663  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:14.891348  7807 tablet_service.cc:1511] Processing CreateTablet for tablet 44ed68b66f2c4a59a2e1c334ec6380a5 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:14.892767  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ed68b66f2c4a59a2e1c334ec6380a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.909070  7941 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:14.909801  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 44ed68b66f2c4a59a2e1c334ec6380a5 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:14.914328  7732 tablet_service.cc:1511] Processing CreateTablet for tablet 44ed68b66f2c4a59a2e1c334ec6380a5 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:14.914898  7733 tablet_service.cc:1511] Processing CreateTablet for tablet bb3bf96c4c6049efa4ec3725c681de10 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:14.916553  7732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ed68b66f2c4a59a2e1c334ec6380a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.917282  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ed68b66f2c4a59a2e1c334ec6380a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.918166  7660 tablet_service.cc:1511] Processing CreateTablet for tablet e968d46ff0984f6b958e5378d07c3d32 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:14.919670  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968d46ff0984f6b958e5378d07c3d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.920012  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3bf96c4c6049efa4ec3725c681de10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.934119  7731 tablet_service.cc:1511] Processing CreateTablet for tablet e968d46ff0984f6b958e5378d07c3d32 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:14.935931  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968d46ff0984f6b958e5378d07c3d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.939633  7809 tablet_service.cc:1511] Processing CreateTablet for tablet e968d46ff0984f6b958e5378d07c3d32 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:14.920099  7942 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:14.944993  7882 tablet_service.cc:1511] Processing CreateTablet for tablet ffc78460a31e44259913b287fcc501a6 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:14.960117  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc78460a31e44259913b287fcc501a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.975323  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968d46ff0984f6b958e5378d07c3d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:14.976060  7943 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:14.998885  7940 tablet_bootstrap.cc:654] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.001348  7941 tablet_bootstrap.cc:654] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.066161  7943 tablet_bootstrap.cc:654] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.088105  7697 heartbeater.cc:499] Master 127.0.107.254:33985 was elected leader, sending a full tablet report...
I20260709 13:04:15.107154  7940 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:15.107909  7940 ts_tablet_manager.cc:1403] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.242s	user 0.006s	sys 0.022s
I20260709 13:04:15.111435  7940 raft_consensus.cc:359] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.122068  7940 raft_consensus.cc:385] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.125283  7659 tablet_service.cc:1511] Processing CreateTablet for tablet ffc78460a31e44259913b287fcc501a6 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:15.127260  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc78460a31e44259913b287fcc501a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.135840  7811 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0a2a6ec6a1432b9f925ef0927de924 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:15.137509  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0a2a6ec6a1432b9f925ef0927de924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.144784  7881 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0a2a6ec6a1432b9f925ef0927de924 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:15.145887  7941 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:15.146293  7881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0a2a6ec6a1432b9f925ef0927de924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.146437  7941 ts_tablet_manager.cc:1403] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.238s	user 0.042s	sys 0.045s
I20260709 13:04:15.124249  7940 raft_consensus.cc:740] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.151837  7940 consensus_queue.cc:260] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.155532  7941 raft_consensus.cc:359] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:15.156635  7941 raft_consensus.cc:385] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.157038  7941 raft_consensus.cc:740] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.158033  7941 consensus_queue.cc:260] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:15.148952  7942 tablet_bootstrap.cc:654] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.150599  7733 tablet_service.cc:1511] Processing CreateTablet for tablet ffc78460a31e44259913b287fcc501a6 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:15.160497  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc78460a31e44259913b287fcc501a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.164125  7943 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:15.164791  7943 ts_tablet_manager.cc:1403] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.189s	user 0.024s	sys 0.041s
I20260709 13:04:15.169049  7943 raft_consensus.cc:359] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.169823  7943 raft_consensus.cc:385] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.170169  7943 raft_consensus.cc:740] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.170964  7943 consensus_queue.cc:260] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.174885  7807 tablet_service.cc:1511] Processing CreateTablet for tablet b497b4caeba049e0bcdcef814028ecea (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:15.178295  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b497b4caeba049e0bcdcef814028ecea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.178457  7882 tablet_service.cc:1511] Processing CreateTablet for tablet b497b4caeba049e0bcdcef814028ecea (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:15.180181  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b497b4caeba049e0bcdcef814028ecea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.181079  7808 tablet_service.cc:1511] Processing CreateTablet for tablet c3ccaa93d3a94f34a4ab6ea95c7bb67d (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:15.181110  7880 tablet_service.cc:1511] Processing CreateTablet for tablet ff75938660e94825aaa4dc33fe595037 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:15.182760  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff75938660e94825aaa4dc33fe595037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.183461  7735 tablet_service.cc:1511] Processing CreateTablet for tablet b497b4caeba049e0bcdcef814028ecea (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:15.185021  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b497b4caeba049e0bcdcef814028ecea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.188627  7808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ccaa93d3a94f34a4ab6ea95c7bb67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.170791  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 5d0a2a6ec6a1432b9f925ef0927de924 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:15.196587  7772 heartbeater.cc:499] Master 127.0.107.254:33985 was elected leader, sending a full tablet report...
I20260709 13:04:15.178377  7660 tablet_service.cc:1511] Processing CreateTablet for tablet c3ccaa93d3a94f34a4ab6ea95c7bb67d (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:15.210887  7940 ts_tablet_manager.cc:1434] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.103s	user 0.016s	sys 0.000s
I20260709 13:04:15.211455  7941 ts_tablet_manager.cc:1434] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.065s	user 0.012s	sys 0.012s
I20260709 13:04:15.212204  7940 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:15.212625  7920 heartbeater.cc:499] Master 127.0.107.254:33985 was elected leader, sending a full tablet report...
I20260709 13:04:15.217555  7658 tablet_service.cc:1511] Processing CreateTablet for tablet ff75938660e94825aaa4dc33fe595037 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:15.218621  7734 tablet_service.cc:1511] Processing CreateTablet for tablet c3ccaa93d3a94f34a4ab6ea95c7bb67d (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:15.212770  7941 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:15.228192  7660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ccaa93d3a94f34a4ab6ea95c7bb67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.230356  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d0a2a6ec6a1432b9f925ef0927de924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.228546  7734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3ccaa93d3a94f34a4ab6ea95c7bb67d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.232681  7658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff75938660e94825aaa4dc33fe595037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.229882  7950 raft_consensus.cc:493] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.234371  7950 raft_consensus.cc:515] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.246019  7942 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:15.246578  7942 ts_tablet_manager.cc:1403] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.327s	user 0.017s	sys 0.009s
I20260709 13:04:15.227844  7943 ts_tablet_manager.cc:1434] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.062s	user 0.017s	sys 0.009s
I20260709 13:04:15.259274  7942 raft_consensus.cc:359] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.260762  7942 raft_consensus.cc:385] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.251799  7950 leader_election.cc:290] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:15.270668  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 4acc87afffa74c29bd1e7e9d5d3c207e (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:15.273329  7943 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:15.278146  7811 tablet_service.cc:1511] Processing CreateTablet for tablet 4acc87afffa74c29bd1e7e9d5d3c207e (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:15.280256  7811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4acc87afffa74c29bd1e7e9d5d3c207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.285962  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4acc87afffa74c29bd1e7e9d5d3c207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.289723  7882 tablet_service.cc:1511] Processing CreateTablet for tablet 68d8efcb62f44723b004455b1a44abbc (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:15.291500  7657 tablet_service.cc:1511] Processing CreateTablet for tablet 89b785eb056a414f897653597ab2eaf1 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:15.292908  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d8efcb62f44723b004455b1a44abbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.293071  7657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b785eb056a414f897653597ab2eaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.291702  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 68d8efcb62f44723b004455b1a44abbc (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:15.297537  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d8efcb62f44723b004455b1a44abbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.303612  7732 tablet_service.cc:1511] Processing CreateTablet for tablet 89b785eb056a414f897653597ab2eaf1 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:15.305085  7732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b785eb056a414f897653597ab2eaf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.304996  7881 tablet_service.cc:1511] Processing CreateTablet for tablet 4acc87afffa74c29bd1e7e9d5d3c207e (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:15.311888  7881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4acc87afffa74c29bd1e7e9d5d3c207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.311605  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 89b785eb056a414f897653597ab2eaf1 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:15.313162  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89b785eb056a414f897653597ab2eaf1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:15.314590  7698 tablet.cc:2406] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:15.316206  7846 heartbeater.cc:499] Master 127.0.107.254:33985 was elected leader, sending a full tablet report...
I20260709 13:04:15.316833  7883 tablet_service.cc:1511] Processing CreateTablet for tablet cc8445b7cffa4e0886197daf4d7f765e (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:15.318254  7883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8445b7cffa4e0886197daf4d7f765e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.271258  7942 raft_consensus.cc:740] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.309635  7808 tablet_service.cc:1511] Processing CreateTablet for tablet 68d8efcb62f44723b004455b1a44abbc (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:15.320755  7733 tablet_service.cc:1511] Processing CreateTablet for tablet ff75938660e94825aaa4dc33fe595037 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:15.321808  7808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68d8efcb62f44723b004455b1a44abbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.322361  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff75938660e94825aaa4dc33fe595037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.339236  7662 tablet_service.cc:1511] Processing CreateTablet for tablet cc8445b7cffa4e0886197daf4d7f765e (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:15.319492  7942 consensus_queue.cc:260] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.340025  7943 tablet_bootstrap.cc:654] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.340699  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8445b7cffa4e0886197daf4d7f765e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.342276  7735 tablet_service.cc:1511] Processing CreateTablet for tablet cc8445b7cffa4e0886197daf4d7f765e (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:15.350385  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc8445b7cffa4e0886197daf4d7f765e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.345567  7810 tablet_service.cc:1511] Processing CreateTablet for tablet 5654cc6cdd4a43588ca31774035b64ed (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:15.352952  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5654cc6cdd4a43588ca31774035b64ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.355142  7941 tablet_bootstrap.cc:654] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.364147  7656 tablet_service.cc:1511] Processing CreateTablet for tablet 5654cc6cdd4a43588ca31774035b64ed (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:15.374145  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5654cc6cdd4a43588ca31774035b64ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.375061  7737 tablet_service.cc:1511] Processing CreateTablet for tablet 4f69f4370f9c45b5a22013b2937db5fb (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:15.376509  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f69f4370f9c45b5a22013b2937db5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.384688  7806 tablet_service.cc:1511] Processing CreateTablet for tablet 4f69f4370f9c45b5a22013b2937db5fb (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:15.386124  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f69f4370f9c45b5a22013b2937db5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.394147  7885 tablet_service.cc:1511] Processing CreateTablet for tablet 4f69f4370f9c45b5a22013b2937db5fb (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:15.395584  7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f69f4370f9c45b5a22013b2937db5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.402513  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:15.404928  7635 leader_election.cc:343] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.413560  7940 tablet_bootstrap.cc:654] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.422609  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 5654cc6cdd4a43588ca31774035b64ed (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:15.424413  7943 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:15.427385  7943 ts_tablet_manager.cc:1403] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.004s
I20260709 13:04:15.424472  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5654cc6cdd4a43588ca31774035b64ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.445088  7942 ts_tablet_manager.cc:1434] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.198s	user 0.012s	sys 0.024s
I20260709 13:04:15.446378  7948 raft_consensus.cc:493] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.447103  7948 raft_consensus.cc:515] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:15.467005  7659 tablet_service.cc:1511] Processing CreateTablet for tablet db9df6f7183e4b2eb63befcccb8c2fa3 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:15.468341  7941 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:15.468606  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9df6f7183e4b2eb63befcccb8c2fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.469185  7941 ts_tablet_manager.cc:1403] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.257s	user 0.017s	sys 0.000s
I20260709 13:04:15.478091  7940 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:15.478845  7940 ts_tablet_manager.cc:1403] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.267s	user 0.022s	sys 0.008s
I20260709 13:04:15.481598  7942 tablet_bootstrap.cc:492] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:15.495971  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:15.496974  7747 raft_consensus.cc:2468] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:15.498783  7636 leader_election.cc:304] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:15.500262  7950 raft_consensus.cc:2804] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:15.500736  7950 raft_consensus.cc:493] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.501219  7950 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.502363  7943 raft_consensus.cc:359] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.503364  7943 raft_consensus.cc:385] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.503762  7943 raft_consensus.cc:740] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.504475  7942 tablet_bootstrap.cc:654] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.504876  7943 consensus_queue.cc:260] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.512300  7948 leader_election.cc:290] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:15.513480  7943 ts_tablet_manager.cc:1434] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.086s	user 0.011s	sys 0.011s
I20260709 13:04:15.520010  7943 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:15.545324  7949 raft_consensus.cc:493] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.546037  7949 raft_consensus.cc:515] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.500355  7941 raft_consensus.cc:359] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.552503  7949 leader_election.cc:290] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:15.548939  7941 raft_consensus.cc:385] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.574997  7810 tablet_service.cc:1511] Processing CreateTablet for tablet db9df6f7183e4b2eb63befcccb8c2fa3 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:15.577005  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9df6f7183e4b2eb63befcccb8c2fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.576937  7940 raft_consensus.cc:359] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.577998  7940 raft_consensus.cc:385] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.578307  7940 raft_consensus.cc:740] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.579334  7940 consensus_queue.cc:260] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.558892  7941 raft_consensus.cc:740] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.560918  7731 tablet_service.cc:1511] Processing CreateTablet for tablet db9df6f7183e4b2eb63befcccb8c2fa3 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:15.613930  7882 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9465bf05df47b988f23dac9f545177 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:15.615329  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9df6f7183e4b2eb63befcccb8c2fa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.616149  7953 raft_consensus.cc:493] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.616699  7953 raft_consensus.cc:515] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.603442  7941 consensus_queue.cc:260] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.615463  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9465bf05df47b988f23dac9f545177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.625448  7953 leader_election.cc:290] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:15.636711  7658 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9465bf05df47b988f23dac9f545177 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:15.645495  7658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9465bf05df47b988f23dac9f545177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.638195  7950 raft_consensus.cc:515] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.651283  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:15.651998  7895 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.640232  7941 ts_tablet_manager.cc:1434] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.171s	user 0.011s	sys 0.000s
I20260709 13:04:15.655797  7737 tablet_service.cc:1511] Processing CreateTablet for tablet 7d9465bf05df47b988f23dac9f545177 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:15.658023  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d9465bf05df47b988f23dac9f545177. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.661679  7941 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:15.664167  7950 leader_election.cc:290] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:15.677749  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:15.678653  7747 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:15.671748  7943 tablet_bootstrap.cc:654] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.683365  7941 tablet_bootstrap.cc:654] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.674810  7895 raft_consensus.cc:2468] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:15.686951  7942 tablet_bootstrap.cc:492] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:15.689356  7810 tablet_service.cc:1511] Processing CreateTablet for tablet bda007baac86482589feb8c8a9761337 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:15.693315  7881 tablet_service.cc:1511] Processing CreateTablet for tablet bda007baac86482589feb8c8a9761337 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:15.696875  7635 leader_election.cc:304] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:15.705014  7942 ts_tablet_manager.cc:1403] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.224s	user 0.028s	sys 0.015s
I20260709 13:04:15.711230  7940 ts_tablet_manager.cc:1434] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.232s	user 0.013s	sys 0.000s
I20260709 13:04:15.712585  7881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda007baac86482589feb8c8a9761337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.712602  7940 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:15.715147  7659 tablet_service.cc:1511] Processing CreateTablet for tablet bda007baac86482589feb8c8a9761337 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:15.720067  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda007baac86482589feb8c8a9761337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.721997  7968 raft_consensus.cc:2804] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:15.724026  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda007baac86482589feb8c8a9761337. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.729130  7968 raft_consensus.cc:697] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:15.731272  7942 raft_consensus.cc:359] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:15.732138  7942 raft_consensus.cc:385] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.732471  7942 raft_consensus.cc:740] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.733181  7808 tablet_service.cc:1511] Processing CreateTablet for tablet 78b1fb849b894694b44d527478e929ad (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:15.736075  7808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b1fb849b894694b44d527478e929ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.739269  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3bf96c4c6049efa4ec3725c681de10" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:15.739765  7883 tablet_service.cc:1511] Processing CreateTablet for tablet 78b1fb849b894694b44d527478e929ad (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:15.741176  7883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b1fb849b894694b44d527478e929ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.735759  7968 consensus_queue.cc:237] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:15.742120  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3bf96c4c6049efa4ec3725c681de10" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:15.741206  7860 leader_election.cc:343] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:15.746734  7859 leader_election.cc:343] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.733240  7942 consensus_queue.cc:260] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:15.750509  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 78b1fb849b894694b44d527478e929ad (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:15.753680  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b1fb849b894694b44d527478e929ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.753468  7859 leader_election.cc:304] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:15.757257  7948 raft_consensus.cc:2749] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.762225  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a5ed5a8b8146bba4818317966c6707" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:15.762279  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a5ed5a8b8146bba4818317966c6707" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:15.767168  7747 raft_consensus.cc:2468] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:15.769815  7942 ts_tablet_manager.cc:1434] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:04:15.770166  7656 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa1517a5fc74d25bb5d1b3fa8947cb5 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:04:15.773281  7713 leader_election.cc:343] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.774111  7942 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:15.774283  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa1517a5fc74d25bb5d1b3fa8947cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.777731  7943 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:15.778344  7943 ts_tablet_manager.cc:1403] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.259s	user 0.019s	sys 0.000s
I20260709 13:04:15.802386  7943 raft_consensus.cc:359] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:15.803351  7943 raft_consensus.cc:385] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.803702  7943 raft_consensus.cc:740] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
W20260709 13:04:15.806864  7712 leader_election.cc:343] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.808535  7712 leader_election.cc:304] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:15.813653  7943 consensus_queue.cc:260] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:15.813011  7940 tablet_bootstrap.cc:654] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.816988  7943 ts_tablet_manager.cc:1434] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.000s
I20260709 13:04:15.818435  7806 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa1517a5fc74d25bb5d1b3fa8947cb5 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:15.827121  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa1517a5fc74d25bb5d1b3fa8947cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.825567  7949 raft_consensus.cc:2749] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.835989  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 00461ff939684b6fb3967bed0ebf0cd7 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:15.836229  7568 catalog_manager.cc:5697] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:15.837496  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00461ff939684b6fb3967bed0ebf0cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.844611  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 00461ff939684b6fb3967bed0ebf0cd7 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:15.846239  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00461ff939684b6fb3967bed0ebf0cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.852887  7941 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:15.853536  7941 ts_tablet_manager.cc:1403] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.192s	user 0.023s	sys 0.001s
I20260709 13:04:15.853773  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf6e495d139410392594c5345bd5306" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
W20260709 13:04:15.855767  7786 leader_election.cc:343] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.863618  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf6e495d139410392594c5345bd5306" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:15.867676  7784 leader_election.cc:343] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.868551  7784 leader_election.cc:304] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:15.869204  7941 raft_consensus.cc:359] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.869807  7953 raft_consensus.cc:2749] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.870347  7941 raft_consensus.cc:385] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.870823  7941 raft_consensus.cc:740] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.882563  7942 tablet_bootstrap.cc:654] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.883066  7940 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:15.885084  7940 ts_tablet_manager.cc:1403] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.172s	user 0.019s	sys 0.023s
I20260709 13:04:15.885898  7809 tablet_service.cc:1511] Processing CreateTablet for tablet d6de6b4220944748b4c901c3f0e50bfe (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:15.889103  7940 raft_consensus.cc:359] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.889417  7885 tablet_service.cc:1511] Processing CreateTablet for tablet d6de6b4220944748b4c901c3f0e50bfe (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:15.890036  7940 raft_consensus.cc:385] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.891053  7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6de6b4220944748b4c901c3f0e50bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.876098  7943 tablet_bootstrap.cc:492] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:15.891873  7656 tablet_service.cc:1511] Processing CreateTablet for tablet d6de6b4220944748b4c901c3f0e50bfe (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:15.897673  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6de6b4220944748b4c901c3f0e50bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.896875  7940 raft_consensus.cc:740] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.904855  7940 consensus_queue.cc:260] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.911970  7807 tablet_service.cc:1511] Processing CreateTablet for tablet 7f531d2e532f4a488a87413159704294 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:15.896977  7941 consensus_queue.cc:260] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.913658  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f531d2e532f4a488a87413159704294. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:15.898331  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:15.913625  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 7f531d2e532f4a488a87413159704294 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:15.919956  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f531d2e532f4a488a87413159704294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.915890  7941 ts_tablet_manager.cc:1434] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.002s
W20260709 13:04:15.917186  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 110603us
I20260709 13:04:15.930462  7731 tablet_service.cc:1511] Processing CreateTablet for tablet 00461ff939684b6fb3967bed0ebf0cd7 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:15.930809  7968 raft_consensus.cc:493] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.927112  7737 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa1517a5fc74d25bb5d1b3fa8947cb5 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:15.927889  7940 ts_tablet_manager.cc:1434] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 13:04:15.926507  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6de6b4220944748b4c901c3f0e50bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.942188  7940 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:15.929262  7658 tablet_service.cc:1511] Processing CreateTablet for tablet 2887a0ab539d41ecba648e3621ce28a0 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:15.943675  7943 tablet_bootstrap.cc:654] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:15.937768  7731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00461ff939684b6fb3967bed0ebf0cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.944904  7658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2887a0ab539d41ecba648e3621ce28a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.947530  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa1517a5fc74d25bb5d1b3fa8947cb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.948371  7968 raft_consensus.cc:515] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.951674  7968 leader_election.cc:290] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:15.942282  7734 tablet_service.cc:1511] Processing CreateTablet for tablet 7f531d2e532f4a488a87413159704294 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:15.953251  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c6a31a382c47888fc962c7a1a27921" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:15.954802  7734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f531d2e532f4a488a87413159704294. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:15.956496  7636 leader_election.cc:343] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.924985  7941 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:15.972926  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c6a31a382c47888fc962c7a1a27921" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:15.975270  7638 leader_election.cc:343] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:15.976070  7638 leader_election.cc:304] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:15.977310  7735 tablet_service.cc:1511] Processing CreateTablet for tablet 2887a0ab539d41ecba648e3621ce28a0 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:15.981694  7942 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:15.982251  7735 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2887a0ab539d41ecba648e3621ce28a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.982604  7942 ts_tablet_manager.cc:1403] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.209s	user 0.000s	sys 0.020s
I20260709 13:04:15.984409  7968 raft_consensus.cc:2749] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:15.989588  7942 raft_consensus.cc:359] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.991186  7942 raft_consensus.cc:385] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:15.991729  7942 raft_consensus.cc:740] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:15.993341  7942 consensus_queue.cc:260] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:15.998621  7808 tablet_service.cc:1511] Processing CreateTablet for tablet 2887a0ab539d41ecba648e3621ce28a0 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:16.001046  7808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2887a0ab539d41ecba648e3621ce28a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:15.969642  7941 tablet_bootstrap.cc:654] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.010677  7940 tablet_bootstrap.cc:654] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.015512  7882 tablet_service.cc:1511] Processing CreateTablet for tablet e96bceeac5554814ab33aee056d166c2 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:16.019351  7661 tablet_service.cc:1511] Processing CreateTablet for tablet e96bceeac5554814ab33aee056d166c2 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:16.023667  7953 raft_consensus.cc:493] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.029873  7953 raft_consensus.cc:515] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.040102  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96bceeac5554814ab33aee056d166c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.042373  7953 leader_election.cc:290] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:16.046814  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96bceeac5554814ab33aee056d166c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.047147  7806 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec80c3084b643f3a77a25d471dace7f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:16.052156  7733 tablet_service.cc:1511] Processing CreateTablet for tablet e96bceeac5554814ab33aee056d166c2 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:16.055110  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96bceeac5554814ab33aee056d166c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.061723  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec80c3084b643f3a77a25d471dace7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.067023  7883 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec80c3084b643f3a77a25d471dace7f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:16.069463  7883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec80c3084b643f3a77a25d471dace7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.082898  7943 tablet_bootstrap.cc:492] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:16.083639  7943 ts_tablet_manager.cc:1403] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.227s	user 0.016s	sys 0.011s
I20260709 13:04:16.090929  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec80c3084b643f3a77a25d471dace7f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:16.094921  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec80c3084b643f3a77a25d471dace7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.095058  7732 tablet_service.cc:1511] Processing CreateTablet for tablet 0287ecd0addf408bbf1e25813f68a5df (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:16.097240  7732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287ecd0addf408bbf1e25813f68a5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.097890  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:16.099900  7785 leader_election.cc:343] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.095189  7943 raft_consensus.cc:359] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.102530  7943 raft_consensus.cc:385] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.102854  7943 raft_consensus.cc:740] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.108208  7810 tablet_service.cc:1511] Processing CreateTablet for tablet 0287ecd0addf408bbf1e25813f68a5df (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:16.109791  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287ecd0addf408bbf1e25813f68a5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.124956  7882 tablet_service.cc:1511] Processing CreateTablet for tablet 0287ecd0addf408bbf1e25813f68a5df (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:16.126807  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0287ecd0addf408bbf1e25813f68a5df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.128346  7943 consensus_queue.cc:260] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.144480  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:16.146129  7662 tablet_service.cc:1511] Processing CreateTablet for tablet c5e8e2d38d164dcfbef72067d4328f65 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:16.147601  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e8e2d38d164dcfbef72067d4328f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.155074  7953 raft_consensus.cc:493] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.155192  7973 raft_consensus.cc:493] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.155771  7953 raft_consensus.cc:515] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.156716  7973 raft_consensus.cc:515] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:16.159762  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a5ed5a8b8146bba4818317966c6707" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:16.160080  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a5ed5a8b8146bba4818317966c6707" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:16.160573  7747 raft_consensus.cc:2468] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:16.160826  7943 ts_tablet_manager.cc:1434] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.002s
I20260709 13:04:16.162047  7953 leader_election.cc:290] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:16.156716  7736 tablet_service.cc:1511] Processing CreateTablet for tablet c5e8e2d38d164dcfbef72067d4328f65 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:16.163744  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e8e2d38d164dcfbef72067d4328f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.161890  7785 leader_election.cc:304] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:16.168622  7973 leader_election.cc:290] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:16.169771  7786 leader_election.cc:343] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.172299  7953 raft_consensus.cc:2804] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:16.172884  7953 raft_consensus.cc:493] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.173318  7953 raft_consensus.cc:3060] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.179802  7942 ts_tablet_manager.cc:1434] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.196s	user 0.011s	sys 0.009s
I20260709 13:04:16.182039  7942 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:16.182691  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3bf96c4c6049efa4ec3725c681de10" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
W20260709 13:04:16.184845  7712 leader_election.cc:343] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.184938  7943 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:16.199667  7807 tablet_service.cc:1511] Processing CreateTablet for tablet c5e8e2d38d164dcfbef72067d4328f65 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:16.202724  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e8e2d38d164dcfbef72067d4328f65. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:16.190984  7784 leader_election.cc:343] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.208546  7784 leader_election.cc:304] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:16.209640  7979 raft_consensus.cc:2749] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:16.218160  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3bf96c4c6049efa4ec3725c681de10" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:16.218986  7895 raft_consensus.cc:2468] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:16.220808  7710 leader_election.cc:304] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:16.221805  7973 raft_consensus.cc:2804] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:16.222291  7973 raft_consensus.cc:493] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.222635  7973 raft_consensus.cc:3060] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.207836  7943 tablet_bootstrap.cc:654] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.227242  7942 tablet_bootstrap.cc:654] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.233791  7968 consensus_queue.cc:1048] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.237233  7885 tablet_service.cc:1511] Processing CreateTablet for tablet a1d7a48d13f746369b2ee192d52214bc (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 13:04:16.256376  7556 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 47868.6us
W20260709 13:04:16.247426  7555 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 48127.7us
I20260709 13:04:16.260313  7659 tablet_service.cc:1511] Processing CreateTablet for tablet a1d7a48d13f746369b2ee192d52214bc (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:16.261878  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d7a48d13f746369b2ee192d52214bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.273336  7973 raft_consensus.cc:515] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:16.278153  7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d7a48d13f746369b2ee192d52214bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.278375  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3bf96c4c6049efa4ec3725c681de10" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:16.279160  7895 raft_consensus.cc:3060] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.280431  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3bf96c4c6049efa4ec3725c681de10" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
W20260709 13:04:16.282326  7712 leader_election.cc:343] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.283667  7953 raft_consensus.cc:515] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.287559  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a5ed5a8b8146bba4818317966c6707" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:16.288339  7746 raft_consensus.cc:3060] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.289208  7953 leader_election.cc:290] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:16.289855  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a5ed5a8b8146bba4818317966c6707" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
W20260709 13:04:16.293609  7786 leader_election.cc:343] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.299750  7948 raft_consensus.cc:493] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.306850  7948 raft_consensus.cc:515] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.308753  7883 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfb59fc67914cce94336c08b2fa4e19 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:16.310643  7883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfb59fc67914cce94336c08b2fa4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.310776  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d149138d084c9db0b0266c1877f04f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:16.311637  7672 raft_consensus.cc:2468] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:16.313155  7860 leader_election.cc:304] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:16.314684  7941 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:16.315275  7941 ts_tablet_manager.cc:1403] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.392s	user 0.017s	sys 0.006s
I20260709 13:04:16.317299  7734 tablet_service.cc:1511] Processing CreateTablet for tablet a1d7a48d13f746369b2ee192d52214bc (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:16.318670  7734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1d7a48d13f746369b2ee192d52214bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.318980  7948 leader_election.cc:290] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:16.319705  7948 raft_consensus.cc:2804] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:16.320096  7948 raft_consensus.cc:493] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.320441  7948 raft_consensus.cc:3060] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.325809  7656 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfb59fc67914cce94336c08b2fa4e19 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:16.328852  7895 raft_consensus.cc:2468] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:16.296689  7973 leader_election.cc:290] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:16.332738  7968 consensus_queue.cc:1048] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:16.333355  7810 tablet_service.cc:1511] Processing CreateTablet for tablet 0911fc9d471948a3878933bd85d9b5e9 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:16.334789  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911fc9d471948a3878933bd85d9b5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.346819  7940 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:16.347502  7940 ts_tablet_manager.cc:1403] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.406s	user 0.007s	sys 0.015s
I20260709 13:04:16.347219  7737 tablet_service.cc:1511] Processing CreateTablet for tablet 0911fc9d471948a3878933bd85d9b5e9 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:16.348790  7737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911fc9d471948a3878933bd85d9b5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.343127  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfb59fc67914cce94336c08b2fa4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.331591  7941 raft_consensus.cc:359] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:16.362802  7807 tablet_service.cc:1511] Processing CreateTablet for tablet 1dfb59fc67914cce94336c08b2fa4e19 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:16.363895  7942 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:16.364493  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dfb59fc67914cce94336c08b2fa4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.364523  7942 ts_tablet_manager.cc:1403] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.183s	user 0.019s	sys 0.019s
I20260709 13:04:16.377774  7941 raft_consensus.cc:385] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.409616  7732 tablet_service.cc:1511] Processing CreateTablet for tablet fce1a8da8e024329904347c281ae405a (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:16.410020  7661 tablet_service.cc:1511] Processing CreateTablet for tablet fce1a8da8e024329904347c281ae405a (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:16.411551  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce1a8da8e024329904347c281ae405a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.409616  7806 tablet_service.cc:1511] Processing CreateTablet for tablet fce1a8da8e024329904347c281ae405a (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:16.415472  7948 raft_consensus.cc:515] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.411562  7732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce1a8da8e024329904347c281ae405a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.417094  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fce1a8da8e024329904347c281ae405a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.418381  7948 leader_election.cc:290] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:16.390797  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 77720.4us
I20260709 13:04:16.432750  7710 leader_election.cc:304] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:16.433851  7973 raft_consensus.cc:2804] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.433996  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d149138d084c9db0b0266c1877f04f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:16.434278  7746 raft_consensus.cc:2468] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:16.434525  7973 raft_consensus.cc:697] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:16.434713  7672 raft_consensus.cc:3060] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.435670  7973 consensus_queue.cc:237] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:16.376762  7942 raft_consensus.cc:359] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.399679  7941 raft_consensus.cc:740] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.393184  7940 raft_consensus.cc:359] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:16.453222  7942 raft_consensus.cc:385] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.457398  7672 raft_consensus.cc:2468] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:16.465206  7785 leader_election.cc:304] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:16.469364  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 82d30e47b0db4941b31196032e1bbe62 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:16.457885  7940 raft_consensus.cc:385] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.469589  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 82d30e47b0db4941b31196032e1bbe62 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:16.478797  7860 leader_election.cc:304] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:16.484797  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 82d30e47b0db4941b31196032e1bbe62 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:16.502887  7948 raft_consensus.cc:2804] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.503371  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d30e47b0db4941b31196032e1bbe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.505831  7885 tablet_service.cc:1511] Processing CreateTablet for tablet 54d5fb6202ad4fb1b17b5bd822d19b47 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:16.485461  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 54d5fb6202ad4fb1b17b5bd822d19b47 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:16.509811  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d5fb6202ad4fb1b17b5bd822d19b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.511207  7943 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:16.479411  7953 raft_consensus.cc:2804] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.471832  7882 tablet_service.cc:1511] Processing CreateTablet for tablet 0911fc9d471948a3878933bd85d9b5e9 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:16.512501  7953 raft_consensus.cc:697] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:16.513008  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0911fc9d471948a3878933bd85d9b5e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.513427  7953 consensus_queue.cc:237] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.488381  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d30e47b0db4941b31196032e1bbe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.516295  7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d5fb6202ad4fb1b17b5bd822d19b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.489113  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82d30e47b0db4941b31196032e1bbe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.511982  7943 ts_tablet_manager.cc:1403] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.327s	user 0.008s	sys 0.017s
I20260709 13:04:16.489461  7569 catalog_manager.cc:5697] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.497947  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d149138d084c9db0b0266c1877f04f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:16.499035  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d149138d084c9db0b0266c1877f04f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
W20260709 13:04:16.523253  7861 leader_election.cc:343] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:16.531529  7861 leader_election.cc:343] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.474900  7940 raft_consensus.cc:740] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.468263  7942 raft_consensus.cc:740] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.532648  7948 raft_consensus.cc:697] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:16.468815  7941 consensus_queue.cc:260] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:16.539332  7986 raft_consensus.cc:493] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.539580  7948 consensus_queue.cc:237] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.539917  7986 raft_consensus.cc:515] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:16.545742  7941 ts_tablet_manager.cc:1434] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.230s	user 0.013s	sys 0.002s
I20260709 13:04:16.547283  7941 tablet_bootstrap.cc:492] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:16.548585  7986 leader_election.cc:290] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:16.550621  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf6e495d139410392594c5345bd5306" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:16.550832  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf6e495d139410392594c5345bd5306" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:16.551865  7820 raft_consensus.cc:2468] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
W20260709 13:04:16.552485  7860 leader_election.cc:343] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.553936  7861 leader_election.cc:304] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:16.555646  7986 raft_consensus.cc:2804] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:16.556197  7986 raft_consensus.cc:493] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.556634  7986 raft_consensus.cc:3060] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.560685  7940 consensus_queue.cc:260] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:16.565101  7940 ts_tablet_manager.cc:1434] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.217s	user 0.008s	sys 0.005s
I20260709 13:04:16.566649  7940 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:16.571982  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 54d5fb6202ad4fb1b17b5bd822d19b47 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:16.574012  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54d5fb6202ad4fb1b17b5bd822d19b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.574963  7570 catalog_manager.cc:5697] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:16.580875  7942 consensus_queue.cc:260] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.596112  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5b29cc10794a339c482492d5fbaa75 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:16.598119  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5b29cc10794a339c482492d5fbaa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.601941  7973 raft_consensus.cc:493] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.602600  7973 raft_consensus.cc:515] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.603550  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5b29cc10794a339c482492d5fbaa75 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:16.605039  7973 leader_election.cc:290] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:16.606065  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed68b66f2c4a59a2e1c334ec6380a5" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:16.606335  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed68b66f2c4a59a2e1c334ec6380a5" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:16.608201  7713 leader_election.cc:343] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:16.609198  7710 leader_election.cc:343] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.609768  7710 leader_election.cc:304] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:16.610765  7973 raft_consensus.cc:2749] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:16.616640  7942 ts_tablet_manager.cc:1434] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.244s	user 0.007s	sys 0.007s
I20260709 13:04:16.605055  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5b29cc10794a339c482492d5fbaa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.618006  7942 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:16.627238  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 7e5b29cc10794a339c482492d5fbaa75 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:16.629339  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e5b29cc10794a339c482492d5fbaa75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.637382  7943 raft_consensus.cc:359] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.638325  7943 raft_consensus.cc:385] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.638670  7943 raft_consensus.cc:740] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.640691  7992 raft_consensus.cc:493] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.641508  7992 raft_consensus.cc:515] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:16.645669  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3bf96c4c6049efa4ec3725c681de10" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:16.645828  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 33813684ca014951b1442b91c51b0c2f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:16.646607  7895 raft_consensus.cc:2393] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:16.647722  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33813684ca014951b1442b91c51b0c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.652827  7992 leader_election.cc:290] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:16.653270  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3bf96c4c6049efa4ec3725c681de10" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:16.655351  7636 leader_election.cc:304] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:16.657933  7992 raft_consensus.cc:3060] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.658776  7942 tablet_bootstrap.cc:654] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.667768  7734 tablet_service.cc:1511] Processing CreateTablet for tablet 33813684ca014951b1442b91c51b0c2f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:16.669390  7734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33813684ca014951b1442b91c51b0c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.675223  7941 tablet_bootstrap.cc:654] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.678721  7940 tablet_bootstrap.cc:654] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.680012  7986 raft_consensus.cc:515] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:16.684721  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf6e495d139410392594c5345bd5306" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:16.685146  7992 raft_consensus.cc:2749] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:16.685454  7820 raft_consensus.cc:3060] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.660202  7569 catalog_manager.cc:5697] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.681011  7943 consensus_queue.cc:260] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.694381  7986 leader_election.cc:290] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:16.695621  7943 ts_tablet_manager.cc:1434] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.176s	user 0.008s	sys 0.002s
I20260709 13:04:16.695870  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf6e495d139410392594c5345bd5306" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:16.703620  7942 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
W20260709 13:04:16.708492  7860 leader_election.cc:343] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:16.708884  7820 raft_consensus.cc:2468] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:16.717586  7861 leader_election.cc:304] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:16.714248  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 33813684ca014951b1442b91c51b0c2f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:16.715534  7943 tablet_bootstrap.cc:492] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:16.721668  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33813684ca014951b1442b91c51b0c2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.721940  7986 raft_consensus.cc:2804] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.724020  7942 ts_tablet_manager.cc:1403] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.106s	user 0.009s	sys 0.005s
I20260709 13:04:16.730250  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6bac98b41745fab1ce373328ca0c8b (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:16.730250  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6bac98b41745fab1ce373328ca0c8b (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:16.731144  7941 tablet_bootstrap.cc:492] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:16.732374  7986 raft_consensus.cc:697] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:16.738991  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc0069dd6948f0979c733fd0ac5343 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:16.734449  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6bac98b41745fab1ce373328ca0c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.735005  7806 tablet_service.cc:1511] Processing CreateTablet for tablet bc39bf2ad6844beb8466b427508830f9 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:16.734931  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6bac98b41745fab1ce373328ca0c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.749195  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc39bf2ad6844beb8466b427508830f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.750126  7732 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb13ccbedb42ada1f3add822434eab (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:16.751293  7943 tablet_bootstrap.cc:654] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.754725  7942 raft_consensus.cc:359] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.738020  7656 tablet_service.cc:1511] Processing CreateTablet for tablet bc39bf2ad6844beb8466b427508830f9 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:16.740900  7807 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc0069dd6948f0979c733fd0ac5343 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:16.757066  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc0069dd6948f0979c733fd0ac5343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.757488  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc39bf2ad6844beb8466b427508830f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.755550  7942 raft_consensus.cc:385] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.739293  7986 consensus_queue.cc:237] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:16.743623  7883 tablet_service.cc:1511] Processing CreateTablet for tablet 25fc0069dd6948f0979c733fd0ac5343 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:16.759316  7942 raft_consensus.cc:740] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.744781  7941 ts_tablet_manager.cc:1403] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.009s
I20260709 13:04:16.745210  7662 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb13ccbedb42ada1f3add822434eab (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:16.763535  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb13ccbedb42ada1f3add822434eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.740610  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc0069dd6948f0979c733fd0ac5343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.767902  7732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb13ccbedb42ada1f3add822434eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.755501  7810 tablet_service.cc:1511] Processing CreateTablet for tablet a6fb13ccbedb42ada1f3add822434eab (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:16.769116  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6fb13ccbedb42ada1f3add822434eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.736572  7882 tablet_service.cc:1511] Processing CreateTablet for tablet bc39bf2ad6844beb8466b427508830f9 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:16.772433  7734 tablet_service.cc:1511] Processing CreateTablet for tablet 8b6bac98b41745fab1ce373328ca0c8b (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:16.773980  7734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6bac98b41745fab1ce373328ca0c8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.776603  7940 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:16.784653  7940 ts_tablet_manager.cc:1403] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.218s	user 0.010s	sys 0.024s
I20260709 13:04:16.786039  7808 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c4442b3ae45928f37714c97e92bbd (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:16.787513  7808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c4442b3ae45928f37714c97e92bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.779780  7659 tablet_service.cc:1511] Processing CreateTablet for tablet fbbddc9b10cc4f5aabaa9e3b135ffc2f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:16.792193  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbddc9b10cc4f5aabaa9e3b135ffc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.780411  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc39bf2ad6844beb8466b427508830f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.794339  7883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25fc0069dd6948f0979c733fd0ac5343. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.803184  7940 raft_consensus.cc:359] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:16.762394  7942 consensus_queue.cc:260] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.783666  7736 tablet_service.cc:1511] Processing CreateTablet for tablet fbbddc9b10cc4f5aabaa9e3b135ffc2f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:16.769223  7885 tablet_service.cc:1511] Processing CreateTablet for tablet fbbddc9b10cc4f5aabaa9e3b135ffc2f (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:16.809202  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbddc9b10cc4f5aabaa9e3b135ffc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.809369  7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbbddc9b10cc4f5aabaa9e3b135ffc2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.820122  7940 raft_consensus.cc:385] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.820627  7940 raft_consensus.cc:740] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.822342  7941 raft_consensus.cc:359] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.823304  7941 raft_consensus.cc:385] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.823658  7941 raft_consensus.cc:740] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.833566  7942 ts_tablet_manager.cc:1434] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.002s
I20260709 13:04:16.840363  7973 consensus_queue.cc:1048] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.828333  7940 consensus_queue.cc:260] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:16.843199  7953 raft_consensus.cc:493] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.843981  7953 raft_consensus.cc:515] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.846561  7953 leader_election.cc:290] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:16.847409  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c6a31a382c47888fc962c7a1a27921" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:16.848218  7672 raft_consensus.cc:2468] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:16.848299  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c6a31a382c47888fc962c7a1a27921" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:16.849197  7747 raft_consensus.cc:2468] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:16.849721  7943 tablet_bootstrap.cc:492] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:16.849840  7786 leader_election.cc:304] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:16.850858  7953 raft_consensus.cc:2804] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:16.856704  7953 raft_consensus.cc:493] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.850404  7943 ts_tablet_manager.cc:1403] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.008s
I20260709 13:04:16.857134  7953 raft_consensus.cc:3060] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.866567  7943 raft_consensus.cc:359] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.867430  7943 raft_consensus.cc:385] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.867720  7943 raft_consensus.cc:740] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.860471  7941 consensus_queue.cc:260] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.880012  7881 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c4442b3ae45928f37714c97e92bbd (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:16.891973  7881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c4442b3ae45928f37714c97e92bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.892530  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 814f68057304479398b938502ddb6f05 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:16.892956  7941 ts_tablet_manager.cc:1434] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.130s	user 0.009s	sys 0.000s
I20260709 13:04:16.893936  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814f68057304479398b938502ddb6f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.896317  7656 tablet_service.cc:1511] Processing CreateTablet for tablet 9c4c4442b3ae45928f37714c97e92bbd (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:16.897718  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4c4442b3ae45928f37714c97e92bbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.894289  7570 catalog_manager.cc:5697] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:16.896333  7942 tablet_bootstrap.cc:492] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:16.894212  7941 tablet_bootstrap.cc:492] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:16.919739  7810 tablet_service.cc:1511] Processing CreateTablet for tablet 814f68057304479398b938502ddb6f05 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:16.922377  7885 tablet_service.cc:1511] Processing CreateTablet for tablet 814f68057304479398b938502ddb6f05 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:16.920768  7940 ts_tablet_manager.cc:1434] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.135s	user 0.007s	sys 0.003s
I20260709 13:04:16.931248  7882 tablet_service.cc:1511] Processing CreateTablet for tablet 9e898dd859544a1ebf030fc90a64701c (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:16.934468  7940 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:16.934268  7806 tablet_service.cc:1511] Processing CreateTablet for tablet cf11683974b449738775dd5a453c9b7c (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:16.934487  7659 tablet_service.cc:1511] Processing CreateTablet for tablet cf11683974b449738775dd5a453c9b7c (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:04:16.935981  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:16.943084  7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814f68057304479398b938502ddb6f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.943836  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e898dd859544a1ebf030fc90a64701c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.936424  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf11683974b449738775dd5a453c9b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.948730  7953 raft_consensus.cc:515] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:16.951735  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c6a31a382c47888fc962c7a1a27921" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:16.952361  7672 raft_consensus.cc:3060] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.957454  7662 tablet_service.cc:1511] Processing CreateTablet for tablet 9e898dd859544a1ebf030fc90a64701c (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:16.958940  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e898dd859544a1ebf030fc90a64701c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.959976  7672 raft_consensus.cc:2468] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:16.961556  7949 consensus_queue.cc:1048] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:16.961727  7786 leader_election.cc:304] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:16.960577  7986 raft_consensus.cc:493] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.963304  7986 raft_consensus.cc:515] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.963644  7979 raft_consensus.cc:2804] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.934638  7810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 814f68057304479398b938502ddb6f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.939929  7736 tablet_service.cc:1511] Processing CreateTablet for tablet cf11683974b449738775dd5a453c9b7c (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:16.967761  7806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf11683974b449738775dd5a453c9b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.967873  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf11683974b449738775dd5a453c9b7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.972141  7986 leader_election.cc:290] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:16.972723  7943 consensus_queue.cc:260] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:16.973405  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:16.974016  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:16.974210  7820 raft_consensus.cc:2468] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:16.974334  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2bd913427444e4a532f350222d496d (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:16.974735  7747 raft_consensus.cc:2468] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:16.974644  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 9e898dd859544a1ebf030fc90a64701c (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:16.975714  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2bd913427444e4a532f350222d496d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.976079  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e898dd859544a1ebf030fc90a64701c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.975916  7861 leader_election.cc:304] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:16.977160  7808 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2bd913427444e4a532f350222d496d (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:16.978135  7943 ts_tablet_manager.cc:1434] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.000s
I20260709 13:04:16.978919  7808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2bd913427444e4a532f350222d496d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.979298  7943 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:16.985528  7986 raft_consensus.cc:2804] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:16.986107  7986 raft_consensus.cc:493] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.986474  7986 raft_consensus.cc:3060] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.982776  7941 tablet_bootstrap.cc:654] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.991519  7942 tablet_bootstrap.cc:654] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.017243  7733 tablet_service.cc:1511] Processing CreateTablet for tablet c67ee10cce2a4cf68ce49c4c20fcd708 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:17.030133  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67ee10cce2a4cf68ce49c4c20fcd708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.023281  7953 leader_election.cc:290] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:17.023515  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c6a31a382c47888fc962c7a1a27921" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:17.026759  7807 tablet_service.cc:1511] Processing CreateTablet for tablet c67ee10cce2a4cf68ce49c4c20fcd708 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:17.032666  7880 tablet_service.cc:1511] Processing CreateTablet for tablet c67ee10cce2a4cf68ce49c4c20fcd708 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:17.022919  7943 tablet_bootstrap.cc:654] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.030543  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 72c94730189a4964ab34c7aefdbd813a (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:17.036633  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c94730189a4964ab34c7aefdbd813a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.031354  7979 raft_consensus.cc:697] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:17.038199  7979 consensus_queue.cc:237] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.034593  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67ee10cce2a4cf68ce49c4c20fcd708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.035138  7747 raft_consensus.cc:3060] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.035698  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c67ee10cce2a4cf68ce49c4c20fcd708. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.027202  7940 tablet_bootstrap.cc:654] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.048475  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2bd913427444e4a532f350222d496d (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:17.049962  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2bd913427444e4a532f350222d496d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.061960  7747 raft_consensus.cc:2468] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:17.069886  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 72c94730189a4964ab34c7aefdbd813a (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:17.035662  7986 raft_consensus.cc:515] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.071121  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c94730189a4964ab34c7aefdbd813a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.077756  7943 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:17.078858  7941 tablet_bootstrap.cc:492] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:17.080506  7881 tablet_service.cc:1511] Processing CreateTablet for tablet a24ddd1785584baaac825181369d1331 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:17.124960  7943 ts_tablet_manager.cc:1403] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.010s
I20260709 13:04:17.125012  7941 ts_tablet_manager.cc:1403] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.231s	user 0.017s	sys 0.016s
I20260709 13:04:17.125757  7881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24ddd1785584baaac825181369d1331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.081751  7986 leader_election.cc:290] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:17.082417  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:17.129022  7747 raft_consensus.cc:3060] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.082304  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 72c94730189a4964ab34c7aefdbd813a (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:17.133296  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72c94730189a4964ab34c7aefdbd813a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.083258  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:17.136472  7820 raft_consensus.cc:3060] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.137651  7941 raft_consensus.cc:359] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.138967  7941 raft_consensus.cc:385] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.139353  7941 raft_consensus.cc:740] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.099663  7997 consensus_queue.cc:1048] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.140471  7941 consensus_queue.cc:260] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.104669  8006 consensus_queue.cc:1048] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.114310  7733 tablet_service.cc:1511] Processing CreateTablet for tablet a24ddd1785584baaac825181369d1331 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:17.147840  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24ddd1785584baaac825181369d1331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.118400  7882 tablet_service.cc:1511] Processing CreateTablet for tablet 666216fc7a1f403992aed2103a1031ef (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:17.121784  7807 tablet_service.cc:1511] Processing CreateTablet for tablet 666216fc7a1f403992aed2103a1031ef (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:17.150038  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666216fc7a1f403992aed2103a1031ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.150038  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666216fc7a1f403992aed2103a1031ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.121784  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 666216fc7a1f403992aed2103a1031ef (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:17.153579  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666216fc7a1f403992aed2103a1031ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.149071  7941 ts_tablet_manager.cc:1434] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
W20260709 13:04:17.162846  7786 consensus_peers.cc:597] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:17.186115  7942 tablet_bootstrap.cc:492] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:17.200434  7821 raft_consensus.cc:3060] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.200256  7662 tablet_service.cc:1511] Processing CreateTablet for tablet a24ddd1785584baaac825181369d1331 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:17.201612  7942 ts_tablet_manager.cc:1403] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.313s	user 0.022s	sys 0.026s
I20260709 13:04:17.205122  7940 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:17.205973  7940 ts_tablet_manager.cc:1403] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.272s	user 0.018s	sys 0.032s
I20260709 13:04:17.206264  7736 tablet_service.cc:1511] Processing CreateTablet for tablet 7985bf73aa8b418389701bac6f2257f8 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:17.218290  7820 raft_consensus.cc:2468] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:17.219672  7861 leader_election.cc:304] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:17.220643  7997 raft_consensus.cc:2804] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.222304  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 7985bf73aa8b418389701bac6f2257f8 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:17.225230  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7985bf73aa8b418389701bac6f2257f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.211956  7736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7985bf73aa8b418389701bac6f2257f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.230679  7986 consensus_queue.cc:1048] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.221345  7809 tablet_service.cc:1511] Processing CreateTablet for tablet 7985bf73aa8b418389701bac6f2257f8 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:17.234779  7940 raft_consensus.cc:359] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.236526  7940 raft_consensus.cc:385] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.236913  7940 raft_consensus.cc:740] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.237716  7940 consensus_queue.cc:260] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.240530  7941 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:17.245615  7940 ts_tablet_manager.cc:1434] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.001s
I20260709 13:04:17.246963  7656 tablet_service.cc:1511] Processing CreateTablet for tablet 82f41c2981eb4e27bb7a90979e8ef071 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:17.253297  7733 tablet_service.cc:1511] Processing CreateTablet for tablet 82f41c2981eb4e27bb7a90979e8ef071 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:17.265221  7940 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:17.265843  7662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a24ddd1785584baaac825181369d1331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.265843  7733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f41c2981eb4e27bb7a90979e8ef071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.267869  7656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f41c2981eb4e27bb7a90979e8ef071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.251093  7942 raft_consensus.cc:359] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.249046  7809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7985bf73aa8b418389701bac6f2257f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.262770  7570 catalog_manager.cc:5697] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.254002  7943 raft_consensus.cc:359] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.254510  7808 tablet_service.cc:1511] Processing CreateTablet for tablet 82f41c2981eb4e27bb7a90979e8ef071 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:17.292306  7997 raft_consensus.cc:697] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:17.294205  7992 raft_consensus.cc:493] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.294680  7659 tablet_service.cc:1511] Processing CreateTablet for tablet 6b897e7d731a42678b1ecb79b5e2e468 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:17.294807  7992 raft_consensus.cc:515] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.297017  7807 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd80ffcb91143aeb64f882f614e0817 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:17.297084  7992 leader_election.cc:290] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:17.297727  7732 tablet_service.cc:1511] Processing CreateTablet for tablet 6b897e7d731a42678b1ecb79b5e2e468 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:17.299001  7732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b897e7d731a42678b1ecb79b5e2e468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.274098  7943 raft_consensus.cc:385] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.315995  7943 raft_consensus.cc:740] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.317411  7943 consensus_queue.cc:260] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.321074  7808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82f41c2981eb4e27bb7a90979e8ef071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.274559  7942 raft_consensus.cc:385] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.325723  7942 raft_consensus.cc:740] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.326944  7942 consensus_queue.cc:260] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.310408  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf6e495d139410392594c5345bd5306" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:17.312661  7988 raft_consensus.cc:493] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.329783  7988 raft_consensus.cc:515] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.313247  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cf6e495d139410392594c5345bd5306" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:17.335759  7635 leader_election.cc:304] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:17.335829  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a5ed5a8b8146bba4818317966c6707" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:17.336838  7992 raft_consensus.cc:2749] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.307969  7659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b897e7d731a42678b1ecb79b5e2e468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.338851  7997 consensus_queue.cc:237] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.361819  7671 raft_consensus.cc:3060] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.381261  7949 raft_consensus.cc:493] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.381796  7949 raft_consensus.cc:515] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.385555  7988 leader_election.cc:290] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:17.388362  7986 raft_consensus.cc:493] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.380708  7661 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd80ffcb91143aeb64f882f614e0817 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:17.356475  7747 raft_consensus.cc:2468] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:17.390507  7661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd80ffcb91143aeb64f882f614e0817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.389186  7986 raft_consensus.cc:515] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.398862  7986 leader_election.cc:290] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:17.398895  7942 ts_tablet_manager.cc:1434] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.196s	user 0.007s	sys 0.002s
I20260709 13:04:17.402094  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5a5ed5a8b8146bba4818317966c6707" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:17.403059  7942 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:17.401553  7941 tablet_bootstrap.cc:654] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.403985  7943 ts_tablet_manager.cc:1434] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.278s	user 0.010s	sys 0.009s
I20260709 13:04:17.383980  7949 leader_election.cc:290] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:17.399992  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed68b66f2c4a59a2e1c334ec6380a5" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:17.405270  7943 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:17.407032  7638 leader_election.cc:304] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:17.411334  7992 raft_consensus.cc:2749] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.412919  7979 raft_consensus.cc:493] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.413445  7979 raft_consensus.cc:515] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.416414  7807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd80ffcb91143aeb64f882f614e0817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.418090  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed68b66f2c4a59a2e1c334ec6380a5" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:17.418819  7818 raft_consensus.cc:2468] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:17.419680  7986 consensus_queue.cc:1048] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.421065  7861 leader_election.cc:304] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:17.421967  7986 raft_consensus.cc:2804] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.422343  7986 raft_consensus.cc:493] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.422748  7986 raft_consensus.cc:3060] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.426937  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d149138d084c9db0b0266c1877f04f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.428088  7979 leader_election.cc:290] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:17.429282  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5d149138d084c9db0b0266c1877f04f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:17.431739  8016 consensus_queue.cc:1048] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.432087  7882 tablet_service.cc:1511] Processing CreateTablet for tablet 7fd80ffcb91143aeb64f882f614e0817 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:17.433506  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd80ffcb91143aeb64f882f614e0817. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.434347  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 6b897e7d731a42678b1ecb79b5e2e468 (DEFAULT_TABLE table=test-workload [id=1b0b98708a1641c2b37bc56761432541]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:17.435819  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b897e7d731a42678b1ecb79b5e2e468. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:17.437085  7786 leader_election.cc:304] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:17.438182  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc78460a31e44259913b287fcc501a6" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:17.439522  7940 tablet_bootstrap.cc:654] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.410494  7747 raft_consensus.cc:2468] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:17.453104  7943 tablet_bootstrap.cc:654] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.446178  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc78460a31e44259913b287fcc501a6" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.468374  7942 tablet_bootstrap.cc:654] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:17.475101  7710 leader_election.cc:343] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:17.493680  7712 leader_election.cc:343] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.493453  7570 catalog_manager.cc:5697] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.502652  7712 leader_election.cc:304] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:17.495545  7941 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:17.505292  7953 raft_consensus.cc:2749] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:17.517228  7949 raft_consensus.cc:2749] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.525429  7986 raft_consensus.cc:515] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.529064  7941 ts_tablet_manager.cc:1403] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.318s	user 0.024s	sys 0.012s
I20260709 13:04:17.530174  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed68b66f2c4a59a2e1c334ec6380a5" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:17.531051  7747 raft_consensus.cc:3060] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.531710  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ed68b66f2c4a59a2e1c334ec6380a5" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:17.532433  7820 raft_consensus.cc:3060] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.533107  7941 raft_consensus.cc:359] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.536309  7941 raft_consensus.cc:385] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.536625  7941 raft_consensus.cc:740] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.538755  7941 consensus_queue.cc:260] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.542793  7747 raft_consensus.cc:2468] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:17.546813  7986 leader_election.cc:290] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:17.548288  7859 leader_election.cc:304] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:17.542878  7941 ts_tablet_manager.cc:1434] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:04:17.557087  7941 tablet_bootstrap.cc:492] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:17.557554  7953 consensus_queue.cc:1048] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.563786  7986 raft_consensus.cc:2804] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.565480  7986 raft_consensus.cc:697] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:17.578339  7942 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:17.550622  7820 raft_consensus.cc:2468] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:17.580596  7942 ts_tablet_manager.cc:1403] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.005s
I20260709 13:04:17.586525  7942 raft_consensus.cc:359] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.588729  7986 consensus_queue.cc:237] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.593173  7942 raft_consensus.cc:385] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.603247  7672 raft_consensus.cc:3060] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.600759  7942 raft_consensus.cc:740] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.604848  7953 consensus_queue.cc:1048] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.615945  7943 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:17.616658  7943 ts_tablet_manager.cc:1403] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.212s	user 0.022s	sys 0.028s
I20260709 13:04:17.618254  7941 tablet_bootstrap.cc:654] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.620630  7943 raft_consensus.cc:359] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.621503  7943 raft_consensus.cc:385] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.621793  7943 raft_consensus.cc:740] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.622702  7943 consensus_queue.cc:260] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.625505  7943 ts_tablet_manager.cc:1434] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:04:17.630424  7943 tablet_bootstrap.cc:492] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:17.634645  7942 consensus_queue.cc:260] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.636881  7942 ts_tablet_manager.cc:1434] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.002s
I20260709 13:04:17.643711  7943 tablet_bootstrap.cc:654] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.615994  7940 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:17.649049  7940 ts_tablet_manager.cc:1403] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.384s	user 0.021s	sys 0.028s
I20260709 13:04:17.654682  7570 catalog_manager.cc:5697] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.662442  7941 tablet_bootstrap.cc:492] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:17.663170  7941 ts_tablet_manager.cc:1403] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.004s
I20260709 13:04:17.663435  7940 raft_consensus.cc:359] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.664362  7940 raft_consensus.cc:385] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.664669  7940 raft_consensus.cc:740] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.665836  7943 tablet_bootstrap.cc:492] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:17.665437  7940 consensus_queue.cc:260] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.666574  7943 ts_tablet_manager.cc:1403] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.000s
I20260709 13:04:17.667219  7942 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:17.668673  7940 ts_tablet_manager.cc:1434] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:04:17.669808  7953 raft_consensus.cc:493] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.670351  7953 raft_consensus.cc:515] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.670441  7943 raft_consensus.cc:359] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.671372  7943 raft_consensus.cc:385] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.671717  7943 raft_consensus.cc:740] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.672844  7953 leader_election.cc:290] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:17.672569  7943 consensus_queue.cc:260] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.675274  7943 ts_tablet_manager.cc:1434] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:17.675199  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968d46ff0984f6b958e5378d07c3d32" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.676352  7942 tablet_bootstrap.cc:654] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.676559  7672 raft_consensus.cc:2468] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:17.676982  7943 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:17.677985  7786 leader_election.cc:304] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:17.680338  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968d46ff0984f6b958e5378d07c3d32" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:17.681285  7747 raft_consensus.cc:2468] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:17.681720  7953 raft_consensus.cc:2804] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.682340  7953 raft_consensus.cc:493] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.682803  7953 raft_consensus.cc:3060] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.684492  7943 tablet_bootstrap.cc:654] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.687065  7940 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:17.666846  7941 raft_consensus.cc:359] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.713572  7941 raft_consensus.cc:385] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.714208  7941 raft_consensus.cc:740] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.715626  7941 consensus_queue.cc:260] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:17.718546  7940 tablet_bootstrap.cc:654] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.712350  7953 raft_consensus.cc:515] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.721642  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968d46ff0984f6b958e5378d07c3d32" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:17.722283  7672 raft_consensus.cc:3060] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.722404  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968d46ff0984f6b958e5378d07c3d32" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:17.723230  7747 raft_consensus.cc:3060] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.728919  7672 raft_consensus.cc:2468] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:17.730384  7786 leader_election.cc:304] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:17.731415  7747 raft_consensus.cc:2468] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:17.731703  8031 raft_consensus.cc:2804] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.732520  8031 raft_consensus.cc:697] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:17.733686  7941 ts_tablet_manager.cc:1434] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:04:17.733624  8031 consensus_queue.cc:237] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.734980  7941 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:17.738469  7953 leader_election.cc:290] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:17.738575  7942 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:17.739579  7942 ts_tablet_manager.cc:1403] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.073s	user 0.022s	sys 0.026s
I20260709 13:04:17.740976  7943 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:17.741734  7943 ts_tablet_manager.cc:1403] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.065s	user 0.017s	sys 0.025s
I20260709 13:04:17.742791  7942 raft_consensus.cc:359] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.743634  7942 raft_consensus.cc:385] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.743965  7942 raft_consensus.cc:740] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.744801  7942 consensus_queue.cc:260] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.745709  7943 raft_consensus.cc:359] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.746537  7943 raft_consensus.cc:385] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.746790  7943 raft_consensus.cc:740] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.747522  7943 consensus_queue.cc:260] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.749827  7943 ts_tablet_manager.cc:1434] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:17.750299  7940 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:17.750809  7940 ts_tablet_manager.cc:1403] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.000s
I20260709 13:04:17.751468  7943 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:17.753558  7940 raft_consensus.cc:359] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.754259  7940 raft_consensus.cc:385] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.754630  7940 raft_consensus.cc:740] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.755505  7940 consensus_queue.cc:260] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.756237  7942 ts_tablet_manager.cc:1434] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:04:17.757535  7942 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:17.760802  7940 ts_tablet_manager.cc:1434] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:17.761951  7940 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:17.763821  7943 tablet_bootstrap.cc:654] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.762486  7570 catalog_manager.cc:5697] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.770833  7942 tablet_bootstrap.cc:654] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.775098  7940 tablet_bootstrap.cc:654] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.775127  7941 tablet_bootstrap.cc:654] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.785785  7942 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:17.786420  7942 ts_tablet_manager.cc:1403] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.000s
I20260709 13:04:17.790051  7942 raft_consensus.cc:359] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.791139  7942 raft_consensus.cc:385] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.791466  7942 raft_consensus.cc:740] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.792562  7942 consensus_queue.cc:260] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.795369  7942 ts_tablet_manager.cc:1434] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:04:17.796496  7942 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:17.801189  7941 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:17.801870  7941 ts_tablet_manager.cc:1403] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.005s
I20260709 13:04:17.805225  7941 raft_consensus.cc:359] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.813048  7941 raft_consensus.cc:385] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.813373  7941 raft_consensus.cc:740] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.813540  7943 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:17.814203  7941 consensus_queue.cc:260] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.814339  7943 ts_tablet_manager.cc:1403] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.024s
I20260709 13:04:17.814441  7940 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:17.811662  7942 tablet_bootstrap.cc:654] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.815392  7940 ts_tablet_manager.cc:1403] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.054s	user 0.030s	sys 0.014s
I20260709 13:04:17.817232  7943 raft_consensus.cc:359] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.817858  7943 raft_consensus.cc:385] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.818091  7943 raft_consensus.cc:740] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.818991  7943 consensus_queue.cc:260] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.818977  7940 raft_consensus.cc:359] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.819978  7940 raft_consensus.cc:385] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.823290  7940 raft_consensus.cc:740] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.823704  7941 ts_tablet_manager.cc:1434] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:04:17.824155  7940 consensus_queue.cc:260] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.825044  7941 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:17.821199  7943 ts_tablet_manager.cc:1434] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:17.826305  7940 ts_tablet_manager.cc:1434] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:17.827176  7943 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:17.827375  7940 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:17.832675  7941 tablet_bootstrap.cc:654] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.833959  7940 tablet_bootstrap.cc:654] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.834515  7943 tablet_bootstrap.cc:654] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.844379  7986 raft_consensus.cc:493] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.844952  7986 raft_consensus.cc:515] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.849193  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0a2a6ec6a1432b9f925ef0927de924" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.849916  7672 raft_consensus.cc:2468] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:17.849200  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0a2a6ec6a1432b9f925ef0927de924" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:17.851285  7820 raft_consensus.cc:2468] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:17.852521  7861 leader_election.cc:304] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:17.853385  7997 raft_consensus.cc:2804] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.853741  7997 raft_consensus.cc:493] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.854072  7997 raft_consensus.cc:3060] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.847980  7986 leader_election.cc:290] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:17.867475  7997 raft_consensus.cc:515] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.870697  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0a2a6ec6a1432b9f925ef0927de924" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:17.871305  7820 raft_consensus.cc:3060] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.874218  7942 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:17.874845  7942 ts_tablet_manager.cc:1403] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.001s
I20260709 13:04:17.875512  7940 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:17.876016  7940 ts_tablet_manager.cc:1403] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.030s
I20260709 13:04:17.877074  7997 leader_election.cc:290] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:17.878300  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d0a2a6ec6a1432b9f925ef0927de924" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:17.878635  7942 raft_consensus.cc:359] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.879012  7672 raft_consensus.cc:3060] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.879151  7940 raft_consensus.cc:359] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.879925  7940 raft_consensus.cc:385] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.879570  7942 raft_consensus.cc:385] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.880335  7940 raft_consensus.cc:740] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.880514  7943 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:17.880664  7942 raft_consensus.cc:740] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.881585  7943 ts_tablet_manager.cc:1403] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.001s
I20260709 13:04:17.881278  7940 consensus_queue.cc:260] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.881902  7942 consensus_queue.cc:260] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.883657  7940 ts_tablet_manager.cc:1434] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:04:17.884826  7940 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:17.884784  7943 raft_consensus.cc:359] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.885852  7943 raft_consensus.cc:385] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.886140  7943 raft_consensus.cc:740] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.889760  7942 ts_tablet_manager.cc:1434] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:04:17.892753  7820 raft_consensus.cc:2468] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:17.891548  7940 tablet_bootstrap.cc:654] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.894338  7861 leader_election.cc:304] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:17.895380  7997 raft_consensus.cc:2804] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.891906  7941 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:17.896275  7672 raft_consensus.cc:2468] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:17.890501  7943 consensus_queue.cc:260] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.896468  7941 ts_tablet_manager.cc:1403] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.032s
I20260709 13:04:17.892992  7942 tablet_bootstrap.cc:492] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:17.896857  7997 raft_consensus.cc:697] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:17.897171  8024 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.900700  8024 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.904381  7943 ts_tablet_manager.cc:1434] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:17.905037  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.905509  7943 tablet_bootstrap.cc:492] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
W20260709 13:04:17.907961  7712 leader_election.cc:343] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.913118  7973 raft_consensus.cc:493] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.913039  7941 raft_consensus.cc:359] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.913924  7941 raft_consensus.cc:385] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.913733  7973 raft_consensus.cc:515] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:17.914238  7941 raft_consensus.cc:740] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.914933  7941 consensus_queue.cc:260] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.917011  7941 ts_tablet_manager.cc:1434] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:04:17.917979  7941 tablet_bootstrap.cc:492] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:17.918172  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ccaa93d3a94f34a4ab6ea95c7bb67d" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.918999  7671 raft_consensus.cc:2468] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:17.917644  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ccaa93d3a94f34a4ab6ea95c7bb67d" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:17.911912  7943 tablet_bootstrap.cc:654] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.919871  7818 raft_consensus.cc:2468] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:17.920413  7712 leader_election.cc:304] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:17.921360  7949 raft_consensus.cc:2804] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.921747  7949 raft_consensus.cc:493] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.922086  7949 raft_consensus.cc:3060] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.915892  7973 leader_election.cc:290] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:17.928193  7941 tablet_bootstrap.cc:654] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.928282  7986 consensus_queue.cc:1048] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.932070  7973 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.932875  7973 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.936791  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:17.938722  7710 leader_election.cc:343] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.940759  8024 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:17.943138  7997 consensus_queue.cc:237] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:17.958658  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.959947  8017 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:17.961016  7712 leader_election.cc:343] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.960875  8017 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:17.956967  7973 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:17.961778  7712 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:17.965552  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.966485  8016 raft_consensus.cc:493] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.967176  8016 raft_consensus.cc:515] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:17.968158  7860 leader_election.cc:343] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.970091  8016 leader_election.cc:290] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:17.973142  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc78460a31e44259913b287fcc501a6" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:17.974329  7672 raft_consensus.cc:2468] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:17.977479  8024 raft_consensus.cc:2749] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.978261  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc78460a31e44259913b287fcc501a6" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:17.979249  7746 raft_consensus.cc:2468] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:17.980432  8016 consensus_queue.cc:1048] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.980674  7860 leader_election.cc:304] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:17.986167  8017 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:17.989897  7986 raft_consensus.cc:2804] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.990583  7986 raft_consensus.cc:493] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.991020  7986 raft_consensus.cc:3060] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.002408  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:18.005940  7949 raft_consensus.cc:515] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:18.012976  7859 leader_election.cc:343] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.013844  7859 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:18.015687  8016 raft_consensus.cc:2749] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.026223  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:18.028118  7713 leader_election.cc:343] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.028481  7949 leader_election.cc:290] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:18.028924  7713 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:18.030664  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ccaa93d3a94f34a4ab6ea95c7bb67d" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:18.037014  7671 raft_consensus.cc:3060] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.041268  8024 raft_consensus.cc:493] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.041776  8024 raft_consensus.cc:515] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.044629  8024 leader_election.cc:290] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:18.045754  8024 raft_consensus.cc:2749] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.046499  7986 raft_consensus.cc:515] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.053932  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b497b4caeba049e0bcdcef814028ecea" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:18.049516  7942 tablet_bootstrap.cc:654] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.065618  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b497b4caeba049e0bcdcef814028ecea" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:18.066433  7894 raft_consensus.cc:2468] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
W20260709 13:04:18.069262  7713 leader_election.cc:343] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.073182  8016 consensus_queue.cc:1048] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.081312  7710 leader_election.cc:304] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:18.083155  7973 raft_consensus.cc:2804] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.083694  7973 raft_consensus.cc:493] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.084249  7973 raft_consensus.cc:3060] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.088932  7671 raft_consensus.cc:2468] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
W20260709 13:04:18.035678  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:18.098652  7941 tablet_bootstrap.cc:492] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:18.100097  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc78460a31e44259913b287fcc501a6" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:18.106021  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc78460a31e44259913b287fcc501a6" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:18.106477  7745 raft_consensus.cc:3060] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.106789  7672 raft_consensus.cc:3060] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.106755  7712 leader_election.cc:304] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:18.113185  7949 raft_consensus.cc:2804] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.113968  7949 raft_consensus.cc:697] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:18.114928  7949 consensus_queue.cc:237] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.115715  7745 raft_consensus.cc:2468] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:18.101466  7940 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:18.117380  7940 ts_tablet_manager.cc:1403] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.233s	user 0.059s	sys 0.099s
I20260709 13:04:18.104874  7943 tablet_bootstrap.cc:492] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:18.117208  7859 leader_election.cc:304] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:18.118084  7943 ts_tablet_manager.cc:1403] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.213s	user 0.027s	sys 0.052s
I20260709 13:04:18.120327  7941 ts_tablet_manager.cc:1403] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.203s	user 0.023s	sys 0.055s
I20260709 13:04:18.120801  7672 raft_consensus.cc:2468] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:18.120818  8017 raft_consensus.cc:2804] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.124531  7941 raft_consensus.cc:359] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.125342  7941 raft_consensus.cc:385] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.125662  7941 raft_consensus.cc:740] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.126422  7941 consensus_queue.cc:260] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.128788  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3ccaa93d3a94f34a4ab6ea95c7bb67d" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:18.129619  7940 raft_consensus.cc:359] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.138116  7940 raft_consensus.cc:385] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.138522  7940 raft_consensus.cc:740] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.138715  7820 raft_consensus.cc:3060] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.139349  7940 consensus_queue.cc:260] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.129237  7943 raft_consensus.cc:359] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.140476  7943 raft_consensus.cc:385] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.140873  7943 raft_consensus.cc:740] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.145205  7940 ts_tablet_manager.cc:1434] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:04:18.143455  7943 consensus_queue.cc:260] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.146380  7940 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:18.147987  7943 ts_tablet_manager.cc:1434] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 13:04:18.148073  7973 raft_consensus.cc:515] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.154927  7940 tablet_bootstrap.cc:654] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.155061  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b497b4caeba049e0bcdcef814028ecea" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
W20260709 13:04:18.160169  7713 leader_election.cc:343] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.173318  7986 leader_election.cc:290] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:18.173815  7941 ts_tablet_manager.cc:1434] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.005s
I20260709 13:04:18.175284  7941 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:18.182214  7953 consensus_queue.cc:1048] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.188318  8017 raft_consensus.cc:697] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:18.189739  8017 consensus_queue.cc:237] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.192703  7953 raft_consensus.cc:493] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.212563  7953 raft_consensus.cc:515] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.200157  7973 leader_election.cc:290] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:18.201025  7943 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:18.207923  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b497b4caeba049e0bcdcef814028ecea" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:18.218190  7894 raft_consensus.cc:3060] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.219203  7953 leader_election.cc:290] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:18.220857  7986 consensus_queue.cc:1048] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.209367  8026 consensus_queue.cc:1048] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.217352  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acc87afffa74c29bd1e7e9d5d3c207e" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:18.225934  7784 leader_election.cc:343] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.229478  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acc87afffa74c29bd1e7e9d5d3c207e" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:18.234731  7820 raft_consensus.cc:2468] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:18.261538  7941 tablet_bootstrap.cc:654] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.266270  7940 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:18.266949  7940 ts_tablet_manager.cc:1403] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.121s	user 0.027s	sys 0.008s
I20260709 13:04:18.270735  7940 raft_consensus.cc:359] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.271656  7940 raft_consensus.cc:385] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.272007  7940 raft_consensus.cc:740] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.272928  7940 consensus_queue.cc:260] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:18.273543  7786 leader_election.cc:343] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.274271  7786 leader_election.cc:304] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:18.275167  8026 raft_consensus.cc:2749] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.276090  7940 ts_tablet_manager.cc:1434] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:04:18.277878  7940 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:18.283074  7941 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:18.283977  7941 ts_tablet_manager.cc:1403] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.002s
I20260709 13:04:18.285629  7940 tablet_bootstrap.cc:654] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.286959  7941 raft_consensus.cc:359] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.287731  7941 raft_consensus.cc:385] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.282075  7894 raft_consensus.cc:2468] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:18.288017  7941 raft_consensus.cc:740] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.313040  7941 consensus_queue.cc:260] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.304212  7943 tablet_bootstrap.cc:654] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.337718  7941 ts_tablet_manager.cc:1434] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.003s
I20260709 13:04:18.344000  8074 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.344652  8074 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.347096  8074 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:18.350162  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:18.351316  7745 raft_consensus.cc:2468] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:18.338742  7710 leader_election.cc:304] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:18.355612  7973 raft_consensus.cc:2804] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.357045  7636 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
W20260709 13:04:18.321569  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 185342us
I20260709 13:04:18.357843  7973 raft_consensus.cc:697] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:18.384497  7973 consensus_queue.cc:237] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.368223  7992 raft_consensus.cc:2804] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.546389  7992 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.546551  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:18.434695  8075 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.480667  7570 catalog_manager.cc:5697] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.547526  7894 raft_consensus.cc:2468] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:18.547678  8075 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.549220  7943 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:18.512694  7940 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:18.549767  7943 ts_tablet_manager.cc:1403] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.401s	user 0.025s	sys 0.021s
I20260709 13:04:18.540256  8017 consensus_queue.cc:1048] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.546855  7992 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.550164  7940 ts_tablet_manager.cc:1403] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.273s	user 0.018s	sys 0.049s
I20260709 13:04:18.550103  7973 raft_consensus.cc:493] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.391225  7942 tablet_bootstrap.cc:492] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:18.537436  8016 raft_consensus.cc:493] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.553272  7940 raft_consensus.cc:359] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.556522  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:18.557336  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:18.560873  7973 raft_consensus.cc:515] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.562985  7992 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.572343  7942 ts_tablet_manager.cc:1403] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.680s	user 0.022s	sys 0.001s
I20260709 13:04:18.573542  7992 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:18.573730  7638 leader_election.cc:343] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.567039  7943 raft_consensus.cc:359] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.569336  7940 raft_consensus.cc:385] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.575397  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:18.576051  7943 raft_consensus.cc:385] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.576138  7940 raft_consensus.cc:740] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.576440  7943 raft_consensus.cc:740] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.576967  7940 consensus_queue.cc:260] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.577128  7943 consensus_queue.cc:260] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.579036  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:18.579958  7569 catalog_manager.cc:5697] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:18.581094  7713 leader_election.cc:343] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.569195  8016 raft_consensus.cc:515] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.576457  7745 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.583804  8016 leader_election.cc:290] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:18.584102  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:18.579067  7940 ts_tablet_manager.cc:1434] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:04:18.588768  7894 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.589715  7940 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:18.569540  7941 tablet_bootstrap.cc:492] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:18.590780  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69f4370f9c45b5a22013b2937db5fb" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:18.592870  7861 leader_election.cc:343] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.585532  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69f4370f9c45b5a22013b2937db5fb" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:18.595515  8016 consensus_queue.cc:1048] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:18.596266  7859 leader_election.cc:343] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.596828  7859 leader_election.cc:304] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:18.570333  7747 raft_consensus.cc:2468] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:18.587532  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:18.599707  7710 leader_election.cc:343] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.600219  7710 leader_election.cc:304] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:18.601359  8016 raft_consensus.cc:2749] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.601878  7636 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:18.602391  7949 raft_consensus.cc:2749] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.602941  8074 raft_consensus.cc:2804] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.603392  8074 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.603794  8074 raft_consensus.cc:3060] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.561796  8075 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:18.608494  7941 tablet_bootstrap.cc:654] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.586277  7973 leader_election.cc:290] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:18.587992  7942 raft_consensus.cc:359] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.613452  7942 raft_consensus.cc:385] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.613880  7942 raft_consensus.cc:740] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.614945  7942 consensus_queue.cc:260] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.617841  7940 tablet_bootstrap.cc:654] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.623785  7942 ts_tablet_manager.cc:1434] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:04:18.626590  7942 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:18.627725  7941 tablet_bootstrap.cc:492] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:18.628337  7941 ts_tablet_manager.cc:1403] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.001s
I20260709 13:04:18.628293  7745 raft_consensus.cc:2468] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:18.630859  7636 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:18.631767  7941 raft_consensus.cc:359] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.635023  7942 tablet_bootstrap.cc:654] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.637413  7992 raft_consensus.cc:2804] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.644806  7992 raft_consensus.cc:697] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:18.647007  7941 raft_consensus.cc:385] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.647389  7941 raft_consensus.cc:740] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.643711  7894 raft_consensus.cc:2468] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:18.648713  7941 consensus_queue.cc:260] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.651939  7941 ts_tablet_manager.cc:1434] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:04:18.653381  7941 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:18.652966  7992 consensus_queue.cc:237] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.639992  8074 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.643087  7940 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:18.660766  7940 ts_tablet_manager.cc:1403] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.005s
I20260709 13:04:18.662930  8074 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:18.663793  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:18.665078  7940 raft_consensus.cc:359] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
W20260709 13:04:18.665930  7638 leader_election.cc:343] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.666307  7940 raft_consensus.cc:385] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.666754  7940 raft_consensus.cc:740] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.666937  7953 raft_consensus.cc:493] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.667562  7953 raft_consensus.cc:515] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.667949  7940 consensus_queue.cc:260] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.670114  7953 leader_election.cc:290] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:18.670571  7940 ts_tablet_manager.cc:1434] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:04:18.671793  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b497b4caeba049e0bcdcef814028ecea" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:18.672459  7940 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:18.579067  7943 ts_tablet_manager.cc:1434] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.002s
I20260709 13:04:18.665198  7973 consensus_queue.cc:1048] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:18.675792  7943 tablet_bootstrap.cc:492] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:18.678926  7941 tablet_bootstrap.cc:654] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.678727  8016 consensus_queue.cc:1048] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.689447  7940 tablet_bootstrap.cc:654] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.692502  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:18.694808  7745 raft_consensus.cc:3060] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.702313  7941 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:18.702920  7941 ts_tablet_manager.cc:1403] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.000s
I20260709 13:04:18.707345  7941 raft_consensus.cc:359] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.709022  8064 consensus_queue.cc:1048] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.714367  7973 consensus_queue.cc:1048] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:18.716022  7940 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:18.716639  7940 ts_tablet_manager.cc:1403] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.005s
I20260709 13:04:18.718495  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b497b4caeba049e0bcdcef814028ecea" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:18.709081  7941 raft_consensus.cc:385] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.719822  7940 raft_consensus.cc:359] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.725533  7940 raft_consensus.cc:385] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.725225  7992 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.726152  7940 raft_consensus.cc:740] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.726577  7992 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.728380  7941 raft_consensus.cc:740] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.731071  7992 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:18.727341  7940 consensus_queue.cc:260] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.731901  8074 raft_consensus.cc:493] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.731999  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:18.732455  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:18.732460  8074 raft_consensus.cc:515] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.734220  7747 raft_consensus.cc:2468] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:18.734761  7895 raft_consensus.cc:2468] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:18.720737  7943 tablet_bootstrap.cc:654] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.737618  7636 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:18.738827  7992 raft_consensus.cc:2804] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.739391  7992 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.737790  7566 catalog_manager.cc:5697] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.741077  7894 raft_consensus.cc:2393] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:18.744546  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:18.747247  8064 raft_consensus.cc:493] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.747848  8064 raft_consensus.cc:515] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.750119  8064 leader_election.cc:290] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:18.749706  7941 consensus_queue.cc:260] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.739822  7992 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:18.753173  7638 leader_election.cc:343] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.756714  7940 ts_tablet_manager.cc:1434] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:04:18.757342  8074 leader_election.cc:290] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:18.758136  7940 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:18.759502  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:18.752240  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:18.760854  7747 raft_consensus.cc:2468] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
W20260709 13:04:18.761476  7635 leader_election.cc:343] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.762235  7941 ts_tablet_manager.cc:1434] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.000s
I20260709 13:04:18.762334  7635 leader_election.cc:304] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:18.763451  7941 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:18.763447  8075 raft_consensus.cc:2749] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.765233  7784 leader_election.cc:304] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:18.768613  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:18.769930  7953 raft_consensus.cc:3060] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.771095  7941 tablet_bootstrap.cc:654] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.774811  7992 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.780791  8017 raft_consensus.cc:493] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.781553  8017 raft_consensus.cc:515] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.783769  8017 leader_election.cc:290] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:18.778481  7859 leader_election.cc:304] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:18.785247  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:18.784228  7992 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:18.788575  7747 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:18.789733  7861 leader_election.cc:343] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:18.789640  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acc87afffa74c29bd1e7e9d5d3c207e" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:18.790906  7672 raft_consensus.cc:2468] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:18.792114  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acc87afffa74c29bd1e7e9d5d3c207e" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:18.792513  7860 leader_election.cc:304] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:18.792924  7820 raft_consensus.cc:2468] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:18.794333  8064 raft_consensus.cc:2804] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.794713  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:18.795574  7893 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.794836  8064 raft_consensus.cc:493] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.796465  8064 raft_consensus.cc:3060] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.795743  8017 raft_consensus.cc:2804] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.799330  8017 raft_consensus.cc:493] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.799979  8017 raft_consensus.cc:3060] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.799743  7973 consensus_queue.cc:1048] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.801369  7745 raft_consensus.cc:2468] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:18.803432  7636 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:18.804679  7992 raft_consensus.cc:2804] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.805158  7992 raft_consensus.cc:697] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:18.804756  7569 catalog_manager.cc:5697] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.806039  7992 consensus_queue.cc:237] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.806424  8064 raft_consensus.cc:515] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.810947  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acc87afffa74c29bd1e7e9d5d3c207e" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:18.811635  7671 raft_consensus.cc:3060] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.811791  7747 raft_consensus.cc:2468] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:18.812595  7943 tablet_bootstrap.cc:492] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:18.813119  7943 ts_tablet_manager.cc:1403] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.138s	user 0.014s	sys 0.005s
I20260709 13:04:18.813196  7636 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:18.814141  8074 raft_consensus.cc:2804] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.814735  8074 raft_consensus.cc:697] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:18.815572  8074 consensus_queue.cc:237] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:18.816946  7943 raft_consensus.cc:359] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.817938  7943 raft_consensus.cc:385] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.818275  7943 raft_consensus.cc:740] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.819716  7943 consensus_queue.cc:260] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.814092  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4acc87afffa74c29bd1e7e9d5d3c207e" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:18.818812  8064 leader_election.cc:290] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:18.825058  7820 raft_consensus.cc:3060] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.829093  7671 raft_consensus.cc:2468] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:18.830782  7860 leader_election.cc:304] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:18.831859  8064 raft_consensus.cc:2804] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.832432  8064 raft_consensus.cc:697] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:18.833352  8064 consensus_queue.cc:237] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.833824  7893 raft_consensus.cc:2468] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:18.834105  7942 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:18.834820  7942 ts_tablet_manager.cc:1403] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.208s	user 0.040s	sys 0.025s
I20260709 13:04:18.841323  7953 raft_consensus.cc:2749] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:18.842442  7942 raft_consensus.cc:359] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.843362  7942 raft_consensus.cc:385] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.843698  7942 raft_consensus.cc:740] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.844787  7942 consensus_queue.cc:260] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.847499  7942 ts_tablet_manager.cc:1434] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:18.860069  7943 ts_tablet_manager.cc:1434] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:04:18.861554  7942 tablet_bootstrap.cc:492] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:18.864681  7943 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:18.884667  7941 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:18.885421  7941 ts_tablet_manager.cc:1403] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.122s	user 0.020s	sys 0.003s
I20260709 13:04:18.887436  7820 raft_consensus.cc:2468] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:18.892527  7941 raft_consensus.cc:359] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.893476  7941 raft_consensus.cc:385] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.893700  7940 tablet_bootstrap.cc:654] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.896010  7953 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.893796  7941 raft_consensus.cc:740] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.899787  7953 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.900378  7941 consensus_queue.cc:260] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.901933  8017 raft_consensus.cc:515] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.903179  7942 tablet_bootstrap.cc:654] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.904204  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:18.905221  7747 raft_consensus.cc:2393] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 1: Already voted for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in this term.
I20260709 13:04:18.905062  8017 leader_election.cc:290] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:18.905674  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:18.906447  7745 raft_consensus.cc:3060] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:18.909303  7949 consensus_queue.cc:1048] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:18.909368  7943 tablet_bootstrap.cc:654] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.915694  7953 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:18.915990  7941 ts_tablet_manager.cc:1434] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:04:18.918709  7941 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:18.917775  7570 catalog_manager.cc:5697] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.933230  7941 tablet_bootstrap.cc:654] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.933902  7943 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:18.934577  7943 ts_tablet_manager.cc:1403] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.003s
I20260709 13:04:18.938314  7943 raft_consensus.cc:359] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.939397  7943 raft_consensus.cc:385] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.939810  7943 raft_consensus.cc:740] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.940833  7943 consensus_queue.cc:260] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:18.943751  7943 ts_tablet_manager.cc:1434] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:18.945176  7943 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:18.952575  7942 tablet_bootstrap.cc:492] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:18.953293  7942 ts_tablet_manager.cc:1403] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.010s
I20260709 13:04:18.953919  7943 tablet_bootstrap.cc:654] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:18.968123  8064 raft_consensus.cc:493] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.968518  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:18.969434  7745 raft_consensus.cc:2468] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:18.969635  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:18.972213  7940 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:18.967067  7569 catalog_manager.cc:5697] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.972978  7940 ts_tablet_manager.cc:1403] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.215s	user 0.010s	sys 0.005s
I20260709 13:04:18.974761  7859 leader_election.cc:304] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:18.975878  8017 raft_consensus.cc:2804] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:18.976485  8017 raft_consensus.cc:697] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:18.977347  8017 consensus_queue.cc:237] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.969056  8064 raft_consensus.cc:515] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:18.991209  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:18.992300  7670 raft_consensus.cc:2468] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:18.992574  7942 raft_consensus.cc:359] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.993675  7942 raft_consensus.cc:385] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:18.993991  7942 raft_consensus.cc:740] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:18.994149  7860 leader_election.cc:304] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:18.994899  7942 consensus_queue.cc:260] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:18.995867  8059 raft_consensus.cc:2804] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:18.996644  8059 raft_consensus.cc:493] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.997048  8059 raft_consensus.cc:3060] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:18.999143  7861 leader_election.cc:343] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.002959  7942 ts_tablet_manager.cc:1434] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.001s
I20260709 13:04:19.004173  7942 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:19.005806  7566 catalog_manager.cc:5697] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.007246  8064 leader_election.cc:290] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:19.008868  7940 raft_consensus.cc:359] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.010406  7940 raft_consensus.cc:385] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.008011  7566 catalog_manager.cc:5697] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.010843  7940 raft_consensus.cc:740] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.012542  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:19.015520  7786 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:19.011827  7940 consensus_queue.cc:260] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.018651  7940 ts_tablet_manager.cc:1434] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:04:19.019770  7940 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:19.022842  8101 raft_consensus.cc:3060] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.024696  8059 raft_consensus.cc:515] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
W20260709 13:04:19.026654  7861 leader_election.cc:343] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.029191  7943 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:19.036207  7943 ts_tablet_manager.cc:1403] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.091s	user 0.024s	sys 0.024s
I20260709 13:04:19.038033  8100 raft_consensus.cc:493] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.038977  8100 raft_consensus.cc:515] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.042430  8101 raft_consensus.cc:2749] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.043355  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69f4370f9c45b5a22013b2937db5fb" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:19.115936  7747 raft_consensus.cc:2468] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:19.052618  7992 consensus_queue.cc:1048] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.065s
I20260709 13:04:19.119148  7785 leader_election.cc:304] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:19.121863  8100 leader_election.cc:290] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:19.122514  8100 raft_consensus.cc:2804] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.122985  8100 raft_consensus.cc:493] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.125818  7941 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:19.124817  8059 leader_election.cc:290] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:19.126544  7941 ts_tablet_manager.cc:1403] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.208s	user 0.029s	sys 0.014s
W20260709 13:04:19.128820  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 102175us
I20260709 13:04:19.131942  7943 raft_consensus.cc:359] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.064935  7940 tablet_bootstrap.cc:654] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.133095  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:19.123432  8100 raft_consensus.cc:3060] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.138082  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:19.138991  7670 raft_consensus.cc:3060] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.010804  7942 tablet_bootstrap.cc:654] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:19.141062  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:19.135692  7943 raft_consensus.cc:385] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.136334  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69f4370f9c45b5a22013b2937db5fb" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:19.141894  7943 raft_consensus.cc:740] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.142087  7893 raft_consensus.cc:2468] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:19.145298  7943 consensus_queue.cc:260] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.152770  7941 raft_consensus.cc:359] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:19.152079  7861 leader_election.cc:343] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.153923  7941 raft_consensus.cc:385] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.154356  7941 raft_consensus.cc:740] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.155709  7943 ts_tablet_manager.cc:1434] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.118s	user 0.015s	sys 0.003s
I20260709 13:04:19.156942  7943 tablet_bootstrap.cc:492] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:19.155643  7941 consensus_queue.cc:260] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.170594  7670 raft_consensus.cc:2468] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:19.173386  7940 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:19.174032  7940 ts_tablet_manager.cc:1403] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.154s	user 0.019s	sys 0.015s
I20260709 13:04:19.177313  7569 catalog_manager.cc:5697] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.182783  7940 raft_consensus.cc:359] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.183598  7940 raft_consensus.cc:385] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.183878  7940 raft_consensus.cc:740] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.184624  7940 consensus_queue.cc:260] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.186105  7860 leader_election.cc:304] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:19.186822  7940 ts_tablet_manager.cc:1434] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:04:19.187331  8059 raft_consensus.cc:2804] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.187937  8059 raft_consensus.cc:697] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:19.187877  7940 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:19.189090  8059 consensus_queue.cc:237] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.192117  7992 consensus_queue.cc:1048] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.197873  7940 tablet_bootstrap.cc:654] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.201647  7941 ts_tablet_manager.cc:1434] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:04:19.202869  7941 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:19.179330  8100 raft_consensus.cc:515] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.219813  7942 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:19.221094  7942 ts_tablet_manager.cc:1403] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.217s	user 0.026s	sys 0.022s
I20260709 13:04:19.246394  7942 raft_consensus.cc:359] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.247406  7942 raft_consensus.cc:385] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.247751  7942 raft_consensus.cc:740] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.249577  7940 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:19.250258  7940 ts_tablet_manager.cc:1403] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.013s
I20260709 13:04:19.249287  7942 consensus_queue.cc:260] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.254428  7942 ts_tablet_manager.cc:1434] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.004s
I20260709 13:04:19.257543  7940 raft_consensus.cc:359] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.258759  7940 raft_consensus.cc:385] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.259125  7940 raft_consensus.cc:740] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.259874  7940 consensus_queue.cc:260] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.261844  7941 tablet_bootstrap.cc:654] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.263696  7992 consensus_queue.cc:1048] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:19.267903  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69f4370f9c45b5a22013b2937db5fb" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:19.268795  7745 raft_consensus.cc:3060] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.270598  8016 raft_consensus.cc:493] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.271167  8016 raft_consensus.cc:515] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.273408  7949 raft_consensus.cc:493] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.274008  7949 raft_consensus.cc:515] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.274432  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00461ff939684b6fb3967bed0ebf0cd7" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:19.276301  7949 leader_election.cc:290] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:19.276959  7860 leader_election.cc:343] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.277557  7940 ts_tablet_manager.cc:1434] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:04:19.278698  7940 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:19.278708  7943 tablet_bootstrap.cc:654] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.282671  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9465bf05df47b988f23dac9f545177" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:19.285068  7745 raft_consensus.cc:2468] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:19.286175  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9465bf05df47b988f23dac9f545177" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:19.286688  7785 leader_election.cc:304] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:19.287925  8101 raft_consensus.cc:2804] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.288642  8101 raft_consensus.cc:697] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:19.289767  8101 consensus_queue.cc:237] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.295480  8016 leader_election.cc:290] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:19.297534  7942 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:19.298695  8074 consensus_queue.cc:1048] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.299978  7992 consensus_queue.cc:1048] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.305660  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f69f4370f9c45b5a22013b2937db5fb" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:19.306353  7894 raft_consensus.cc:3060] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.298748  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00461ff939684b6fb3967bed0ebf0cd7" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:19.309126  7941 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:19.309732  7941 ts_tablet_manager.cc:1403] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.016s
I20260709 13:04:19.313256  7941 raft_consensus.cc:359] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.313992  7941 raft_consensus.cc:385] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.314280  7941 raft_consensus.cc:740] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
W20260709 13:04:19.314707  7710 leader_election.cc:343] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.285105  7670 raft_consensus.cc:2468] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:19.314970  7941 consensus_queue.cc:260] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.321620  7940 tablet_bootstrap.cc:654] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.322866  7712 leader_election.cc:304] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:19.324146  7949 raft_consensus.cc:2804] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.324676  7949 raft_consensus.cc:493] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.325114  7949 raft_consensus.cc:3060] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.324177  7941 ts_tablet_manager.cc:1434] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:19.326509  7941 tablet_bootstrap.cc:492] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:19.326785  7942 tablet_bootstrap.cc:654] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.273429  8100 leader_election.cc:290] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:19.357349  7941 tablet_bootstrap.cc:654] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.359467  7894 raft_consensus.cc:2468] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
W20260709 13:04:19.360098  7859 leader_election.cc:343] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.360803  7859 leader_election.cc:304] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:19.361595  7570 catalog_manager.cc:5697] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.370311  7941 tablet_bootstrap.cc:492] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:19.370893  7941 ts_tablet_manager.cc:1403] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.002s
I20260709 13:04:19.373554  7942 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:19.374169  7942 ts_tablet_manager.cc:1403] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.077s	user 0.005s	sys 0.016s
I20260709 13:04:19.379406  7940 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:19.380126  7940 ts_tablet_manager.cc:1403] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.005s
W20260709 13:04:19.389143  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 69855.8us
I20260709 13:04:19.390542  8016 consensus_queue.cc:1048] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.394101  8101 raft_consensus.cc:493] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.394434  7943 tablet_bootstrap.cc:492] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:19.395213  7943 ts_tablet_manager.cc:1403] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.239s	user 0.014s	sys 0.021s
I20260709 13:04:19.397192  7949 raft_consensus.cc:515] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.400630  7942 raft_consensus.cc:359] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.401510  7942 raft_consensus.cc:385] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.401822  7942 raft_consensus.cc:740] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.402568  7942 consensus_queue.cc:260] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.390547  8129 raft_consensus.cc:493] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:19.403966  7601 debug-util.cc:398] Leaking SignalData structure 0x7b0800051760 after lost signal to thread 434
W20260709 13:04:19.405869  7601 debug-util.cc:398] Leaking SignalData structure 0x7b08002fc840 after lost signal to thread 7604
I20260709 13:04:19.406823  7942 ts_tablet_manager.cc:1434] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:04:19.407495  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9465bf05df47b988f23dac9f545177" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
W20260709 13:04:19.399293  7635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 66472.7us
I20260709 13:04:19.403800  8129 raft_consensus.cc:515] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.408550  7949 leader_election.cc:290] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:19.398311  7943 raft_consensus.cc:359] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.394806  8101 raft_consensus.cc:515] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.412441  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:19.413208  8101 leader_election.cc:290] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:19.407891  7601 debug-util.cc:398] Leaking SignalData structure 0x7b080011eb40 after lost signal to thread 7696
I20260709 13:04:19.413511  7820 raft_consensus.cc:2468] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
W20260709 13:04:19.415119  7601 debug-util.cc:398] Leaking SignalData structure 0x7b0800116cc0 after lost signal to thread 7771
I20260709 13:04:19.415179  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:19.416882  7601 debug-util.cc:398] Leaking SignalData structure 0x7b08001d6be0 after lost signal to thread 7845
I20260709 13:04:19.416476  7941 raft_consensus.cc:359] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.417464  7941 raft_consensus.cc:385] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.417856  7941 raft_consensus.cc:740] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
W20260709 13:04:19.418433  7601 debug-util.cc:398] Leaking SignalData structure 0x7b0800132360 after lost signal to thread 7919
W20260709 13:04:19.419190  7601 debug-util.cc:398] Leaking SignalData structure 0x7b08001acf20 after lost signal to thread 8004
I20260709 13:04:19.418825  7941 consensus_queue.cc:260] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.383872  7940 raft_consensus.cc:359] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
W20260709 13:04:19.419994  7601 debug-util.cc:398] Leaking SignalData structure 0x7b080008a2c0 after lost signal to thread 8046
W20260709 13:04:19.421815  7601 debug-util.cc:398] Leaking SignalData structure 0x7b0800095200 after lost signal to thread 8047
W20260709 13:04:19.422152  7601 debug-util.cc:398] Leaking SignalData structure 0x7b08000834a0 after lost signal to thread 8048
I20260709 13:04:19.422924  7713 leader_election.cc:304] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:19.424491  7670 raft_consensus.cc:3060] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.427736  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9465bf05df47b988f23dac9f545177" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:19.408211  7942 tablet_bootstrap.cc:492] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
W20260709 13:04:19.420675  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 87702.9us
I20260709 13:04:19.420889  8116 consensus_queue.cc:1048] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:19.435624  7941 ts_tablet_manager.cc:1434] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.064s	user 0.010s	sys 0.000s
I20260709 13:04:19.436663  7941 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:19.421272  7940 raft_consensus.cc:385] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.420396  7943 raft_consensus.cc:385] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.437757  7940 raft_consensus.cc:740] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.437994  7943 raft_consensus.cc:740] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.438685  7940 consensus_queue.cc:260] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.438937  7943 consensus_queue.cc:260] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.421406  8129 leader_election.cc:290] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:19.442353  7943 ts_tablet_manager.cc:1434] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:04:19.443496  7943 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:19.424616  7949 raft_consensus.cc:2804] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.427074  7997 raft_consensus.cc:2749] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.444618  7997 raft_consensus.cc:493] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.445253  7997 raft_consensus.cc:515] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.447582  7997 leader_election.cc:290] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:19.452569  7943 tablet_bootstrap.cc:654] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.458693  7941 tablet_bootstrap.cc:654] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.464756  7566 catalog_manager.cc:5697] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:19.466925  7670 raft_consensus.cc:2468] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
W20260709 13:04:19.457034  7636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 51329us
I20260709 13:04:19.468444  7942 tablet_bootstrap.cc:654] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.448391  7949 raft_consensus.cc:493] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.474450  7949 raft_consensus.cc:3060] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:19.483731  7710 leader_election.cc:343] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.504912  8131 raft_consensus.cc:493] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.512806  8131 raft_consensus.cc:515] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.514956  8131 leader_election.cc:290] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:19.515033  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda007baac86482589feb8c8a9761337" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:19.523133  7940 ts_tablet_manager.cc:1434] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.143s	user 0.019s	sys 0.029s
I20260709 13:04:19.524684  7940 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:19.532994  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:19.536415  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda007baac86482589feb8c8a9761337" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:19.538692  7671 raft_consensus.cc:2468] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:19.543205  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa1517a5fc74d25bb5d1b3fa8947cb5" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:19.551911  7638 leader_election.cc:343] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.553663  7997 consensus_queue.cc:1048] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.529652  8131 raft_consensus.cc:493] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.528939  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:19.565651  7973 raft_consensus.cc:493] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.574878  7973 raft_consensus.cc:515] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.577132  7973 leader_election.cc:290] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:19.579113  7712 leader_election.cc:304] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:19.580305  7672 raft_consensus.cc:2393] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 1: Already voted for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in this term.
I20260709 13:04:19.581010  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b1fb849b894694b44d527478e929ad" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:19.582994  7713 leader_election.cc:343] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.584955  7973 raft_consensus.cc:2804] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.585745  7973 raft_consensus.cc:697] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:19.586833  7973 consensus_queue.cc:237] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.598753  7786 leader_election.cc:304] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:19.601706  7860 leader_election.cc:304] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:19.603256  8100 raft_consensus.cc:3060] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.603543  8116 raft_consensus.cc:2804] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.604270  8116 raft_consensus.cc:493] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.604694  8116 raft_consensus.cc:3060] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.607278  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa1517a5fc74d25bb5d1b3fa8947cb5" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:19.573334  8131 raft_consensus.cc:515] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.612644  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b1fb849b894694b44d527478e929ad" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:19.613075  8131 leader_election.cc:290] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:19.613721  7895 raft_consensus.cc:2468] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:19.616024  7670 raft_consensus.cc:2468] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
W20260709 13:04:19.619256  7861 leader_election.cc:343] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:19.620762  7861 consensus_peers.cc:597] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:19.628818  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:19.632684  7636 leader_election.cc:343] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.633714  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:19.634586  7819 raft_consensus.cc:2468] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:19.636803  7638 leader_election.cc:304] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:19.638106  8130 raft_consensus.cc:2804] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.648473  8130 raft_consensus.cc:493] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.658783  8130 raft_consensus.cc:3060] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.661170  7943 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:19.661741  7943 ts_tablet_manager.cc:1403] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.219s	user 0.025s	sys 0.020s
I20260709 13:04:19.661901  8100 raft_consensus.cc:2749] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.664155  7710 leader_election.cc:304] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:19.665122  8129 raft_consensus.cc:2804] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:19.665520  8129 raft_consensus.cc:493] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.665890  8129 raft_consensus.cc:3060] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.665537  7943 raft_consensus.cc:359] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.673692  7943 raft_consensus.cc:385] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.673981  7943 raft_consensus.cc:740] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.673857  8116 raft_consensus.cc:515] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:19.677954  7943 consensus_queue.cc:260] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.652020  7949 raft_consensus.cc:515] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.633270  7636 leader_election.cc:304] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:19.690944  7943 ts_tablet_manager.cc:1434] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:04:19.709707  7940 tablet_bootstrap.cc:654] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.711118  7943 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:19.714864  7743 raft_consensus.cc:2393] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:19.733881  8139 raft_consensus.cc:2749] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.719967  8130 raft_consensus.cc:515] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.744876  7941 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:19.745440  7941 ts_tablet_manager.cc:1403] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.309s	user 0.014s	sys 0.003s
W20260709 13:04:19.729648  7636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 96970.1us
I20260709 13:04:19.732591  8016 consensus_queue.cc:1048] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:04:19.765062  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda007baac86482589feb8c8a9761337" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
W20260709 13:04:19.773109  7861 leader_election.cc:343] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.777226  8101 consensus_queue.cc:1048] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.778730  7941 raft_consensus.cc:359] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.779592  7941 raft_consensus.cc:385] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.779855  7941 raft_consensus.cc:740] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.767825  7943 tablet_bootstrap.cc:654] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.799510  7941 consensus_queue.cc:260] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.801339  8139 consensus_queue.cc:1048] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:04:19.818619  7942 tablet_bootstrap.cc:492] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:19.819397  7942 ts_tablet_manager.cc:1403] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.411s	user 0.016s	sys 0.024s
I20260709 13:04:19.796981  8116 leader_election.cc:290] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:19.831346  7941 ts_tablet_manager.cc:1434] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.003s
I20260709 13:04:19.833184  7941 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:19.825274  8129 raft_consensus.cc:515] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.843541  8129 leader_election.cc:290] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:19.844987  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b1fb849b894694b44d527478e929ad" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:19.836585  7949 leader_election.cc:290] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:19.839433  8116 raft_consensus.cc:493] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.845805  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:19.846534  8116 raft_consensus.cc:515] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:19.846701  7713 leader_election.cc:343] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:19.846765  7821 raft_consensus.cc:3060] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:19.848912  8146 log.cc:927] Time spent T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:04:19.852764  8101 consensus_queue.cc:1048] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:19.859117  8130 leader_election.cc:290] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:19.865051  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:19.869354  7942 raft_consensus.cc:359] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.870311  7942 raft_consensus.cc:385] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.861876  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda007baac86482589feb8c8a9761337" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:19.871359  7942 raft_consensus.cc:740] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.872426  8116 leader_election.cc:290] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:19.878998  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:19.880270  7744 raft_consensus.cc:2393] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:19.876796  7942 consensus_queue.cc:260] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.885540  7942 ts_tablet_manager.cc:1434] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:04:19.889925  7821 raft_consensus.cc:2468] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:19.892343  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9465bf05df47b988f23dac9f545177" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:19.893239  7672 raft_consensus.cc:2393] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc40c50d1f1e4a7eb98877bf59aaf75d in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:19.894285  7713 leader_election.cc:304] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:19.895287  7949 raft_consensus.cc:2804] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.896095  7949 raft_consensus.cc:697] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:19.874680  7670 raft_consensus.cc:3060] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.897246  7949 consensus_queue.cc:237] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:19.904618  7942 tablet_bootstrap.cc:492] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:19.881477  7566 catalog_manager.cc:5697] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:19.911356  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b1fb849b894694b44d527478e929ad" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:19.912102  7894 raft_consensus.cc:3060] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:19.917585  7636 leader_election.cc:304] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:19.918555  8130 raft_consensus.cc:2749] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:19.923024  7940 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:19.923291  7941 tablet_bootstrap.cc:654] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.923681  7940 ts_tablet_manager.cc:1403] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.399s	user 0.016s	sys 0.004s
I20260709 13:04:19.934794  8148 consensus_queue.cc:1048] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:19.938285  7942 tablet_bootstrap.cc:654] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:19.938740  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:19.939666  7672 raft_consensus.cc:2393] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 1: Already voted for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in this term.
I20260709 13:04:19.940166  7894 raft_consensus.cc:2468] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:19.942425  7710 leader_election.cc:304] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:19.944404  7949 raft_consensus.cc:2804] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:19.946322  7949 raft_consensus.cc:697] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:19.949129  7949 consensus_queue.cc:237] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.960157  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d9465bf05df47b988f23dac9f545177" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:19.967527  7943 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:19.968384  7943 ts_tablet_manager.cc:1403] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.257s	user 0.011s	sys 0.010s
W20260709 13:04:19.976934  8151 log.cc:927] Time spent T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:04:19.986229  7942 tablet_bootstrap.cc:492] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:19.986752  7942 ts_tablet_manager.cc:1403] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.000s
I20260709 13:04:19.989856  7942 raft_consensus.cc:359] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.990653  7942 raft_consensus.cc:385] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.989439  7943 raft_consensus.cc:359] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.990911  7942 raft_consensus.cc:740] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.991197  7943 raft_consensus.cc:385] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:19.991693  7943 raft_consensus.cc:740] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:19.993135  7943 consensus_queue.cc:260] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:19.995543  7943 ts_tablet_manager.cc:1434] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:04:19.996759  7943 tablet_bootstrap.cc:492] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:19.991667  7942 consensus_queue.cc:260] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:19.999171  7942 ts_tablet_manager.cc:1434] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:20.003530  7943 tablet_bootstrap.cc:654] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.006804  7942 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:20.010471  8026 raft_consensus.cc:493] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.011112  8026 raft_consensus.cc:515] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.017467  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:20.028206  7940 raft_consensus.cc:359] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.030930  7940 raft_consensus.cc:385] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.026923  7819 raft_consensus.cc:3060] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.031234  7940 raft_consensus.cc:740] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.024693  8101 raft_consensus.cc:493] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.032829  8101 raft_consensus.cc:515] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.035210  8101 leader_election.cc:290] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:20.032099  7940 consensus_queue.cc:260] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.027235  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.038619  7940 ts_tablet_manager.cc:1434] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.000s
I20260709 13:04:20.039649  7940 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:20.025781  8026 leader_election.cc:290] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:20.043219  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b1fb849b894694b44d527478e929ad" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.045071  7895 raft_consensus.cc:2393] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:20.046254  7570 catalog_manager.cc:5697] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.045205  7784 leader_election.cc:304] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:20.048302  7570 catalog_manager.cc:5697] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.020624  7670 raft_consensus.cc:2468] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:20.061105  7941 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:20.061597  7941 ts_tablet_manager.cc:1403] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.229s	user 0.008s	sys 0.029s
I20260709 13:04:20.065696  7860 leader_election.cc:304] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:20.067358  8148 raft_consensus.cc:2804] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:20.067835  8148 raft_consensus.cc:697] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:20.068953  8148 consensus_queue.cc:237] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.069967  7940 tablet_bootstrap.cc:654] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.068743  7941 raft_consensus.cc:359] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.070639  7941 raft_consensus.cc:385] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.071578  7941 raft_consensus.cc:740] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.072976  7941 consensus_queue.cc:260] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.069898  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78b1fb849b894694b44d527478e929ad" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:20.076159  7941 ts_tablet_manager.cc:1434] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:04:20.077713  7941 tablet_bootstrap.cc:492] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:20.081321  7785 leader_election.cc:304] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:20.082597  8101 raft_consensus.cc:3060] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.092384  8101 raft_consensus.cc:2749] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.094766  7941 tablet_bootstrap.cc:654] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.100970  8026 raft_consensus.cc:2749] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.117900  7859 leader_election.cc:304] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:20.120759  8147 raft_consensus.cc:3060] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.129305  7949 raft_consensus.cc:493] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.133198  7942 tablet_bootstrap.cc:654] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.133147  7949 raft_consensus.cc:515] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.134573  7940 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:20.135206  7940 ts_tablet_manager.cc:1403] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.009s
I20260709 13:04:20.137415  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96bceeac5554814ab33aee056d166c2" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.138204  7895 raft_consensus.cc:2468] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:20.138644  7940 raft_consensus.cc:359] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.139343  7940 raft_consensus.cc:385] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.139599  7940 raft_consensus.cc:740] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.139556  7710 leader_election.cc:304] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:20.140849  8117 raft_consensus.cc:2804] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:20.141289  8117 raft_consensus.cc:493] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.141616  8117 raft_consensus.cc:3060] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.141707  7949 leader_election.cc:290] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:20.140839  7940 consensus_queue.cc:260] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.143051  7569 catalog_manager.cc:5697] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.171437  7943 tablet_bootstrap.cc:492] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:20.172268  7943 ts_tablet_manager.cc:1403] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.176s	user 0.026s	sys 0.022s
I20260709 13:04:20.178428  8139 raft_consensus.cc:493] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.179121  8139 raft_consensus.cc:515] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.180886  8147 raft_consensus.cc:2749] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.182972  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00461ff939684b6fb3967bed0ebf0cd7" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.183396  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96bceeac5554814ab33aee056d166c2" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:20.184964  8139 leader_election.cc:290] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:20.185967  7940 ts_tablet_manager.cc:1434] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:04:20.187173  7940 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:20.187814  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00461ff939684b6fb3967bed0ebf0cd7" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:20.188970  7747 raft_consensus.cc:2468] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:20.183797  7895 raft_consensus.cc:2468] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:20.175854  7943 raft_consensus.cc:359] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.192909  7943 raft_consensus.cc:385] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.193202  7943 raft_consensus.cc:740] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.194015  7943 consensus_queue.cc:260] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.192152  7635 leader_election.cc:304] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:20.202131  8139 raft_consensus.cc:2804] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:20.203147  8139 raft_consensus.cc:493] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:20.200611  7712 leader_election.cc:343] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:20.203616  8139 raft_consensus.cc:3060] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.211571  7941 tablet_bootstrap.cc:492] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:20.212227  7941 ts_tablet_manager.cc:1403] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.135s	user 0.017s	sys 0.023s
I20260709 13:04:20.212316  7943 ts_tablet_manager.cc:1434] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:04:20.212443  7949 consensus_queue.cc:1048] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:20.213843  7943 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:20.202463  8117 raft_consensus.cc:515] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.216832  7942 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:20.217437  7942 ts_tablet_manager.cc:1403] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.218s	user 0.032s	sys 0.024s
I20260709 13:04:20.217666  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96bceeac5554814ab33aee056d166c2" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:20.218654  7895 raft_consensus.cc:3060] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.220906  7943 tablet_bootstrap.cc:654] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.226768  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96bceeac5554814ab33aee056d166c2" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:20.223256  8117 leader_election.cc:290] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:20.231549  7712 leader_election.cc:343] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:20.233209  7942 raft_consensus.cc:359] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.235030  7942 raft_consensus.cc:385] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.235392  7942 raft_consensus.cc:740] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.236135  7942 consensus_queue.cc:260] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.244434  7895 raft_consensus.cc:2468] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:20.249106  7942 ts_tablet_manager.cc:1434] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:04:20.242729  7941 raft_consensus.cc:359] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.250553  7942 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:20.250531  7710 leader_election.cc:304] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:20.250859  7941 raft_consensus.cc:385] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.251529  7941 raft_consensus.cc:740] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.254577  7949 raft_consensus.cc:2804] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:20.255221  7949 raft_consensus.cc:697] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:20.256167  7949 consensus_queue.cc:237] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.256942  8139 raft_consensus.cc:515] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.255848  7940 tablet_bootstrap.cc:654] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.262164  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00461ff939684b6fb3967bed0ebf0cd7" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:20.262836  7894 raft_consensus.cc:3060] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.265626  7942 tablet_bootstrap.cc:654] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.265761  8129 consensus_queue.cc:1048] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:20.273038  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:20.275720  7941 consensus_queue.cc:260] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.280930  8147 raft_consensus.cc:493] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.273238  7894 raft_consensus.cc:2468] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:20.288748  7941 ts_tablet_manager.cc:1434] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:04:20.285506  8147 raft_consensus.cc:515] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.290957  7941 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:20.303583  8147 leader_election.cc:290] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:20.308012  7635 leader_election.cc:304] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:20.313848  7992 raft_consensus.cc:2804] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:20.314637  7992 raft_consensus.cc:697] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:20.314996  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00461ff939684b6fb3967bed0ebf0cd7" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:20.315662  7747 raft_consensus.cc:3060] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.315490  7992 consensus_queue.cc:237] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.318972  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f531d2e532f4a488a87413159704294" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:20.300190  8139 leader_election.cc:290] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:20.322237  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f531d2e532f4a488a87413159704294" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:20.322896  7747 raft_consensus.cc:2468] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
W20260709 13:04:20.324275  7859 leader_election.cc:343] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:20.325076  7861 leader_election.cc:343] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:20.325613  7861 leader_election.cc:304] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:20.326488  8148 raft_consensus.cc:2749] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.320886  7569 catalog_manager.cc:5697] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.345855  7943 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:20.346439  7943 ts_tablet_manager.cc:1403] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.133s	user 0.010s	sys 0.009s
I20260709 13:04:20.349893  7943 raft_consensus.cc:359] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.350626  7943 raft_consensus.cc:385] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.350903  7943 raft_consensus.cc:740] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.351613  7943 consensus_queue.cc:260] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.354333  7943 ts_tablet_manager.cc:1434] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:04:20.355388  7943 tablet_bootstrap.cc:492] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:20.358973  7941 tablet_bootstrap.cc:654] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.366892  8117 consensus_queue.cc:1048] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:20.376816  7940 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:20.377435  7940 ts_tablet_manager.cc:1403] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.191s	user 0.021s	sys 0.015s
I20260709 13:04:20.389294  8129 consensus_queue.cc:1048] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:20.398182  8100 raft_consensus.cc:493] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.399040  8100 raft_consensus.cc:515] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.403438  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda007baac86482589feb8c8a9761337" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.407601  7941 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:20.408392  7941 ts_tablet_manager.cc:1403] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.011s
I20260709 13:04:20.409915  7942 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:20.410533  7942 ts_tablet_manager.cc:1403] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.160s	user 0.023s	sys 0.038s
I20260709 13:04:20.411793  7941 raft_consensus.cc:359] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.412643  7941 raft_consensus.cc:385] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.412931  7941 raft_consensus.cc:740] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.413980  7941 consensus_queue.cc:260] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.414860  8147 raft_consensus.cc:493] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.415778  8147 raft_consensus.cc:515] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.418779  8147 leader_election.cc:290] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:20.414785  7942 raft_consensus.cc:359] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.423300  7942 raft_consensus.cc:385] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.423692  7942 raft_consensus.cc:740] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.424604  7942 consensus_queue.cc:260] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.427160  7943 tablet_bootstrap.cc:654] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.429315  7942 ts_tablet_manager.cc:1434] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:04:20.431725  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6de6b4220944748b4c901c3f0e50bfe" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:20.433301  7942 tablet_bootstrap.cc:492] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:20.440747  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6de6b4220944748b4c901c3f0e50bfe" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
W20260709 13:04:20.442723  7861 leader_election.cc:343] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:20.443455  7860 leader_election.cc:343] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:20.444092  7860 leader_election.cc:304] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:20.449828  7942 tablet_bootstrap.cc:654] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.450587  8100 leader_election.cc:290] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:20.453137  8148 raft_consensus.cc:2749] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.458942  7941 ts_tablet_manager.cc:1434] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:04:20.460371  7941 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:20.464444  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda007baac86482589feb8c8a9761337" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:20.464799  7820 raft_consensus.cc:3060] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.466182  7671 raft_consensus.cc:2393] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 1: Already voted for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in this term.
I20260709 13:04:20.469915  7786 leader_election.cc:304] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:20.476173  7942 tablet_bootstrap.cc:492] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:20.478948  7942 ts_tablet_manager.cc:1403] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.005s
I20260709 13:04:20.488781  7943 tablet_bootstrap.cc:492] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:20.489703  7943 ts_tablet_manager.cc:1403] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.135s	user 0.016s	sys 0.007s
I20260709 13:04:20.491807  8100 raft_consensus.cc:2749] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.492198  7942 raft_consensus.cc:359] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.492872  7942 raft_consensus.cc:385] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.493132  7942 raft_consensus.cc:740] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.493777  8148 consensus_queue.cc:1048] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:20.493849  7942 consensus_queue.cc:260] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.496373  7942 ts_tablet_manager.cc:1434] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:04:20.497572  7942 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:20.501713  7943 raft_consensus.cc:359] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.505810  7941 tablet_bootstrap.cc:654] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.506284  7942 tablet_bootstrap.cc:654] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.506697  7569 catalog_manager.cc:5697] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.509519  7943 raft_consensus.cc:385] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.510218  7943 raft_consensus.cc:740] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.511533  7943 consensus_queue.cc:260] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.516721  7943 ts_tablet_manager.cc:1434] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:04:20.516507  7940 raft_consensus.cc:359] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.517302  7940 raft_consensus.cc:385] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.524463  7943 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:20.517676  7940 raft_consensus.cc:740] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.531750  7940 consensus_queue.cc:260] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.534905  7940 ts_tablet_manager.cc:1434] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.157s	user 0.006s	sys 0.000s
I20260709 13:04:20.536278  7940 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:20.541929  7997 consensus_queue.cc:1048] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:20.555562  7941 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:20.556301  7941 ts_tablet_manager.cc:1403] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.008s
I20260709 13:04:20.562103  7940 tablet_bootstrap.cc:654] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.566471  8129 raft_consensus.cc:493] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.567034  8129 raft_consensus.cc:515] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.567644  8174 raft_consensus.cc:493] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.568178  8174 raft_consensus.cc:515] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.570255  8174 leader_election.cc:290] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:20.570605  8129 leader_election.cc:290] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:20.573881  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287ecd0addf408bbf1e25813f68a5df" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:20.574046  8129 consensus_queue.cc:1048] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:20.574110  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f531d2e532f4a488a87413159704294" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:20.575286  7820 raft_consensus.cc:2468] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:20.575733  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f531d2e532f4a488a87413159704294" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.575963  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287ecd0addf408bbf1e25813f68a5df" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.576516  7894 raft_consensus.cc:2468] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:20.577867  7713 leader_election.cc:304] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:20.581336  8129 raft_consensus.cc:2804] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:20.581754  8129 raft_consensus.cc:493] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.582300  8129 raft_consensus.cc:3060] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.573881  7943 tablet_bootstrap.cc:654] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.590036  8174 raft_consensus.cc:493] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.590742  8174 raft_consensus.cc:515] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.594112  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa1517a5fc74d25bb5d1b3fa8947cb5" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:20.594890  7671 raft_consensus.cc:2468] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
W20260709 13:04:20.596297  7710 leader_election.cc:343] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:20.596777  7712 leader_election.cc:304] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:20.597635  8117 raft_consensus.cc:2804] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:20.598115  8117 raft_consensus.cc:493] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.598454  8117 raft_consensus.cc:3060] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:20.601665  7713 leader_election.cc:343] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:20.602240  7713 leader_election.cc:304] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:20.605021  7949 raft_consensus.cc:2749] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.606460  8117 raft_consensus.cc:515] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.608148  7992 raft_consensus.cc:493] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.608716  7992 raft_consensus.cc:515] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.609481  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa1517a5fc74d25bb5d1b3fa8947cb5" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:20.610204  7671 raft_consensus.cc:3060] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.610888  7992 leader_election.cc:290] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:20.612051  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2887a0ab539d41ecba648e3621ce28a0" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:20.613481  7638 leader_election.cc:343] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:20.614215  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2887a0ab539d41ecba648e3621ce28a0" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:20.614665  7949 consensus_queue.cc:1048] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:20.615630  7636 leader_election.cc:343] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:20.616137  7636 leader_election.cc:304] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:20.617313  8131 raft_consensus.cc:2749] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.620996  7671 raft_consensus.cc:2468] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:20.624410  7712 leader_election.cc:304] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:20.625434  7949 raft_consensus.cc:2804] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:20.627118  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa1517a5fc74d25bb5d1b3fa8947cb5" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:20.627831  7819 raft_consensus.cc:3060] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.630774  8129 raft_consensus.cc:515] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.642200  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f531d2e532f4a488a87413159704294" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:20.643044  7821 raft_consensus.cc:3060] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.647099  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa1517a5fc74d25bb5d1b3fa8947cb5" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:20.650234  8174 leader_election.cc:290] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:20.621137  7941 raft_consensus.cc:359] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.622709  8117 leader_election.cc:290] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:20.651917  7941 raft_consensus.cc:385] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.652299  7941 raft_consensus.cc:740] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.653481  7821 raft_consensus.cc:2468] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:20.653121  7941 consensus_queue.cc:260] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.655082  7713 leader_election.cc:304] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:20.656797  8129 leader_election.cc:290] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:20.668853  8129 raft_consensus.cc:2804] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:20.669497  8129 raft_consensus.cc:697] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:20.670459  8129 consensus_queue.cc:237] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.692862  7942 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:20.693399  7942 ts_tablet_manager.cc:1403] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.196s	user 0.045s	sys 0.062s
I20260709 13:04:20.658013  7941 ts_tablet_manager.cc:1434] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260709 13:04:20.659555  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f531d2e532f4a488a87413159704294" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:20.662046  7940 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:20.695677  7894 raft_consensus.cc:3060] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.695816  7940 ts_tablet_manager.cc:1403] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.005s
I20260709 13:04:20.697044  7942 raft_consensus.cc:359] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.697778  7942 raft_consensus.cc:385] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.698047  7942 raft_consensus.cc:740] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.698846  7942 consensus_queue.cc:260] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.699045  7940 raft_consensus.cc:359] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.699710  7940 raft_consensus.cc:385] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.700009  7940 raft_consensus.cc:740] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.701150  7942 ts_tablet_manager.cc:1434] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:20.700836  7940 consensus_queue.cc:260] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.702811  7940 ts_tablet_manager.cc:1434] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:04:20.704526  7942 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:20.706259  7894 raft_consensus.cc:2468] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:20.708016  7941 tablet_bootstrap.cc:492] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:20.717417  7940 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:20.711021  7942 tablet_bootstrap.cc:654] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.724174  7941 tablet_bootstrap.cc:654] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.713076  7943 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:20.728633  7943 ts_tablet_manager.cc:1403] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.205s	user 0.008s	sys 0.010s
I20260709 13:04:20.731426  7940 tablet_bootstrap.cc:654] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.731428  7943 raft_consensus.cc:359] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.732870  7943 raft_consensus.cc:385] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.733139  7943 raft_consensus.cc:740] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.733801  7943 consensus_queue.cc:260] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.735296  7943 ts_tablet_manager.cc:1434] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:04:20.741497  7942 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:20.742235  7942 ts_tablet_manager.cc:1403] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.008s
I20260709 13:04:20.713456  7819 raft_consensus.cc:2468] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:20.713980  7949 raft_consensus.cc:697] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:20.744714  7949 consensus_queue.cc:237] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.746456  7942 raft_consensus.cc:359] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.747536  7942 raft_consensus.cc:385] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.748260  7943 tablet_bootstrap.cc:492] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:20.747892  7942 raft_consensus.cc:740] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.751202  7940 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:20.751772  7940 ts_tablet_manager.cc:1403] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.006s
I20260709 13:04:20.754264  7942 consensus_queue.cc:260] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.754730  7940 raft_consensus.cc:359] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.755857  7940 raft_consensus.cc:385] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.756184  7940 raft_consensus.cc:740] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.756965  7940 consensus_queue.cc:260] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.757217  7942 ts_tablet_manager.cc:1434] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:04:20.759943  7942 tablet_bootstrap.cc:492] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:20.762178  7940 ts_tablet_manager.cc:1434] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:20.765872  7941 tablet_bootstrap.cc:492] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:20.766474  7941 ts_tablet_manager.cc:1403] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.000s
I20260709 13:04:20.767691  7942 tablet_bootstrap.cc:654] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.768015  7570 catalog_manager.cc:5697] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.773952  7949 consensus_queue.cc:1048] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:20.774307  8100 raft_consensus.cc:493] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.775694  8100 raft_consensus.cc:515] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.777962  8100 leader_election.cc:290] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:20.779309  7949 raft_consensus.cc:493] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.780026  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6de6b4220944748b4c901c3f0e50bfe" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.780771  7893 raft_consensus.cc:2468] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:20.781844  7784 leader_election.cc:304] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:20.782718  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6de6b4220944748b4c901c3f0e50bfe" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:20.783113  8026 raft_consensus.cc:2804] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:20.783402  7671 raft_consensus.cc:2468] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:20.783524  8026 raft_consensus.cc:493] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.784016  8026 raft_consensus.cc:3060] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.779966  7949 raft_consensus.cc:515] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.787002  8131 raft_consensus.cc:493] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.787520  8131 raft_consensus.cc:515] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.789577  8131 leader_election.cc:290] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:20.790565  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96bceeac5554814ab33aee056d166c2" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.791680  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96bceeac5554814ab33aee056d166c2" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:20.793715  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2887a0ab539d41ecba648e3621ce28a0" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:20.794395  7671 raft_consensus.cc:2468] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:20.795656  7636 leader_election.cc:304] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:20.796934  7712 leader_election.cc:304] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:20.797807  8188 raft_consensus.cc:2804] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:20.798189  8188 raft_consensus.cc:493] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.798521  8188 raft_consensus.cc:3060] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.799355  7992 raft_consensus.cc:2749] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.803221  7941 raft_consensus.cc:359] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.809098  7941 raft_consensus.cc:385] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.809736  7941 raft_consensus.cc:740] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.812742  7943 tablet_bootstrap.cc:654] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.817739  8188 raft_consensus.cc:515] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.806286  8026 raft_consensus.cc:515] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.807453  7949 leader_election.cc:290] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:20.821203  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6de6b4220944748b4c901c3f0e50bfe" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:20.821858  7893 raft_consensus.cc:3060] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.821978  8026 leader_election.cc:290] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:20.775187  7570 catalog_manager.cc:5697] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:20.829035  7942 tablet_bootstrap.cc:492] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:20.829737  7942 ts_tablet_manager.cc:1403] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.070s	user 0.014s	sys 0.003s
I20260709 13:04:20.830338  8026 raft_consensus.cc:493] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.805272  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2887a0ab539d41ecba648e3621ce28a0" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:20.830930  8026 raft_consensus.cc:515] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.812569  8131 consensus_queue.cc:1048] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:20.811657  7941 consensus_queue.cc:260] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.833304  7941 ts_tablet_manager.cc:1434] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 13:04:20.833012  7942 raft_consensus.cc:359] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.833808  7942 raft_consensus.cc:385] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.834322  7941 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:20.836323  7819 raft_consensus.cc:2468] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:20.837313  7670 raft_consensus.cc:3060] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.837424  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2887a0ab539d41ecba648e3621ce28a0" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:20.839529  7672 raft_consensus.cc:3060] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.841234  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6de6b4220944748b4c901c3f0e50bfe" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:20.841840  7671 raft_consensus.cc:3060] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.843255  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2887a0ab539d41ecba648e3621ce28a0" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:20.844801  8188 leader_election.cc:290] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:20.808225  7940 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:20.834100  7942 raft_consensus.cc:740] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.850600  7942 consensus_queue.cc:260] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.843958  7819 raft_consensus.cc:3060] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.860123  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2887a0ab539d41ecba648e3621ce28a0" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:20.860266  7941 tablet_bootstrap.cc:654] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.872180  7992 consensus_queue.cc:1048] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:20.875517  8026 leader_election.cc:290] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:20.876734  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2887a0ab539d41ecba648e3621ce28a0" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:20.877947  7747 raft_consensus.cc:2393] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:20.879531  7785 leader_election.cc:304] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:20.885847  7940 tablet_bootstrap.cc:654] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.886077  7942 ts_tablet_manager.cc:1434] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.001s
I20260709 13:04:20.888378  7942 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:20.891711  7941 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:20.892802  8100 raft_consensus.cc:493] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.893335  8100 raft_consensus.cc:515] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.896018  7941 ts_tablet_manager.cc:1403] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.008s
I20260709 13:04:20.902174  8100 leader_election.cc:290] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:20.893280  7671 raft_consensus.cc:2468] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:20.916292  7786 leader_election.cc:304] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:20.917309  8101 raft_consensus.cc:2804] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:20.917843  8101 raft_consensus.cc:697] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:20.891782  7819 raft_consensus.cc:2468] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:20.918902  8026 raft_consensus.cc:2749] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:20.918715  8101 consensus_queue.cc:237] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:20.926285  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287ecd0addf408bbf1e25813f68a5df" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:20.927219  7747 raft_consensus.cc:2468] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:20.928751  7785 leader_election.cc:304] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:20.928766  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287ecd0addf408bbf1e25813f68a5df" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:20.929769  7942 tablet_bootstrap.cc:654] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:20.929728  7895 raft_consensus.cc:2468] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:20.932279  8026 raft_consensus.cc:2804] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:20.932739  8026 raft_consensus.cc:493] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.933092  8026 raft_consensus.cc:3060] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:20.941524  7713 leader_election.cc:304] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:20.925354  7893 raft_consensus.cc:2468] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:20.944424  8188 raft_consensus.cc:2804] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:20.945178  8188 raft_consensus.cc:697] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:20.946346  8188 consensus_queue.cc:237] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.949244  7941 raft_consensus.cc:359] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.950109  7941 raft_consensus.cc:385] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.950392  7941 raft_consensus.cc:740] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.951118  7941 consensus_queue.cc:260] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:20.962280  8174 consensus_queue.cc:1048] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:20.967067  7940 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:20.967736  7940 ts_tablet_manager.cc:1403] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.204s	user 0.018s	sys 0.020s
I20260709 13:04:20.970980  7940 raft_consensus.cc:359] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.971729  7940 raft_consensus.cc:385] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.935245  7672 raft_consensus.cc:2468] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:20.972003  7940 raft_consensus.cc:740] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:20.974500  7943 tablet_bootstrap.cc:492] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:20.975123  7943 ts_tablet_manager.cc:1403] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.239s	user 0.021s	sys 0.011s
I20260709 13:04:20.975396  7940 consensus_queue.cc:260] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:20.977939  7941 ts_tablet_manager.cc:1434] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.000s
I20260709 13:04:20.978904  7941 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:20.992127  7943 raft_consensus.cc:359] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:20.993175  7943 raft_consensus.cc:385] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:20.993538  7943 raft_consensus.cc:740] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.024565  7566 catalog_manager.cc:5697] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.028414  7942 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.030435  7942 ts_tablet_manager.cc:1403] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.015s
I20260709 13:04:21.012014  7943 consensus_queue.cc:260] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.034324  7943 ts_tablet_manager.cc:1434] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:04:21.043401  7942 raft_consensus.cc:359] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.050765  7942 raft_consensus.cc:385] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.051630  7943 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:21.052945  7941 tablet_bootstrap.cc:654] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.051324  7942 raft_consensus.cc:740] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.059687  7942 consensus_queue.cc:260] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.062604  7940 ts_tablet_manager.cc:1434] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.095s	user 0.038s	sys 0.028s
I20260709 13:04:21.064291  7940 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:21.059859  7992 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.060312  7635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 53088.1us
I20260709 13:04:21.077188  7942 ts_tablet_manager.cc:1434] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 13:04:21.087241  7942 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:21.075249  7992 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.098264  8101 raft_consensus.cc:493] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.101423  8101 raft_consensus.cc:515] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.103673  8101 leader_election.cc:290] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:21.105414  8206 raft_consensus.cc:493] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.105924  8206 raft_consensus.cc:515] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.108467  8206 leader_election.cc:290] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:21.108932  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:21.110776  7636 leader_election.cc:343] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.112262  7949 consensus_queue.cc:1048] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:21.112972  8148 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.113464  8148 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.114544  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:21.115232  7940 tablet_bootstrap.cc:654] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:21.116474  7785 leader_election.cc:343] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.117700  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:21.118374  7671 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:21.118690  7992 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:21.119640  7860 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:21.119814  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:21.120631  8147 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:21.121060  8147 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.121395  8147 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.123462  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:21.124223  7669 raft_consensus.cc:2468] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:21.115798  8148 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:21.127674  7638 leader_election.cc:343] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.128069  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:21.128738  7821 raft_consensus.cc:2468] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:21.129688  7786 leader_election.cc:304] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:21.130463  8147 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.131651  7638 leader_election.cc:304] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:21.132537  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:21.119820  7567 catalog_manager.cc:5697] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.135160  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:21.135877  7669 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.131518  8100 raft_consensus.cc:2804] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:21.137385  8100 raft_consensus.cc:493] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.137770  8100 raft_consensus.cc:3060] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.139245  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:21.140125  7894 raft_consensus.cc:2393] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 1: Already voted for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in this term.
I20260709 13:04:21.141723  7635 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:21.142549  8131 raft_consensus.cc:2804] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:21.143183  8131 raft_consensus.cc:493] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.143532  8131 raft_consensus.cc:3060] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:21.149315  7861 leader_election.cc:343] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.151222  8131 raft_consensus.cc:515] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.155767  7943 tablet_bootstrap.cc:654] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.158818  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:21.142472  8026 raft_consensus.cc:515] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
W20260709 13:04:21.160548  7861 leader_election.cc:343] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.166638  8026 leader_election.cc:290] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:21.160562  8147 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:21.168479  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287ecd0addf408bbf1e25813f68a5df" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:21.170287  7669 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:21.170554  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0287ecd0addf408bbf1e25813f68a5df" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:21.172541  8100 raft_consensus.cc:515] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.175071  7992 raft_consensus.cc:2749] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:21.175429  7743 raft_consensus.cc:3060] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.180446  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:21.180805  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:21.181278  8131 leader_election.cc:290] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:21.174711  7894 raft_consensus.cc:3060] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.185901  7819 raft_consensus.cc:2393] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 1: Already voted for candidate 7873a3a04f1f4097ac2435c017ca346a in this term.
W20260709 13:04:21.182826  7636 leader_election.cc:343] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.188010  7860 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:21.189266  8148 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:21.189769  8148 raft_consensus.cc:697] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:21.190593  8148 consensus_queue.cc:237] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.198030  7638 leader_election.cc:304] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:21.212548  8131 raft_consensus.cc:2749] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:21.214470  7943 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:21.214980  7943 ts_tablet_manager.cc:1403] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.164s	user 0.010s	sys 0.003s
I20260709 13:04:21.220081  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:21.233342  7669 raft_consensus.cc:2393] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 1: Already voted for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in this term.
I20260709 13:04:21.223358  7940 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:21.236022  7940 ts_tablet_manager.cc:1403] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.172s	user 0.026s	sys 0.027s
I20260709 13:04:21.228026  8117 consensus_queue.cc:1048] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:04:21.226644  7941 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:21.239315  7743 raft_consensus.cc:2468] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:21.239781  7941 ts_tablet_manager.cc:1403] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.261s	user 0.017s	sys 0.008s
I20260709 13:04:21.240017  7940 raft_consensus.cc:359] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.224689  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:21.241571  7940 raft_consensus.cc:385] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.223526  8100 leader_election.cc:290] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:21.241968  7894 raft_consensus.cc:2468] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:21.243717  7942 tablet_bootstrap.cc:654] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.236253  7943 raft_consensus.cc:359] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.245311  7943 raft_consensus.cc:385] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.245638  7943 raft_consensus.cc:740] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.246090  7941 raft_consensus.cc:359] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.247007  7941 raft_consensus.cc:385] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.247328  7941 raft_consensus.cc:740] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.240936  7785 leader_election.cc:304] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
W20260709 13:04:21.249086  7785 leader_election.cc:343] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.249545  7785 leader_election.cc:304] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:21.250347  8026 raft_consensus.cc:2804] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:21.250756  8100 raft_consensus.cc:2749] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:21.251037  8026 raft_consensus.cc:697] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:21.251947  8026 consensus_queue.cc:237] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.254364  7941 consensus_queue.cc:260] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.262943  7941 ts_tablet_manager.cc:1434] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:04:21.264324  7941 tablet_bootstrap.cc:492] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:21.259490  7943 consensus_queue.cc:260] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.241991  7940 raft_consensus.cc:740] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.265466  7940 consensus_queue.cc:260] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.267693  7940 ts_tablet_manager.cc:1434] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.001s
I20260709 13:04:21.271603  7567 catalog_manager.cc:5697] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.274766  7570 catalog_manager.cc:5697] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.285003  7941 tablet_bootstrap.cc:654] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.286456  7940 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:21.296500  8188 consensus_queue.cc:1048] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:21.303651  8117 consensus_queue.cc:1048] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:21.313083  7943 ts_tablet_manager.cc:1434] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.098s	user 0.010s	sys 0.000s
I20260709 13:04:21.315307  7943 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:21.331064  7942 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.331717  7942 ts_tablet_manager.cc:1403] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.246s	user 0.021s	sys 0.008s
I20260709 13:04:21.335768  7940 tablet_bootstrap.cc:654] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.382196  8174 consensus_queue.cc:1048] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:21.418159  8026 consensus_queue.cc:1048] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:21.421655  8129 raft_consensus.cc:493] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.422297  8129 raft_consensus.cc:515] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.424678  8129 leader_election.cc:290] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:21.428419  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911fc9d471948a3878933bd85d9b5e9" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:21.429924  8148 raft_consensus.cc:493] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.429855  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911fc9d471948a3878933bd85d9b5e9" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:21.430754  8148 raft_consensus.cc:515] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.435750  8148 leader_election.cc:290] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:21.437824  7710 leader_election.cc:343] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.441071  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7a48d13f746369b2ee192d52214bc" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:21.441557  7713 leader_election.cc:343] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.438282  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7a48d13f746369b2ee192d52214bc" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:21.442292  7672 raft_consensus.cc:2468] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:21.443672  7713 leader_election.cc:304] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:21.446715  8174 raft_consensus.cc:2749] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:21.443804  7860 leader_election.cc:304] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
W20260709 13:04:21.447505  7859 leader_election.cc:343] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.450129  8211 raft_consensus.cc:2804] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:21.450639  8211 raft_consensus.cc:493] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.444588  7942 raft_consensus.cc:359] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.450974  8211 raft_consensus.cc:3060] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.451099  7942 raft_consensus.cc:385] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.451423  7942 raft_consensus.cc:740] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.452261  7942 consensus_queue.cc:260] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.458506  7942 ts_tablet_manager.cc:1434] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.000s
I20260709 13:04:21.459712  7942 tablet_bootstrap.cc:492] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:21.465283  7941 tablet_bootstrap.cc:492] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:21.466187  7941 ts_tablet_manager.cc:1403] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.202s	user 0.009s	sys 0.009s
I20260709 13:04:21.487396  7943 tablet_bootstrap.cc:654] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.499962  7940 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:21.500720  7940 ts_tablet_manager.cc:1403] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.215s	user 0.020s	sys 0.069s
I20260709 13:04:21.509071  8211 raft_consensus.cc:515] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.512713  8148 raft_consensus.cc:493] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.518059  8026 consensus_queue.cc:1048] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:21.519156  8148 raft_consensus.cc:515] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.512741  7940 raft_consensus.cc:359] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.515537  8117 consensus_queue.cc:1048] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:21.509938  7941 raft_consensus.cc:359] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.521003  7940 raft_consensus.cc:385] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.521929  7941 raft_consensus.cc:385] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.522029  7940 raft_consensus.cc:740] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.522362  7941 raft_consensus.cc:740] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.523159  7940 consensus_queue.cc:260] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.526393  7940 ts_tablet_manager.cc:1434] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:04:21.526919  7942 tablet_bootstrap.cc:654] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.530025  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:21.530910  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:21.531728  7669 raft_consensus.cc:2468] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
W20260709 13:04:21.534530  7861 leader_election.cc:343] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.535445  7860 leader_election.cc:304] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:21.536772  8147 raft_consensus.cc:2804] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:21.537168  8147 raft_consensus.cc:493] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.537500  8147 raft_consensus.cc:3060] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.539863  7940 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:21.542867  7941 consensus_queue.cc:260] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.548707  7941 ts_tablet_manager.cc:1434] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.001s
I20260709 13:04:21.554011  7941 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:21.543116  8148 leader_election.cc:290] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:21.590914  8147 raft_consensus.cc:515] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.596617  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:21.598176  8211 leader_election.cc:290] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:21.598863  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:21.599587  7671 raft_consensus.cc:3060] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.599677  7943 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:21.600515  8147 leader_election.cc:290] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:21.600741  7943 ts_tablet_manager.cc:1403] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.286s	user 0.022s	sys 0.005s
I20260709 13:04:21.599524  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7a48d13f746369b2ee192d52214bc" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:21.619292  7669 raft_consensus.cc:3060] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.622327  8117 raft_consensus.cc:493] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.622872  8117 raft_consensus.cc:515] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.621798  7942 tablet_bootstrap.cc:492] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.625845  7942 ts_tablet_manager.cc:1403] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.166s	user 0.018s	sys 0.028s
W20260709 13:04:21.606850  7861 leader_election.cc:343] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.629925  7942 raft_consensus.cc:359] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.631588  7942 raft_consensus.cc:385] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.631916  7942 raft_consensus.cc:740] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.632766  7942 consensus_queue.cc:260] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.634877  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:21.636469  7669 raft_consensus.cc:2468] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:21.637919  7860 leader_election.cc:304] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
W20260709 13:04:21.638830  7710 leader_election.cc:343] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.639629  8211 raft_consensus.cc:2804] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:21.640157  8211 raft_consensus.cc:697] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:21.618819  7943 raft_consensus.cc:359] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.641301  7943 raft_consensus.cc:385] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.641727  8117 leader_election.cc:290] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:21.599814  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7a48d13f746369b2ee192d52214bc" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:21.609503  7671 raft_consensus.cc:2468] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:21.643927  7942 ts_tablet_manager.cc:1434] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:21.644937  7942 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
W20260709 13:04:21.646032  7859 leader_election.cc:343] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.648428  7860 leader_election.cc:304] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:21.649260  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:21.649914  8148 raft_consensus.cc:2804] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:21.650488  8148 raft_consensus.cc:697] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:21.650960  7942 tablet_bootstrap.cc:654] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.610915  7940 tablet_bootstrap.cc:654] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.640939  8211 consensus_queue.cc:237] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:21.652426  7712 leader_election.cc:343] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.652999  7712 leader_election.cc:304] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:21.653899  8117 raft_consensus.cc:2749] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:21.651466  8148 consensus_queue.cc:237] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.607784  7941 tablet_bootstrap.cc:654] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.669674  7943 raft_consensus.cc:740] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.670804  7943 consensus_queue.cc:260] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.690068  7941 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:21.691198  7941 ts_tablet_manager.cc:1403] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.137s	user 0.014s	sys 0.000s
I20260709 13:04:21.692204  7943 ts_tablet_manager.cc:1434] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.002s
I20260709 13:04:21.693944  7941 raft_consensus.cc:359] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.694900  7941 raft_consensus.cc:385] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.695179  7941 raft_consensus.cc:740] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.695940  7941 consensus_queue.cc:260] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:21.698370  7941 ts_tablet_manager.cc:1434] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:21.704515  7941 tablet_bootstrap.cc:492] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:21.706353  7942 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.706969  7942 ts_tablet_manager.cc:1403] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.018s
I20260709 13:04:21.710304  7942 raft_consensus.cc:359] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.714218  7942 raft_consensus.cc:385] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.714500  7942 raft_consensus.cc:740] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.716341  7942 consensus_queue.cc:260] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.718838  7942 ts_tablet_manager.cc:1434] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 13:04:21.719929  7942 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:21.728293  7942 tablet_bootstrap.cc:654] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.736076  7941 tablet_bootstrap.cc:654] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.744081  7949 raft_consensus.cc:493] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.745013  7949 raft_consensus.cc:515] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.749158  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:21.749714  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:21.750105  7669 raft_consensus.cc:2393] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 1: Already voted for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in this term.
I20260709 13:04:21.750341  7942 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.751171  7949 leader_election.cc:290] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:21.751369  7942 ts_tablet_manager.cc:1403] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.008s
I20260709 13:04:21.750653  7821 raft_consensus.cc:2393] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 1: Already voted for candidate 7873a3a04f1f4097ac2435c017ca346a in this term.
I20260709 13:04:21.750341  7941 tablet_bootstrap.cc:492] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:21.752382  7941 ts_tablet_manager.cc:1403] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 13:04:21.753402  7712 leader_election.cc:304] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:21.754261  7942 raft_consensus.cc:359] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.754997  7942 raft_consensus.cc:385] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.754839  7941 raft_consensus.cc:359] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.755085  7949 raft_consensus.cc:3060] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.755407  7942 raft_consensus.cc:740] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.757918  7942 consensus_queue.cc:260] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.758809  7941 raft_consensus.cc:385] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.759670  7941 raft_consensus.cc:740] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.760330  7942 ts_tablet_manager.cc:1434] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:04:21.760426  7941 consensus_queue.cc:260] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.761472  7942 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:21.765758  7941 ts_tablet_manager.cc:1434] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 13:04:21.768484  7942 tablet_bootstrap.cc:654] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.773389  7949 raft_consensus.cc:2749] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:21.759771  7821 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.780025  7942 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.788616  7942 ts_tablet_manager.cc:1403] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.007s
I20260709 13:04:21.791565  7942 raft_consensus.cc:359] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.792261  7942 raft_consensus.cc:385] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.792529  7942 raft_consensus.cc:740] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.782106  7941 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:21.794925  7942 consensus_queue.cc:260] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.796512  7942 ts_tablet_manager.cc:1434] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:21.797423  7942 tablet_bootstrap.cc:492] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:21.803090  7942 tablet_bootstrap.cc:654] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.803499  8101 consensus_queue.cc:1048] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:21.808267  8101 consensus_queue.cc:1048] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:21.823025  7941 tablet_bootstrap.cc:654] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.828118  8211 raft_consensus.cc:493] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.828944  8211 raft_consensus.cc:515] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.693887  7943 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:21.835868  7567 catalog_manager.cc:5697] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.837580  7567 catalog_manager.cc:5697] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.840760  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911fc9d471948a3878933bd85d9b5e9" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:21.842062  7743 raft_consensus.cc:2468] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:21.848212  7859 leader_election.cc:304] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:21.849391  7997 raft_consensus.cc:2804] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:21.849822  7997 raft_consensus.cc:493] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.850167  7997 raft_consensus.cc:3060] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.852926  8148 consensus_queue.cc:1048] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:21.854472  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:21.831941  8211 leader_election.cc:290] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:21.863116  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911fc9d471948a3878933bd85d9b5e9" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:21.864096  7818 raft_consensus.cc:2468] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
W20260709 13:04:21.865576  8234 log.cc:927] Time spent T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:04:21.866597  7997 raft_consensus.cc:515] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.869462  7940 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:21.869531  7942 tablet_bootstrap.cc:492] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.871778  7940 ts_tablet_manager.cc:1403] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.332s	user 0.031s	sys 0.053s
I20260709 13:04:21.871876  7942 ts_tablet_manager.cc:1403] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.075s	user 0.004s	sys 0.021s
I20260709 13:04:21.872110  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911fc9d471948a3878933bd85d9b5e9" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:21.872815  7743 raft_consensus.cc:3060] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.876017  7942 raft_consensus.cc:359] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.876780  7942 raft_consensus.cc:385] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.877082  7942 raft_consensus.cc:740] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.877746  7942 consensus_queue.cc:260] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.879523  7940 raft_consensus.cc:359] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.880051  7942 ts_tablet_manager.cc:1434] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:21.880616  7940 raft_consensus.cc:385] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.881023  7940 raft_consensus.cc:740] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.881578  7942 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:21.882001  7940 consensus_queue.cc:260] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.883504  7997 leader_election.cc:290] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:21.883744  7743 raft_consensus.cc:2468] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:21.888736  7942 tablet_bootstrap.cc:654] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.888863  7859 leader_election.cc:304] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:21.890668  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0911fc9d471948a3878933bd85d9b5e9" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:21.891443  7818 raft_consensus.cc:3060] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.894028  8101 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.894577  8101 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.896411  8026 raft_consensus.cc:493] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.896997  8026 raft_consensus.cc:515] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.899080  8026 leader_election.cc:290] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:21.899474  8101 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:21.902125  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:21.902570  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:21.902865  7671 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:21.903369  7669 raft_consensus.cc:2393] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 1: Already voted for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in this term.
I20260709 13:04:21.904704  7786 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:21.906984  8026 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:21.907466  8026 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.907887  8026 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:21.909945  7942 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.910732  7942 ts_tablet_manager.cc:1403] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 13:04:21.912212  7943 tablet_bootstrap.cc:654] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.901687  7997 raft_consensus.cc:2804] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:21.918699  7997 raft_consensus.cc:697] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:21.920478  8101 raft_consensus.cc:493] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.920869  7997 consensus_queue.cc:237] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.921290  8101 raft_consensus.cc:515] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:21.924228  8101 leader_election.cc:290] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:21.925092  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5b29cc10794a339c482492d5fbaa75" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:21.926227  7942 raft_consensus.cc:359] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:21.927377  7785 leader_election.cc:343] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:21.928350  7942 raft_consensus.cc:385] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.928807  7942 raft_consensus.cc:740] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.930109  7942 consensus_queue.cc:260] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.932964  7942 ts_tablet_manager.cc:1434] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.002s
I20260709 13:04:21.934293  7942 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:21.940980  8206 raft_consensus.cc:493] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.941577  8206 raft_consensus.cc:515] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.943818  8206 leader_election.cc:290] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:21.944634  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:21.945163  7942 tablet_bootstrap.cc:654] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:21.945642  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:21.946421  7821 raft_consensus.cc:2468] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:21.947841  7638 leader_election.cc:304] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:21.948657  8206 raft_consensus.cc:2804] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:21.951223  8206 raft_consensus.cc:493] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.951558  8206 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:21.959589  7943 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:21.960405  7943 ts_tablet_manager.cc:1403] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.267s	user 0.014s	sys 0.008s
W20260709 13:04:21.961540  7636 leader_election.cc:343] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:21.961969  8232 log.cc:927] Time spent T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:04:21.963820  7943 raft_consensus.cc:359] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.964696  7943 raft_consensus.cc:385] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.965009  7943 raft_consensus.cc:740] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.967130  7943 consensus_queue.cc:260] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:21.969308  7940 ts_tablet_manager.cc:1434] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.001s
I20260709 13:04:21.970474  7940 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:21.975488  7941 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:21.976146  7941 ts_tablet_manager.cc:1403] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.194s	user 0.033s	sys 0.032s
I20260709 13:04:21.979020  7941 raft_consensus.cc:359] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.980399  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:21.980722  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:21.981655  7942 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:21.982221  7942 ts_tablet_manager.cc:1403] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.015s
I20260709 13:04:21.985598  7942 raft_consensus.cc:359] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.985927  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5b29cc10794a339c482492d5fbaa75" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:21.986299  7942 raft_consensus.cc:385] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:21.986639  7818 raft_consensus.cc:2468] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:21.986742  7893 raft_consensus.cc:2468] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:21.986660  7942 raft_consensus.cc:740] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:21.988580  7942 consensus_queue.cc:260] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.990783  7942 ts_tablet_manager.cc:1434] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:21.991283  7943 ts_tablet_manager.cc:1434] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:04:21.991748  7942 tablet_bootstrap.cc:492] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:21.992437  8100 raft_consensus.cc:493] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.993095  8100 raft_consensus.cc:515] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.995870  8100 leader_election.cc:290] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:21.995900  8026 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:21.992487  7943 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:21.998518  7942 tablet_bootstrap.cc:654] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.001421  8148 consensus_queue.cc:1048] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:22.004231  7784 leader_election.cc:304] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:22.006107  8101 raft_consensus.cc:3060] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.010185  7942 tablet_bootstrap.cc:492] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:22.010725  7942 ts_tablet_manager.cc:1403] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:04:22.012878  7943 tablet_bootstrap.cc:654] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.015224  7942 raft_consensus.cc:359] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.016053  7942 raft_consensus.cc:385] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.016351  7942 raft_consensus.cc:740] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.017552  7942 consensus_queue.cc:260] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.021603  7942 ts_tablet_manager.cc:1434] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:22.022657  7942 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:22.024603  8101 raft_consensus.cc:2749] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:22.025974  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 46778.9us
I20260709 13:04:22.026978  7943 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:22.041361  7943 ts_tablet_manager.cc:1403] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.001s
I20260709 13:04:22.041733  8148 raft_consensus.cc:493] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.042327  8148 raft_consensus.cc:515] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.044505  8148 leader_election.cc:290] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:22.027979  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d5fb6202ad4fb1b17b5bd822d19b47" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:22.028906  7942 tablet_bootstrap.cc:654] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.045248  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d5fb6202ad4fb1b17b5bd822d19b47" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:22.044726  7943 raft_consensus.cc:359] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.050390  7943 raft_consensus.cc:385] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.050491  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:22.050757  7943 raft_consensus.cc:740] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.051208  7743 raft_consensus.cc:2468] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:22.037918  7941 raft_consensus.cc:385] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.052227  7941 raft_consensus.cc:740] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.053385  7941 consensus_queue.cc:260] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.054190  7859 leader_election.cc:304] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:22.054371  7894 raft_consensus.cc:2468] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:22.051513  7943 consensus_queue.cc:260] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.056751  8148 raft_consensus.cc:2804] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:22.040009  7784 leader_election.cc:304] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:22.057890  7941 ts_tablet_manager.cc:1434] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.002s
I20260709 13:04:22.058715  8100 raft_consensus.cc:2804] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:22.059055  7941 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:22.059250  8100 raft_consensus.cc:493] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.059646  8100 raft_consensus.cc:3060] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.037649  8206 raft_consensus.cc:515] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.068135  8148 raft_consensus.cc:493] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.068627  8148 raft_consensus.cc:3060] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.073738  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:22.074757  7821 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:22.078037  7786 leader_election.cc:343] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.079197  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:22.080020  7743 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.091976  7818 raft_consensus.cc:1240] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Rejecting Update request from peer cc40c50d1f1e4a7eb98877bf59aaf75d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:04:22.094487  7941 tablet_bootstrap.cc:654] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.095383  7743 raft_consensus.cc:2468] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:22.056865  7943 ts_tablet_manager.cc:1434] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:22.097208  7943 tablet_bootstrap.cc:492] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:22.109472  8100 raft_consensus.cc:515] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.112893  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5b29cc10794a339c482492d5fbaa75" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
W20260709 13:04:22.114391  7785 leader_election.cc:343] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.114324  7941 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:22.115613  8206 leader_election.cc:290] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:22.116741  7941 ts_tablet_manager.cc:1403] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.003s
I20260709 13:04:22.119845  8148 raft_consensus.cc:515] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.124286  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:22.087805  7821 raft_consensus.cc:2468] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:22.128199  7636 leader_election.cc:304] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
W20260709 13:04:22.130574  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 77941.3us
I20260709 13:04:22.132303  7943 tablet_bootstrap.cc:654] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.132674  7940 tablet_bootstrap.cc:654] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.132992  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:22.134486  8100 leader_election.cc:290] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:22.134593  8131 raft_consensus.cc:2804] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:22.135226  8131 raft_consensus.cc:697] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:22.136219  8131 consensus_queue.cc:237] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.136658  7570 catalog_manager.cc:5697] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.123047  8026 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:22.119841  7941 raft_consensus.cc:359] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.143086  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:22.143451  7941 raft_consensus.cc:385] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.143659  7747 raft_consensus.cc:3060] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.143769  7941 raft_consensus.cc:740] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.144480  7941 consensus_queue.cc:260] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.146550  7941 ts_tablet_manager.cc:1434] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 13:04:22.151621  7747 raft_consensus.cc:2468] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:22.160938  7942 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:22.168884  7942 ts_tablet_manager.cc:1403] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.015s
I20260709 13:04:22.172024  7942 raft_consensus.cc:359] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.173941  7942 raft_consensus.cc:385] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.174232  7942 raft_consensus.cc:740] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.174917  7942 consensus_queue.cc:260] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.161327  8148 leader_election.cc:290] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:22.176906  7860 leader_election.cc:343] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.162674  7941 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:22.178750  8148 consensus_queue.cc:1048] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:22.167063  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:22.177186  7942 ts_tablet_manager.cc:1434] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
W20260709 13:04:22.180734  7860 leader_election.cc:343] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.181077  7942 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:22.197326  7859 leader_election.cc:304] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:22.198650  7940 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
W20260709 13:04:22.192219  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 136518us
I20260709 13:04:22.199213  7940 ts_tablet_manager.cc:1403] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.229s	user 0.011s	sys 0.000s
I20260709 13:04:22.199967  7784 leader_election.cc:304] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:22.193645  8100 raft_consensus.cc:493] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.201108  8100 raft_consensus.cc:515] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.201894  8101 raft_consensus.cc:2804] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:22.202479  8101 raft_consensus.cc:493] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.202924  8101 raft_consensus.cc:3060] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.204353  8100 leader_election.cc:290] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:22.204627  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33813684ca014951b1442b91c51b0c2f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:22.204906  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33813684ca014951b1442b91c51b0c2f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:22.207103  8211 raft_consensus.cc:2804] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:22.207664  8211 raft_consensus.cc:697] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:22.208595  8211 consensus_queue.cc:237] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:22.209717  7785 leader_election.cc:343] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:22.211511  7786 leader_election.cc:343] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.211953  7786 leader_election.cc:304] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:22.212651  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:22.213639  8026 raft_consensus.cc:2749] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:22.215222  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5b29cc10794a339c482492d5fbaa75" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:22.215849  7894 raft_consensus.cc:3060] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.222191  8101 raft_consensus.cc:515] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.222621  8255 consensus_queue.cc:1059] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:04:22.238196  7784 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:22.238812  7942 tablet_bootstrap.cc:654] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.239058  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d5fb6202ad4fb1b17b5bd822d19b47" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:22.239688  7893 raft_consensus.cc:3060] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.238190  7941 tablet_bootstrap.cc:654] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.240824  8255 raft_consensus.cc:3055] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:22.241276  8255 raft_consensus.cc:740] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:22.242476  8255 consensus_queue.cc:260] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.243851  8255 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:22.239784  8026 raft_consensus.cc:2749] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:22.246011  7570 catalog_manager.cc:5697] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.257380  8174 raft_consensus.cc:493] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.258284  8174 raft_consensus.cc:515] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.263873  7940 raft_consensus.cc:359] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.265261  7940 raft_consensus.cc:385] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.265708  7940 raft_consensus.cc:740] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.266796  7940 consensus_queue.cc:260] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.271098  8174 leader_election.cc:290] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:22.272892  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7a48d13f746369b2ee192d52214bc" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:22.274829  7997 consensus_queue.cc:1048] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:22.277740  7747 raft_consensus.cc:3060] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.288854  7569 catalog_manager.cc:5697] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.299264  7894 raft_consensus.cc:2468] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:22.313167  8211 consensus_queue.cc:1048] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:22.324468  7895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1d7a48d13f746369b2ee192d52214bc" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:22.329571  7940 ts_tablet_manager.cc:1434] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.130s	user 0.005s	sys 0.007s
I20260709 13:04:22.330996  7940 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:22.336561  7710 leader_election.cc:304] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:22.338166  7941 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:22.338752  7941 ts_tablet_manager.cc:1403] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.176s	user 0.040s	sys 0.032s
I20260709 13:04:22.338956  8117 raft_consensus.cc:2749] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:22.356025  7784 leader_election.cc:304] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:22.359598  8100 raft_consensus.cc:2804] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:22.347510  8101 leader_election.cc:290] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:22.341517  8211 consensus_queue.cc:1048] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:04:22.369647  8100 raft_consensus.cc:697] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:22.380147  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d5fb6202ad4fb1b17b5bd822d19b47" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:22.376943  8026 raft_consensus.cc:493] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.383642  8026 raft_consensus.cc:515] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.385700  8026 leader_election.cc:290] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:22.392817  7786 leader_election.cc:343] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.401206  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc39bf2ad6844beb8466b427508830f9" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:22.401510  8026 raft_consensus.cc:493] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.402005  8026 raft_consensus.cc:515] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.404644  8026 leader_election.cc:290] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:22.405143  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc39bf2ad6844beb8466b427508830f9" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:22.406354  7894 raft_consensus.cc:2468] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 0.
I20260709 13:04:22.410179  7942 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:22.410800  7942 ts_tablet_manager.cc:1403] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.230s	user 0.026s	sys 0.021s
I20260709 13:04:22.408010  7893 raft_consensus.cc:2468] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:22.414947  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc0069dd6948f0979c733fd0ac5343" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:22.416467  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc0069dd6948f0979c733fd0ac5343" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:22.418449  7785 leader_election.cc:343] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.420116  7942 raft_consensus.cc:359] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.420969  7942 raft_consensus.cc:385] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.420441  8100 consensus_queue.cc:237] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.422390  7784 leader_election.cc:304] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:22.423702  7942 raft_consensus.cc:740] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.424597  7941 raft_consensus.cc:359] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.426221  7941 raft_consensus.cc:385] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.426925  7941 raft_consensus.cc:740] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.427676  7941 consensus_queue.cc:260] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.428182  7943 tablet_bootstrap.cc:492] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:22.428767  7943 ts_tablet_manager.cc:1403] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.332s	user 0.041s	sys 0.030s
I20260709 13:04:22.432142  7942 consensus_queue.cc:260] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.435900  8204 raft_consensus.cc:493] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.443269  8204 raft_consensus.cc:515] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.445991  8204 leader_election.cc:290] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:22.447412  7942 ts_tablet_manager.cc:1434] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:04:22.449257  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:22.449613  7942 tablet_bootstrap.cc:492] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:22.449867  7941 ts_tablet_manager.cc:1434] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.111s	user 0.009s	sys 0.000s
W20260709 13:04:22.449796  7786 leader_election.cc:343] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:22.450773  7785 leader_election.cc:343] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.451236  7941 tablet_bootstrap.cc:492] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:22.454586  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:22.460566  7942 tablet_bootstrap.cc:654] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.462119  7943 raft_consensus.cc:359] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.463146  7943 raft_consensus.cc:385] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.463454  7943 raft_consensus.cc:740] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.464133  7943 consensus_queue.cc:260] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.472560  7941 tablet_bootstrap.cc:654] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.474176  8206 raft_consensus.cc:493] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.468747  8204 raft_consensus.cc:2804] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:22.481102  7943 ts_tablet_manager.cc:1434] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260709 13:04:22.482956  7942 tablet_bootstrap.cc:492] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:22.486915  7943 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:22.480279  8204 raft_consensus.cc:493] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.488814  8204 raft_consensus.cc:3060] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:22.474789  8206 raft_consensus.cc:515] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.494097  7943 tablet_bootstrap.cc:654] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.494369  8206 leader_election.cc:290] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:22.495769  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:22.496925  7743 raft_consensus.cc:2393] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 1: Already voted for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in this term.
I20260709 13:04:22.497009  7942 ts_tablet_manager.cc:1403] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.008s
I20260709 13:04:22.499883  7942 raft_consensus.cc:359] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.500581  7942 raft_consensus.cc:385] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.500831  7942 raft_consensus.cc:740] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.501616  7942 consensus_queue.cc:260] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.502207  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:22.504084  7942 ts_tablet_manager.cc:1434] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:22.503860  7635 leader_election.cc:304] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:22.505061  8206 raft_consensus.cc:3060] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:22.507654  7786 leader_election.cc:343] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.508152  7786 leader_election.cc:304] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:22.508865  8101 raft_consensus.cc:2749] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:22.509305  8255 consensus_queue.cc:1048] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:22.514686  7942 tablet_bootstrap.cc:492] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
W20260709 13:04:22.475405  7784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 53104us
I20260709 13:04:22.526628  7784 leader_election.cc:304] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:22.530819  8101 raft_consensus.cc:2804] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:22.545843  8101 raft_consensus.cc:697] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:22.546869  8101 consensus_queue.cc:237] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.547459  8254 consensus_queue.cc:1048] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:22.548131  8206 raft_consensus.cc:2749] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:22.562070  7940 tablet_bootstrap.cc:654] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.568791  7943 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:22.569633  7943 ts_tablet_manager.cc:1403] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.083s	user 0.008s	sys 0.008s
W20260709 13:04:22.563187  7784 leader_election.cc:343] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.552604  8204 raft_consensus.cc:515] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.565395  8174 raft_consensus.cc:493] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.584466  8174 raft_consensus.cc:515] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.587291  7941 tablet_bootstrap.cc:492] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:22.587909  7941 ts_tablet_manager.cc:1403] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.137s	user 0.022s	sys 0.007s
I20260709 13:04:22.590602  8174 leader_election.cc:290] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
W20260709 13:04:22.592643  7710 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 256084us
I20260709 13:04:22.590948  7941 raft_consensus.cc:359] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.597522  7941 raft_consensus.cc:385] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.597896  7941 raft_consensus.cc:740] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.598634  7941 consensus_queue.cc:260] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.584100  7784 leader_election.cc:304] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:22.600250  8026 raft_consensus.cc:2749] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:22.601373  7784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 43639.5us
I20260709 13:04:22.610412  8148 raft_consensus.cc:493] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.611066  8148 raft_consensus.cc:515] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.615352  7941 ts_tablet_manager.cc:1434] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:04:22.620136  7941 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:22.622622  8204 leader_election.cc:290] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:22.619565  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5b29cc10794a339c482492d5fbaa75" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:22.625553  7894 raft_consensus.cc:2393] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 1: Already voted for candidate 7873a3a04f1f4097ac2435c017ca346a in this term.
I20260709 13:04:22.625980  7943 raft_consensus.cc:359] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.626785  7943 raft_consensus.cc:385] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.627092  7943 raft_consensus.cc:740] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.627846  7943 consensus_queue.cc:260] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.631363  8148 leader_election.cc:290] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:22.634182  7941 tablet_bootstrap.cc:654] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:22.637305  8268 log.cc:927] Time spent T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:04:22.634833  7943 ts_tablet_manager.cc:1434] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:04:22.640002  7943 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:22.642702  7942 tablet_bootstrap.cc:654] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.646932  7941 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:22.647450  7943 tablet_bootstrap.cc:654] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:22.647614  7941 ts_tablet_manager.cc:1403] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:04:22.712484  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc39bf2ad6844beb8466b427508830f9" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:22.719213  8204 raft_consensus.cc:493] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.721108  8204 raft_consensus.cc:515] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:22.739825  7941 raft_consensus.cc:359] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.740934  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbddc9b10cc4f5aabaa9e3b135ffc2f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:22.741670  7940 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:22.756145  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbddc9b10cc4f5aabaa9e3b135ffc2f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:22.774753  7941 raft_consensus.cc:385] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.776932  7941 raft_consensus.cc:740] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.765257  8100 raft_consensus.cc:493] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.786765  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e5b29cc10794a339c482492d5fbaa75" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:22.807354  8100 raft_consensus.cc:515] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:22.810546  8100 leader_election.cc:290] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:22.810369  7992 consensus_queue.cc:1048] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:22.818416  7786 leader_election.cc:343] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.817672  7569 catalog_manager.cc:5697] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:22.827777  7859 leader_election.cc:343] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:22.832551  7943 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:22.833711  7943 ts_tablet_manager.cc:1403] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.194s	user 0.011s	sys 0.004s
I20260709 13:04:22.846144  8100 raft_consensus.cc:493] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.847133  8100 raft_consensus.cc:515] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:22.806568  8204 leader_election.cc:290] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:22.843999  7943 raft_consensus.cc:359] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.868764  7943 raft_consensus.cc:385] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:22.869184  7943 raft_consensus.cc:740] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:22.850914  7713 leader_election.cc:304] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:22.873651  7668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c4442b3ae45928f37714c97e92bbd" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:22.867434  7941 consensus_queue.cc:260] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.888762  7943 consensus_queue.cc:260] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.904671  8147 raft_consensus.cc:493] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.905407  8147 raft_consensus.cc:515] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:22.913443  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc39bf2ad6844beb8466b427508830f9" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:22.914644  7893 raft_consensus.cc:3060] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:22.864845  7786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 44834.9us
I20260709 13:04:22.929872  7949 raft_consensus.cc:3060] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:22.930249  7713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 79625.5us
I20260709 13:04:22.932348  8148 consensus_queue.cc:1048] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
I20260709 13:04:22.938246  8100 leader_election.cc:290] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:22.922508  7940 ts_tablet_manager.cc:1403] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.592s	user 0.036s	sys 0.020s
W20260709 13:04:22.919144  7785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 82922.4us
I20260709 13:04:22.956719  7941 ts_tablet_manager.cc:1434] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.309s	user 0.010s	sys 0.014s
I20260709 13:04:22.958621  7941 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:22.939687  8147 leader_election.cc:290] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:22.981443  7943 ts_tablet_manager.cc:1434] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.147s	user 0.006s	sys 0.005s
I20260709 13:04:22.984231  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c4442b3ae45928f37714c97e92bbd" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:22.984962  7943 tablet_bootstrap.cc:492] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:23.000435  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6bac98b41745fab1ce373328ca0c8b" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:23.002224  7997 raft_consensus.cc:493] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.003095  7997 raft_consensus.cc:515] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.012274  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:23.013008  8267 raft_consensus.cc:493] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.013664  8267 raft_consensus.cc:515] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.017755  7997 leader_election.cc:290] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:23.019922  8267 leader_election.cc:290] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:23.020994  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6bac98b41745fab1ce373328ca0c8b" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:23.023432  7860 leader_election.cc:343] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.031306  7744 raft_consensus.cc:2468] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:23.031510  7860 leader_election.cc:304] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:23.033565  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33813684ca014951b1442b91c51b0c2f" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:23.034157  8148 raft_consensus.cc:2749] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:23.034639  7820 raft_consensus.cc:2468] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:23.029698  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33813684ca014951b1442b91c51b0c2f" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:23.038379  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:23.038861  7713 leader_election.cc:304] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:23.039486  7745 raft_consensus.cc:2468] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
W20260709 13:04:23.039712  7786 leader_election.cc:343] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.041740  8290 raft_consensus.cc:2804] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.042425  8290 raft_consensus.cc:493] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.043015  8290 raft_consensus.cc:3060] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.046522  7942 tablet_bootstrap.cc:492] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:23.047657  7942 ts_tablet_manager.cc:1403] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.533s	user 0.019s	sys 0.004s
W20260709 13:04:23.048804  7860 leader_election.cc:343] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:23.052313  7785 leader_election.cc:343] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.051723  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:23.054868  7785 leader_election.cc:304] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:23.066969  8254 consensus_queue.cc:1048] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:23.080407  8283 consensus_queue.cc:1048] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:23.089720  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:23.091012  7671 raft_consensus.cc:2468] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:23.079540  8026 raft_consensus.cc:2804] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:23.083873  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 59805.6us
I20260709 13:04:23.095781  8026 raft_consensus.cc:493] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.096485  8026 raft_consensus.cc:3060] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:23.101719  7712 leader_election.cc:343] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.085709  7940 raft_consensus.cc:359] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.109051  7940 raft_consensus.cc:385] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.109483  7940 raft_consensus.cc:740] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.110334  7940 consensus_queue.cc:260] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.112191  7893 raft_consensus.cc:2468] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:23.112931  7940 ts_tablet_manager.cc:1434] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.169s	user 0.008s	sys 0.000s
I20260709 13:04:23.114334  7940 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:23.118301  7942 raft_consensus.cc:359] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.119160  7942 raft_consensus.cc:385] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.119457  7942 raft_consensus.cc:740] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
W20260709 13:04:23.124306  7784 leader_election.cc:343] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.124920  7784 leader_election.cc:304] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:23.125226  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc0069dd6948f0979c733fd0ac5343" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:23.126243  7821 raft_consensus.cc:2468] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
W20260709 13:04:23.126406  7784 leader_election.cc:343] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.126956  7784 leader_election.cc:304] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:23.127950  8285 raft_consensus.cc:2749] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:23.134857  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc0069dd6948f0979c733fd0ac5343" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:23.128238  8100 raft_consensus.cc:2749] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:23.144930  7940 tablet_bootstrap.cc:654] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:23.129784  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:23.176229  7669 raft_consensus.cc:3060] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.184260  7941 tablet_bootstrap.cc:654] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.190706  7859 leader_election.cc:304] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:23.192004  8255 raft_consensus.cc:2804] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.192610  8255 raft_consensus.cc:493] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.193027  8255 raft_consensus.cc:3060] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.158104  7942 consensus_queue.cc:260] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.212381  7943 tablet_bootstrap.cc:654] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.204237  8285 consensus_queue.cc:1048] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:04:23.218195  7861 leader_election.cc:304] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:23.218015  7942 ts_tablet_manager.cc:1434] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.170s	user 0.010s	sys 0.001s
I20260709 13:04:23.218858  7569 catalog_manager.cc:5697] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.222079  7949 raft_consensus.cc:2749] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:23.228300  8285 consensus_queue.cc:1048] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:23.229353  7942 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:23.233011  7940 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:23.233561  7940 ts_tablet_manager.cc:1403] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.001s
I20260709 13:04:23.236342  7997 raft_consensus.cc:2804] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:23.236929  7997 raft_consensus.cc:493] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.237375  7997 raft_consensus.cc:3060] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:23.238667  7859 leader_election.cc:343] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.241128  8290 raft_consensus.cc:515] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.243629  8290 leader_election.cc:290] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:23.247792  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33813684ca014951b1442b91c51b0c2f" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:23.248695  7821 raft_consensus.cc:3060] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.253901  8204 consensus_queue.cc:1048] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:23.259532  7942 tablet_bootstrap.cc:654] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.255434  8285 consensus_queue.cc:1048] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:04:23.278716  7940 raft_consensus.cc:359] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.280561  7940 raft_consensus.cc:385] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.280982  7940 raft_consensus.cc:740] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.287521  7940 consensus_queue.cc:260] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.291659  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33813684ca014951b1442b91c51b0c2f" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:23.292476  7669 raft_consensus.cc:3060] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.298610  7941 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:23.304235  7941 ts_tablet_manager.cc:1403] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.346s	user 0.017s	sys 0.016s
I20260709 13:04:23.313517  7941 raft_consensus.cc:359] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:23.328253  7941 raft_consensus.cc:385] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.328789  7941 raft_consensus.cc:740] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.301528  7669 raft_consensus.cc:2468] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:23.309713  7821 raft_consensus.cc:2468] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:23.333762  7712 leader_election.cc:304] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:23.335307  8290 raft_consensus.cc:2804] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.329654  7941 consensus_queue.cc:260] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:23.336139  8290 raft_consensus.cc:697] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:23.338843  7941 ts_tablet_manager.cc:1434] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:04:23.338657  8290 consensus_queue.cc:237] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.318291  7784 leader_election.cc:304] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
W20260709 13:04:23.349725  7638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 56457.6us
I20260709 13:04:23.355541  8026 raft_consensus.cc:515] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.358140  7997 raft_consensus.cc:515] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.372359  7943 tablet_bootstrap.cc:492] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:23.373250  7943 ts_tablet_manager.cc:1403] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.389s	user 0.025s	sys 0.006s
I20260709 13:04:23.380597  7943 raft_consensus.cc:359] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.388710  7943 raft_consensus.cc:385] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.392418  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:23.393193  7671 raft_consensus.cc:3060] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:23.396853  7941 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:23.396719  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e8e2d38d164dcfbef72067d4328f65" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:23.366467  8026 leader_election.cc:290] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:23.397605  7742 raft_consensus.cc:3060] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:23.389183  7943 raft_consensus.cc:740] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.416008  7940 ts_tablet_manager.cc:1434] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.182s	user 0.011s	sys 0.000s
I20260709 13:04:23.410712  7943 consensus_queue.cc:260] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.441998  8292 raft_consensus.cc:493] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.431561  8026 raft_consensus.cc:2804] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.403649  8255 raft_consensus.cc:515] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:23.454267  8211 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.469972  8211 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:23.474327  7784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 156175us
I20260709 13:04:23.453691  8204 raft_consensus.cc:493] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.493078  7942 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:23.493649  7942 ts_tablet_manager.cc:1403] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.265s	user 0.021s	sys 0.016s
I20260709 13:04:23.495057  8211 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:23.496742  7997 leader_election.cc:290] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:23.462757  8026 raft_consensus.cc:697] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:23.499341  8026 consensus_queue.cc:237] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.508976  7940 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:23.530623  7941 tablet_bootstrap.cc:654] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.523042  7942 raft_consensus.cc:359] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.539124  7942 raft_consensus.cc:385] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.539460  7942 raft_consensus.cc:740] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.512334  8255 leader_election.cc:290] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:23.527268  8204 raft_consensus.cc:515] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.530622  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc0069dd6948f0979c733fd0ac5343" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:23.531124  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:23.548733  7742 raft_consensus.cc:2468] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:23.525337  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6bac98b41745fab1ce373328ca0c8b" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:23.550313  7671 raft_consensus.cc:2468] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:23.550822  7744 raft_consensus.cc:3060] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.552769  7785 leader_election.cc:304] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:23.452808  8292 raft_consensus.cc:515] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.554428  8100 raft_consensus.cc:2804] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:23.555006  8100 raft_consensus.cc:697] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:23.555974  8100 consensus_queue.cc:237] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.560006  7745 raft_consensus.cc:3060] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.565687  8292 leader_election.cc:290] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:23.571880  7943 ts_tablet_manager.cc:1434] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.198s	user 0.013s	sys 0.000s
I20260709 13:04:23.572480  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
W20260709 13:04:23.573694  7859 leader_election.cc:343] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.573823  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc0069dd6948f0979c733fd0ac5343" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:23.580909  7942 consensus_queue.cc:260] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:23.574601  7821 raft_consensus.cc:2468] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
W20260709 13:04:23.588987  7860 leader_election.cc:343] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.590435  7860 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:23.591725  7943 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:23.597970  7942 ts_tablet_manager.cc:1434] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.001s
I20260709 13:04:23.600246  8254 raft_consensus.cc:2749] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:23.603403  7744 raft_consensus.cc:2468] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:23.610147  7859 leader_election.cc:304] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:23.611333  8147 raft_consensus.cc:2804] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.611888  8147 raft_consensus.cc:697] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:23.606240  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc0069dd6948f0979c733fd0ac5343" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:23.606932  7713 leader_election.cc:304] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:23.616470  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6bac98b41745fab1ce373328ca0c8b" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:23.616284  8147 consensus_queue.cc:237] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:23.617928  7893 raft_consensus.cc:2393] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 1: Already voted for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in this term.
W20260709 13:04:23.623939  7860 leader_election.cc:343] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.630697  7745 raft_consensus.cc:2468] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:23.631524  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25fc0069dd6948f0979c733fd0ac5343" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:23.632643  7819 raft_consensus.cc:3060] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:23.639710  7943 tablet_bootstrap.cc:654] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.646629  8206 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cc40c50d1f1e4a7eb98877bf59aaf75d)
I20260709 13:04:23.656291  8206 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.657776  8254 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.648563  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:23.660528  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:23.661470  7821 raft_consensus.cc:2393] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 2: Already voted for candidate 7873a3a04f1f4097ac2435c017ca346a in this term.
I20260709 13:04:23.658366  8254 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.663286  8204 leader_election.cc:290] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:23.643576  8292 raft_consensus.cc:2764] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:23.646394  7941 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:23.680931  7941 ts_tablet_manager.cc:1403] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.284s	user 0.015s	sys 0.005s
I20260709 13:04:23.669682  8206 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:23.672961  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:23.688012  7893 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
W20260709 13:04:23.673424  7785 leader_election.cc:343] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.682674  7859 leader_election.cc:304] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:23.664762  8254 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:23.684930  7940 tablet_bootstrap.cc:654] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.691962  7635 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:23.692245  8254 raft_consensus.cc:2804] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:23.692879  8254 raft_consensus.cc:697] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:23.694089  8206 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:23.693979  8254 consensus_queue.cc:237] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:23.694617  8206 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader cc40c50d1f1e4a7eb98877bf59aaf75d)
I20260709 13:04:23.695194  8206 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:23.676185  7942 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:23.671638  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:23.717623  7818 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 2.
I20260709 13:04:23.719333  7819 raft_consensus.cc:2468] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:23.725062  7942 tablet_bootstrap.cc:654] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.678268  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:23.736747  7941 raft_consensus.cc:359] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.737478  7941 raft_consensus.cc:385] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.735153  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:23.737792  7941 raft_consensus.cc:740] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.739530  7941 consensus_queue.cc:260] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.744573  7941 ts_tablet_manager.cc:1434] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:04:23.787839  7941 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:23.798877  7861 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:23.799814  8254 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:23.800334  8254 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:23.800736  8254 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:23.808807  7566 catalog_manager.cc:5697] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.810878  8254 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.814111  7569 catalog_manager.cc:5697] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:23.816738  8254 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:23.818588  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
W20260709 13:04:23.818781  7784 leader_election.cc:343] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:23.819368  7819 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:23.822293  8286 consensus_queue.cc:1048] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:23.818789  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:23.819362  7784 leader_election.cc:304] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:23.829648  8313 raft_consensus.cc:2749] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:23.836030  8286 consensus_queue.cc:1048] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:04:23.873394  7940 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:23.873991  7940 ts_tablet_manager.cc:1403] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.391s	user 0.029s	sys 0.028s
I20260709 13:04:23.859814  7819 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 3.
I20260709 13:04:23.886714  7941 tablet_bootstrap.cc:654] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:23.887050  7861 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:23.889367  8148 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:23.889947  8148 raft_consensus.cc:697] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:23.891113  8148 consensus_queue.cc:237] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.903596  7943 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:23.905179  7943 ts_tablet_manager.cc:1403] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.316s	user 0.015s	sys 0.008s
I20260709 13:04:23.912264  8206 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:23.913839  7669 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 2.
I20260709 13:04:23.932911  7940 raft_consensus.cc:359] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:23.934060  7940 raft_consensus.cc:385] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:23.934382  7940 raft_consensus.cc:740] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:23.939704  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:23.940976  7819 raft_consensus.cc:2368] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd for earlier term 2. Current term is 3.
I20260709 13:04:23.944901  7638 leader_election.cc:400] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Vote denied by peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219) with higher term. Message: Invalid argument: T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd for earlier term 2. Current term is 3.
I20260709 13:04:23.945518  7638 leader_election.cc:403] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:04:23.946518  8131 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:23.988510  7940 consensus_queue.cc:260] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:23.993803  7940 ts_tablet_manager.cc:1434] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.120s	user 0.010s	sys 0.000s
I20260709 13:04:23.995383  7940 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:23.998099  7943 raft_consensus.cc:359] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:24.000681  7943 raft_consensus.cc:385] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:24.001052  7943 raft_consensus.cc:740] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.005097  7943 consensus_queue.cc:260] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:24.017050  7894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:24.017612  7942 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:24.018265  7942 ts_tablet_manager.cc:1403] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.367s	user 0.014s	sys 0.040s
I20260709 13:04:24.007562  8206 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:24.024233  7943 ts_tablet_manager.cc:1434] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.002s
I20260709 13:04:24.022739  8292 raft_consensus.cc:493] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.030299  8292 raft_consensus.cc:515] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:24.043995  8026 consensus_queue.cc:1048] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:24.045311  7943 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:24.046056  8292 leader_election.cc:290] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:24.056337  7941 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:24.056994  7941 ts_tablet_manager.cc:1403] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.309s	user 0.009s	sys 0.010s
I20260709 13:04:24.058259  8026 raft_consensus.cc:493] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.059602  8255 raft_consensus.cc:493] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.058777  8026 raft_consensus.cc:515] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:24.059959  7941 raft_consensus.cc:359] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:24.060688  7941 raft_consensus.cc:385] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:24.060982  7941 raft_consensus.cc:740] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.061666  7941 consensus_queue.cc:260] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:24.063308  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:24.065035  7785 leader_election.cc:343] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:24.060266  8255 raft_consensus.cc:515] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:24.067749  8255 leader_election.cc:290] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:24.072870  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:24.075624  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:24.078052  7860 leader_election.cc:343] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:24.063498  7942 raft_consensus.cc:359] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:24.078424  7940 tablet_bootstrap.cc:654] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:24.154685  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 76815.4us
I20260709 13:04:24.136322  8306 consensus_queue.cc:1048] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:04:24.172251  7942 raft_consensus.cc:385] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:24.172888  7942 raft_consensus.cc:740] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.173967  7942 consensus_queue.cc:260] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:24.102487  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:24.183910  7819 raft_consensus.cc:2468] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
W20260709 13:04:24.185330  8322 log.cc:927] Time spent T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:04:24.187117  7818 raft_consensus.cc:2468] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:24.139511  8287 raft_consensus.cc:493] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.189510  8287 raft_consensus.cc:515] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:24.192126  8287 leader_election.cc:290] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:24.153285  8026 leader_election.cc:290] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:24.101781  8131 raft_consensus.cc:2749] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219) with higher term. Message: Invalid argument: T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd for earlier term 2. Current term is 3.
I20260709 13:04:24.065035  7941 ts_tablet_manager.cc:1434] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:24.225446  7943 tablet_bootstrap.cc:654] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:24.227385  7942 ts_tablet_manager.cc:1434] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.209s	user 0.008s	sys 0.004s
I20260709 13:04:24.192267  8147 consensus_queue.cc:1048] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:04:24.238629  7941 tablet_bootstrap.cc:492] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:24.253607  7940 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:24.254243  7940 ts_tablet_manager.cc:1403] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.259s	user 0.013s	sys 0.028s
I20260709 13:04:24.254881  7666 raft_consensus.cc:3060] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.258059  7940 raft_consensus.cc:359] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:24.294979  7940 raft_consensus.cc:385] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:24.295329  7940 raft_consensus.cc:740] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:24.259125  7942 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:24.295982  7940 consensus_queue.cc:260] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:24.301873  7940 ts_tablet_manager.cc:1434] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:04:24.131096  7669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:24.311443  8131 raft_consensus.cc:493] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.311760  7713 leader_election.cc:304] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:24.311967  7670 raft_consensus.cc:1275] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:24.312209  8131 raft_consensus.cc:515] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:24.265784  7941 tablet_bootstrap.cc:654] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:24.291992  7861 leader_election.cc:304] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:24.303001  7940 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:24.363335  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 48005us
I20260709 13:04:24.391280  7942 tablet_bootstrap.cc:654] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:24.399641  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 65996.6us
I20260709 13:04:24.402905  8308 raft_consensus.cc:493] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.418764  8254 consensus_queue.cc:1048] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:24.405766  8148 raft_consensus.cc:2804] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:24.419332  8290 raft_consensus.cc:2804] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:24.403674  8308 raft_consensus.cc:515] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
W20260709 13:04:24.389955  7713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 78262.8us
I20260709 13:04:24.435029  8148 raft_consensus.cc:493] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.437677  8290 raft_consensus.cc:493] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:24.454667  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 52987.7us
I20260709 13:04:24.459353  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc39bf2ad6844beb8466b427508830f9" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:24.452490  8148 raft_consensus.cc:3060] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.472160  8131 leader_election.cc:290] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:24.457192  8290 raft_consensus.cc:3060] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:24.487787  7670 raft_consensus.cc:1275] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Refusing update from remote peer cc40c50d1f1e4a7eb98877bf59aaf75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:24.490422  7943 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:24.491067  7943 ts_tablet_manager.cc:1403] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.463s	user 0.058s	sys 0.098s
I20260709 13:04:24.490090  8335 consensus_queue.cc:1048] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:24.501549  8308 leader_election.cc:290] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:24.491660  7746 raft_consensus.cc:1275] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:24.788844  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c4442b3ae45928f37714c97e92bbd" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:24.087529  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:24.865051  7940 tablet_bootstrap.cc:654] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:24.874605  8290 raft_consensus.cc:515] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:24.994254  8290 leader_election.cc:290] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:24.878516  7942 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:24.995692  7942 ts_tablet_manager.cc:1403] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.737s	user 0.063s	sys 0.092s
I20260709 13:04:24.879930  7941 tablet_bootstrap.cc:492] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:24.997081  7941 ts_tablet_manager.cc:1403] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.780s	user 0.062s	sys 0.108s
I20260709 13:04:25.000204  8347 consensus_queue.cc:1048] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:25.002200  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c4442b3ae45928f37714c97e92bbd" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:25.003120  7821 raft_consensus.cc:2468] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:24.893640  7672 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37232 (request call id 88) took 1003 ms. Trace:
I20260709 13:04:25.004490  7672 rpcz_store.cc:276] 0709 13:04:23.889836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.890012 (+   176us) service_pool.cc:224] Handling call
0709 13:04:23.890447 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:23.890860 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:23.890886 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:23.891434 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:04:23.994675 (+103241us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:04:23.994728 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.998619 (+  3891us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.893291 (+894672us) raft_consensus.cc:1685] finished
0709 13:04:24.893318 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.893538 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1325,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":122,"thread_start_us":102761,"threads_started":1,"wal-append.queue_time_us":130606}
I20260709 13:04:25.008353  7814 raft_consensus.cc:1275] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Refusing update from remote peer cc40c50d1f1e4a7eb98877bf59aaf75d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:24.906765  8148 raft_consensus.cc:515] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
W20260709 13:04:24.922254  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:04:24.937000  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 87324.7us
I20260709 13:04:25.003906  7566 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33712 (request call id 73) took 1442 ms. Trace:
I20260709 13:04:25.011157  7941 raft_consensus.cc:359] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.020105  7941 raft_consensus.cc:385] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.020531  7941 raft_consensus.cc:740] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
W20260709 13:04:25.023061  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 59682.5us
I20260709 13:04:25.018314  7566 rpcz_store.cc:276] 0709 13:04:23.561178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.561577 (+   399us) service_pool.cc:224] Handling call
0709 13:04:25.003817 (+1442240us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:24.029109 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:24.063678 (+ 34569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:24.063719 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:04:24.063737 (+    18us) tablet.cc:662] Decoding operations
0709 13:04:24.064151 (+   414us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:24.064245 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:24.064276 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:24.064465 (+   189us) tablet.cc:701] Row locks acquired
0709 13:04:24.064482 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:04:24.064655 (+   173us) write_op.cc:270] Start()
0709 13:04:24.064773 (+   118us) write_op.cc:276] Timestamp: P: 1783602264064601 usec, L: 0
0709 13:04:24.064794 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:04:24.065512 (+   718us) log.cc:844] Serialized 540 byte log entry
0709 13:04:24.779413 (+713901us) op_driver.cc:464] REPLICATION: finished
0709 13:04:24.781297 (+  1884us) write_op.cc:301] APPLY: starting
0709 13:04:24.781380 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:24.781489 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:24.781630 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:24.781857 (+   227us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:24.782013 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:24.782055 (+    42us) write_op.cc:312] APPLY: finished
0709 13:04:24.782264 (+   209us) log.cc:844] Serialized 22 byte log entry
0709 13:04:24.782439 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.782514 (+    75us) write_op.cc:454] Released schema lock
0709 13:04:24.782550 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:24.783333 (+   783us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.783363 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71932,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":1613,"apply.run_cpu_time_us":1664,"apply.run_wall_time_us":2036,"num_ops":1,"prepare.queue_time_us":195592,"prepare.run_cpu_time_us":3122,"prepare.run_wall_time_us":57182,"replication_time_us":714455,"thread_start_us":162928,"threads_started":2}]]}
I20260709 13:04:25.035530  8148 leader_election.cc:290] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:25.041327  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc39bf2ad6844beb8466b427508830f9" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:25.035370  7860 leader_election.cc:343] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.067898  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:25.069089  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6bac98b41745fab1ce373328ca0c8b" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:25.073555  7635 leader_election.cc:304] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:25.035928  8255 consensus_queue.cc:1048] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 13:04:25.074977  8131 raft_consensus.cc:2749] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:25.076026  7860 leader_election.cc:343] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.026932  8306 raft_consensus.cc:493] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.080436  8306 raft_consensus.cc:515] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.061492  7943 raft_consensus.cc:359] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.082094  7943 raft_consensus.cc:385] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.082381  7943 raft_consensus.cc:740] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.083186  8306 leader_election.cc:290] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:25.083089  7943 consensus_queue.cc:260] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.084815  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbddc9b10cc4f5aabaa9e3b135ffc2f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:25.045071  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:25.085933  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6bac98b41745fab1ce373328ca0c8b" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:25.086436  7819 raft_consensus.cc:3060] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:25.054709  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:25.087903  7816 raft_consensus.cc:3060] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:25.090902  7860 leader_election.cc:343] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.051043  7942 raft_consensus.cc:359] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.106827  7567 catalog_manager.cc:5697] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.110385  7667 raft_consensus.cc:3060] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:25.110464  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:25.114349  7569 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33720 (request call id 78) took 1357 ms. Trace:
W20260709 13:04:25.095758  7712 leader_election.cc:343] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.115995  7570 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33702 (request call id 71) took 1097 ms. Trace:
I20260709 13:04:25.117611  7942 raft_consensus.cc:385] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:25.121603  7786 leader_election.cc:343] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.120172  7567 catalog_manager.cc:5697] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.122166  7570 rpcz_store.cc:276] 0709 13:04:24.018047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.018208 (+   161us) service_pool.cc:224] Handling call
0709 13:04:25.115808 (+1097600us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119480,"reported_tablets":1}
I20260709 13:04:25.123862  7786 leader_election.cc:304] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:25.122231  7942 raft_consensus.cc:740] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.133163  7943 ts_tablet_manager.cc:1434] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.642s	user 0.009s	sys 0.003s
W20260709 13:04:25.133522  7943 ts_tablet_manager.cc:1467] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47: Tablet startup took 642ms
I20260709 13:04:25.036285  7941 consensus_queue.cc:260] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.134125  7861 leader_election.cc:304] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:25.135059  8308 raft_consensus.cc:2804] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:25.135468  8308 raft_consensus.cc:493] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.135821  8308 raft_consensus.cc:3060] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:25.132923  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbddc9b10cc4f5aabaa9e3b135ffc2f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:25.137205  7745 raft_consensus.cc:2468] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:25.137535  8147 consensus_queue.cc:1048] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:25.133941  7942 consensus_queue.cc:260] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.141093  7942 ts_tablet_manager.cc:1434] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.145s	user 0.007s	sys 0.002s
I20260709 13:04:25.120973  7569 rpcz_store.cc:276] 0709 13:04:23.760412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.761196 (+   784us) service_pool.cc:224] Handling call
0709 13:04:25.114289 (+1353093us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:24.079213 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:24.102895 (+ 23682us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:24.102927 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:04:24.102943 (+    16us) tablet.cc:662] Decoding operations
0709 13:04:24.103315 (+   372us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:24.103368 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:24.103400 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:24.103586 (+   186us) tablet.cc:701] Row locks acquired
0709 13:04:24.103598 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:04:24.103750 (+   152us) write_op.cc:270] Start()
0709 13:04:24.103863 (+   113us) write_op.cc:276] Timestamp: P: 1783602264103692 usec, L: 0
0709 13:04:24.103878 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:04:24.104566 (+   688us) log.cc:844] Serialized 540 byte log entry
0709 13:04:24.905427 (+800861us) op_driver.cc:464] REPLICATION: finished
0709 13:04:24.906659 (+  1232us) write_op.cc:301] APPLY: starting
0709 13:04:24.906743 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:24.906868 (+   125us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:24.906987 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:24.907256 (+   269us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:24.907460 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:24.907510 (+    50us) write_op.cc:312] APPLY: finished
0709 13:04:24.907727 (+   217us) log.cc:844] Serialized 22 byte log entry
0709 13:04:24.907904 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.907985 (+    81us) write_op.cc:454] Released schema lock
0709 13:04:24.908021 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:24.908366 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:24.908390 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":41851,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":963,"apply.run_cpu_time_us":1693,"apply.run_wall_time_us":1694,"num_ops":1,"prepare.queue_time_us":256892,"prepare.run_cpu_time_us":2600,"prepare.run_wall_time_us":25627,"replication_time_us":801387}]]}
I20260709 13:04:25.142285  7859 leader_election.cc:304] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:25.146304  8306 raft_consensus.cc:493] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.146013  8313 raft_consensus.cc:2749] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:25.133838  7943 ts_tablet_manager.cc:1469] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47: Trace:
0709 13:04:16.782720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.782845 (+   125us) service_pool.cc:224] Handling call
0709 13:04:16.808616 (+ 25771us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:04:16.808761 (+   145us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:04:16.862256 (+ 53495us) tablet_metadata.cc:665] Metadata flushed
0709 13:04:16.927099 (+ 64843us) tablet_replica.cc:206] Creating consensus instance
0709 13:04:16.927545 (+   446us) inbound_call.cc:177] Queueing success response
0709 13:04:24.025201 (+7097656us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:04:24.491363 (+466162us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:04:24.496716 (+  5353us) tablet_replica.cc:261] Starting instrumentation
0709 13:04:25.059796 (+563080us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":160,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"tablet-open.queue_time_us":7097720}
I20260709 13:04:25.122867  8026 consensus_queue.cc:1048] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260709 13:04:25.189927  7942 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:25.199210  7636 leader_election.cc:304] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:25.200220  8338 raft_consensus.cc:2804] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:25.200883  8338 raft_consensus.cc:493] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.179250  8306 raft_consensus.cc:515] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.201328  8338 raft_consensus.cc:3060] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:25.202051  7941 ts_tablet_manager.cc:1434] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.205s	user 0.011s	sys 0.001s
I20260709 13:04:25.203548  7941 tablet_bootstrap.cc:492] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:25.200322  7819 raft_consensus.cc:2468] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:25.212432  8286 raft_consensus.cc:493] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:25.213284  8286 raft_consensus.cc:515] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.214962  7941 tablet_bootstrap.cc:654] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:25.220090  7636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 70362us
I20260709 13:04:25.240392  7943 tablet_bootstrap.cc:492] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:25.246266  7940 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:25.246934  7940 ts_tablet_manager.cc:1403] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.944s	user 0.016s	sys 0.019s
I20260709 13:04:25.239751  8286 leader_election.cc:290] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:25.266064  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 100435us
W20260709 13:04:25.270146  7712 leader_election.cc:343] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.305393  8351 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.306397  8351 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.287532  7940 raft_consensus.cc:359] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.309513  7940 raft_consensus.cc:385] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.309955  7940 raft_consensus.cc:740] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.325767  8351 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:25.326185  8026 raft_consensus.cc:493] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.326982  8026 raft_consensus.cc:515] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.330715  7943 tablet_bootstrap.cc:654] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.331662  8026 leader_election.cc:290] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:25.334635  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:25.338773  7635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 51459.5us
I20260709 13:04:25.340190  8308 raft_consensus.cc:515] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:25.343370  8308 leader_election.cc:290] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:25.343466  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:25.344818  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c4442b3ae45928f37714c97e92bbd" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:25.345599  7817 raft_consensus.cc:3060] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:25.349426  7860 leader_election.cc:343] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.351323  7942 tablet_bootstrap.cc:654] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.352146  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c4c4442b3ae45928f37714c97e92bbd" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
W20260709 13:04:25.355667  7860 leader_election.cc:343] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.358959  7817 raft_consensus.cc:2468] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:25.360277  7861 leader_election.cc:304] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:25.310833  7940 consensus_queue.cc:260] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.370013  7816 raft_consensus.cc:2468] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
W20260709 13:04:25.365042  7784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 202722us
I20260709 13:04:25.381083  7861 leader_election.cc:304] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:25.382524  8148 raft_consensus.cc:2804] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:25.383198  8148 raft_consensus.cc:697] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:25.370234  8351 raft_consensus.cc:2804] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:25.382464  7713 leader_election.cc:304] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:25.384337  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:25.377275  7785 leader_election.cc:343] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.384419  8148 consensus_queue.cc:237] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:25.388127  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:25.390708  7940 ts_tablet_manager.cc:1434] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.143s	user 0.009s	sys 0.000s
I20260709 13:04:25.391844  7940 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:25.392554  8346 raft_consensus.cc:493] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:25.393137  8346 raft_consensus.cc:515] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.395411  8131 raft_consensus.cc:493] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.395969  8131 raft_consensus.cc:515] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.398286  8131 leader_election.cc:290] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:25.400018  8306 leader_election.cc:290] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:25.403972  8338 raft_consensus.cc:515] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.405416  8346 leader_election.cc:290] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:25.406374  8338 leader_election.cc:290] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:25.406935  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:25.407743  7819 raft_consensus.cc:2468] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:25.406294  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33813684ca014951b1442b91c51b0c2f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:25.384490  8351 raft_consensus.cc:697] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:25.410332  8351 consensus_queue.cc:237] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:25.413407  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbddc9b10cc4f5aabaa9e3b135ffc2f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:25.413637  7861 leader_election.cc:304] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:25.414110  7667 raft_consensus.cc:3060] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:25.414489  8308 raft_consensus.cc:2804] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:25.414963  8308 raft_consensus.cc:493] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.415311  8308 raft_consensus.cc:3060] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:25.416851  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbddc9b10cc4f5aabaa9e3b135ffc2f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:25.417814  7892 raft_consensus.cc:2393] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 1: Already voted for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in this term.
W20260709 13:04:25.402594  7784 leader_election.cc:343] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.420662  7784 leader_election.cc:304] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:25.421514  8026 raft_consensus.cc:2749] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:25.433550  7636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 190517us
I20260709 13:04:25.438220  7567 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:33732 (request call id 64) took 1577 ms. Trace:
I20260709 13:04:25.451664  8026 consensus_queue.cc:1048] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:25.456534  7940 tablet_bootstrap.cc:654] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.458187  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:25.459967  8292 raft_consensus.cc:2804] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:25.471055  8358 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.471694  8358 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.475143  8292 raft_consensus.cc:697] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:25.475369  8358 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:25.475574  7943 tablet_bootstrap.cc:492] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
W20260709 13:04:25.461056  7713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 78643.6us
I20260709 13:04:25.476204  8292 consensus_queue.cc:237] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.476418  7941 tablet_bootstrap.cc:492] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:25.476243  7943 ts_tablet_manager.cc:1403] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.278s	user 0.019s	sys 0.005s
I20260709 13:04:25.479382  7941 ts_tablet_manager.cc:1403] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.276s	user 0.008s	sys 0.032s
I20260709 13:04:25.492887  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
W20260709 13:04:25.499609  7786 leader_election.cc:343] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.438903  7567 rpcz_store.cc:276] 0709 13:04:23.860882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.861359 (+   477us) service_pool.cc:224] Handling call
0709 13:04:25.438109 (+1576750us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:25.228403 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:25.229327 (+   924us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:25.229375 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:04:25.229402 (+    27us) tablet.cc:662] Decoding operations
0709 13:04:25.229964 (+   562us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:25.230070 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:25.230112 (+    42us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:04:25.230570 (+   458us) tablet.cc:701] Row locks acquired
0709 13:04:25.230595 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:04:25.230926 (+   331us) write_op.cc:270] Start()
0709 13:04:25.231131 (+   205us) write_op.cc:276] Timestamp: P: 1783602265230729 usec, L: 0
0709 13:04:25.231167 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:04:25.262675 (+ 31508us) log.cc:844] Serialized 928 byte log entry
0709 13:04:25.346733 (+ 84058us) op_driver.cc:464] REPLICATION: finished
0709 13:04:25.347353 (+   620us) write_op.cc:301] APPLY: starting
0709 13:04:25.347599 (+   246us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:25.347719 (+   120us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:25.347823 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:25.369077 (+ 21254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:25.388260 (+ 19183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:04:25.388314 (+    54us) write_op.cc:312] APPLY: finished
0709 13:04:25.388570 (+   256us) log.cc:844] Serialized 28 byte log entry
0709 13:04:25.388761 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:25.388892 (+   131us) write_op.cc:454] Released schema lock
0709 13:04:25.388941 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:25.389379 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:25.389408 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":111917,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":384,"apply.run_cpu_time_us":2316,"apply.run_wall_time_us":41956,"num_ops":2,"prepare.queue_time_us":100506,"prepare.run_cpu_time_us":4566,"prepare.run_wall_time_us":38571,"replication_time_us":115414,"thread_start_us":119676,"threads_started":1}]]}
I20260709 13:04:25.509971  7943 raft_consensus.cc:359] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.510740  7943 raft_consensus.cc:385] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.511011  7943 raft_consensus.cc:740] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.514827  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:25.521525  7768 debug-util.cc:398] Leaking SignalData structure 0x7b0800200580 after lost signal to thread 434
W20260709 13:04:25.522854  7768 debug-util.cc:398] Leaking SignalData structure 0x7b08002b88c0 after lost signal to thread 7604
I20260709 13:04:25.511621  7943 consensus_queue.cc:260] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.489779  8206 raft_consensus.cc:2749] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:25.538048  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:25.550439  7941 raft_consensus.cc:359] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.551352  7941 raft_consensus.cc:385] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.552830  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:25.555841  7785 leader_election.cc:343] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.556339  7785 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
W20260709 13:04:25.533903  7768 debug-util.cc:398] Leaking SignalData structure 0x7b080023dcc0 after lost signal to thread 7696
I20260709 13:04:25.560781  8204 raft_consensus.cc:2749] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:25.561637  7768 debug-util.cc:398] Leaking SignalData structure 0x7b080008b9c0 after lost signal to thread 7771
W20260709 13:04:25.563289  7768 debug-util.cc:398] Leaking SignalData structure 0x7b0800083160 after lost signal to thread 7845
I20260709 13:04:25.564939  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33813684ca014951b1442b91c51b0c2f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:25.551820  7941 raft_consensus.cc:740] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.573246  7943 ts_tablet_manager.cc:1434] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 13:04:25.575191  7941 consensus_queue.cc:260] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.579387  7941 ts_tablet_manager.cc:1434] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 13:04:25.588145  7943 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
W20260709 13:04:25.584546  7768 debug-util.cc:398] Leaking SignalData structure 0x7b080012e5e0 after lost signal to thread 7919
I20260709 13:04:25.591696  7942 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:25.592486  7942 ts_tablet_manager.cc:1403] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.429s	user 0.011s	sys 0.013s
I20260709 13:04:25.598043  8308 raft_consensus.cc:515] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.599573  7636 leader_election.cc:304] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:25.600801  8131 raft_consensus.cc:2749] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.606455  8308 leader_election.cc:290] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:25.610703  7942 raft_consensus.cc:359] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:25.612571  7942 raft_consensus.cc:385] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.612946  7942 raft_consensus.cc:740] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.613801  7942 consensus_queue.cc:260] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:25.586587  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbddc9b10cc4f5aabaa9e3b135ffc2f" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:25.617257  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:25.617502  7744 raft_consensus.cc:3060] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:25.614399  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:25.621759  7815 raft_consensus.cc:3060] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:25.626885  7859 leader_election.cc:343] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.627436  7859 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:25.628633  8329 raft_consensus.cc:2749] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:25.631696  7942 ts_tablet_manager.cc:1434] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.004s
W20260709 13:04:25.633910  7859 leader_election.cc:343] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.644385  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbbddc9b10cc4f5aabaa9e3b135ffc2f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:25.648656  7942 tablet_bootstrap.cc:492] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:25.649693  7712 leader_election.cc:304] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
W20260709 13:04:25.653164  7859 leader_election.cc:343] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.653681  7667 raft_consensus.cc:2468] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:25.658197  8371 raft_consensus.cc:2749] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:25.661764  7942 tablet_bootstrap.cc:654] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.666458  7567 catalog_manager.cc:5697] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 0 to 2, leader changed from <none> to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.658751  7744 raft_consensus.cc:2468] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:25.668891  7860 leader_election.cc:304] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:25.675531  7636 leader_election.cc:304] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:25.671031  7943 tablet_bootstrap.cc:654] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.678808  7941 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:25.680529  8287 raft_consensus.cc:2749] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:25.675678  7567 catalog_manager.cc:5697] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } }
I20260709 13:04:25.688234  8308 raft_consensus.cc:2804] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:25.695050  8308 raft_consensus.cc:697] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:25.696002  8308 consensus_queue.cc:237] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.701582  7940 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:25.702299  7940 ts_tablet_manager.cc:1403] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.311s	user 0.040s	sys 0.027s
I20260709 13:04:25.741420  7569 catalog_manager.cc:5697] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.743402  7941 tablet_bootstrap.cc:654] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.743971  7569 catalog_manager.cc:5697] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.724363  7815 raft_consensus.cc:2468] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:25.750006  7861 leader_election.cc:304] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:25.752251  8329 raft_consensus.cc:2804] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:25.756243  8329 raft_consensus.cc:697] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:25.757272  8329 consensus_queue.cc:237] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.739425  7940 raft_consensus.cc:359] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.764905  7940 raft_consensus.cc:385] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.765302  7940 raft_consensus.cc:740] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.766124  7940 consensus_queue.cc:260] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.782680  7940 ts_tablet_manager.cc:1434] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:04:25.786690  7566 catalog_manager.cc:5697] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.794430  7943 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:25.795135  7943 ts_tablet_manager.cc:1403] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.210s	user 0.009s	sys 0.004s
I20260709 13:04:25.804118  7940 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:25.810964  7942 tablet_bootstrap.cc:492] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:25.810766  7943 raft_consensus.cc:359] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.826879  8358 raft_consensus.cc:493] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.847314  7940 tablet_bootstrap.cc:654] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.847409  8358 raft_consensus.cc:515] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:25.851737  7567 catalog_manager.cc:5697] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.844975  7943 raft_consensus.cc:385] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.853019  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666216fc7a1f403992aed2103a1031ef" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:25.860579  7567 catalog_manager.cc:5697] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.845042  7942 ts_tablet_manager.cc:1403] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.197s	user 0.009s	sys 0.009s
I20260709 13:04:25.863916  7941 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:25.864508  7941 ts_tablet_manager.cc:1403] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.190s	user 0.023s	sys 0.002s
I20260709 13:04:25.864737  7942 raft_consensus.cc:359] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.865396  7942 raft_consensus.cc:385] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.865654  7942 raft_consensus.cc:740] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.854768  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666216fc7a1f403992aed2103a1031ef" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:25.861382  7786 leader_election.cc:343] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.859826  7943 raft_consensus.cc:740] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.867426  7941 raft_consensus.cc:359] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
W20260709 13:04:25.867602  7784 leader_election.cc:343] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.868098  7941 raft_consensus.cc:385] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.868477  7941 raft_consensus.cc:740] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:25.868351  7784 leader_election.cc:304] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:25.854550  8358 leader_election.cc:290] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:25.869392  8358 raft_consensus.cc:2749] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:25.869311  7941 consensus_queue.cc:260] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:25.870317  7942 consensus_queue.cc:260] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.871536  7941 ts_tablet_manager.cc:1434] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:25.867652  7943 consensus_queue.cc:260] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:25.898515  7941 tablet_bootstrap.cc:492] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:25.899224  7943 ts_tablet_manager.cc:1434] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.104s	user 0.010s	sys 0.000s
I20260709 13:04:25.874989  7942 ts_tablet_manager.cc:1434] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:04:25.912833  7942 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:25.885646  8100 raft_consensus.cc:493] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.919957  8100 raft_consensus.cc:515] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:25.923242  8100 leader_election.cc:290] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:25.926704  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:25.927460  8329 consensus_queue.cc:1048] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:25.914059  7943 tablet_bootstrap.cc:492] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
W20260709 13:04:25.928267  7785 leader_election.cc:343] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.932143  7942 tablet_bootstrap.cc:654] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.884209  7940 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:25.936465  7940 ts_tablet_manager.cc:1403] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.153s	user 0.020s	sys 0.002s
I20260709 13:04:25.919420  7941 tablet_bootstrap.cc:654] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:25.928364  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:25.941555  7784 leader_election.cc:343] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:25.942070  7784 leader_election.cc:304] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
W20260709 13:04:25.948494  7860 consensus_peers.cc:597] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.944597  8358 raft_consensus.cc:2749] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:25.993661  7940 raft_consensus.cc:359] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:25.999207  7940 raft_consensus.cc:385] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:25.999665  7940 raft_consensus.cc:740] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.013921  7940 consensus_queue.cc:260] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:26.002246  8344 raft_consensus.cc:493] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.030757  8351 raft_consensus.cc:493] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.031590  7940 ts_tablet_manager.cc:1434] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.092s	user 0.009s	sys 0.000s
I20260709 13:04:26.033619  7940 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:26.035945  7943 tablet_bootstrap.cc:654] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.038053  7941 tablet_bootstrap.cc:492] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:26.038678  7941 ts_tablet_manager.cc:1403] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.019s
I20260709 13:04:26.038895  8117 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.039466  8117 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:26.019954  8344 raft_consensus.cc:515] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.041635  8117 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:26.041839  8344 leader_election.cc:290] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:26.043620  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:26.044952  7892 raft_consensus.cc:2468] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:26.046339  7942 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:26.047001  7942 ts_tablet_manager.cc:1403] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.008s
I20260709 13:04:26.060865  7710 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:26.068555  8174 raft_consensus.cc:2804] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:26.069061  8174 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.069888  8174 raft_consensus.cc:3060] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.031412  8351 raft_consensus.cc:515] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.073225  8351 leader_election.cc:290] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:26.075465  7940 tablet_bootstrap.cc:654] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.094494  7942 raft_consensus.cc:359] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:26.095588  7942 raft_consensus.cc:385] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.073530  8330 consensus_queue.cc:1048] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:04:26.095933  7942 raft_consensus.cc:740] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.101156  7942 consensus_queue.cc:260] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:26.102133  8306 raft_consensus.cc:493] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.131970  7942 ts_tablet_manager.cc:1434] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.085s	user 0.009s	sys 0.000s
I20260709 13:04:26.137635  7941 raft_consensus.cc:359] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.138768  7941 raft_consensus.cc:385] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.139134  7941 raft_consensus.cc:740] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.114856  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:26.141328  7860 consensus_peers.cc:597] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:26.141824  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 53703.9us
I20260709 13:04:26.141381  7941 consensus_queue.cc:260] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.136320  8306 raft_consensus.cc:515] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.167080  8306 leader_election.cc:290] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:26.154018  7666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:26.150844  7816 raft_consensus.cc:2468] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:26.178440  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:26.182543  7940 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:26.186940  7940 ts_tablet_manager.cc:1403] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.154s	user 0.027s	sys 0.008s
I20260709 13:04:26.191511  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666216fc7a1f403992aed2103a1031ef" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:26.195785  7942 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a: Bootstrap starting.
I20260709 13:04:26.192328  7820 raft_consensus.cc:2468] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:26.207470  7943 tablet_bootstrap.cc:492] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:26.208190  7943 ts_tablet_manager.cc:1403] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.295s	user 0.034s	sys 0.011s
I20260709 13:04:26.211624  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666216fc7a1f403992aed2103a1031ef" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:26.215317  7861 leader_election.cc:304] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:26.216269  8390 raft_consensus.cc:2804] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:26.216667  8390 raft_consensus.cc:493] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.216993  8390 raft_consensus.cc:3060] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.175861  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:26.221714  7741 raft_consensus.cc:2468] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:26.200757  7891 raft_consensus.cc:2468] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
W20260709 13:04:26.225104  7860 leader_election.cc:343] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:26.227458  8131 raft_consensus.cc:493] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.228070  8131 raft_consensus.cc:515] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:26.232676  8131 leader_election.cc:290] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:26.183943  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:26.239835  7815 raft_consensus.cc:2468] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:26.241462  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:26.247440  7713 leader_election.cc:304] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:26.248679  8371 raft_consensus.cc:2804] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:26.252017  8174 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:26.249187  8371 raft_consensus.cc:493] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.254652  8371 raft_consensus.cc:3060] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.265420  8387 consensus_queue.cc:1048] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:26.280001  7861 leader_election.cc:304] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
W20260709 13:04:26.298128  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 157115us
W20260709 13:04:26.305625  7712 leader_election.cc:343] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:26.291180  8308 raft_consensus.cc:2804] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:26.313514  7943 raft_consensus.cc:359] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.316778  7943 raft_consensus.cc:385] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.317268  7943 raft_consensus.cc:740] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.302379  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:26.302801  8391 raft_consensus.cc:493] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.331557  7943 consensus_queue.cc:260] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.315773  8308 raft_consensus.cc:493] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.353395  7941 ts_tablet_manager.cc:1434] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.314s	user 0.006s	sys 0.033s
I20260709 13:04:26.352420  7892 raft_consensus.cc:3060] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.357370  8308 raft_consensus.cc:3060] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.362906  8174 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:26.397562  7942 tablet_bootstrap.cc:654] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.400250  7941 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:26.401584  7943 ts_tablet_manager.cc:1434] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.193s	user 0.008s	sys 0.002s
I20260709 13:04:26.406309  8131 raft_consensus.cc:493] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.409457  8371 raft_consensus.cc:515] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.352782  8391 raft_consensus.cc:515] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.412006  8390 raft_consensus.cc:515] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.385028  7667 raft_consensus.cc:3060] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.441617  7665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:26.431274  8147 consensus_queue.cc:1048] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:04:26.444341  7712 leader_election.cc:343] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:26.450320  7892 raft_consensus.cc:2468] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:26.465168  7943 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
W20260709 13:04:26.467516  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 144660us
I20260709 13:04:26.427802  8131 raft_consensus.cc:515] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:26.482897  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:26.498040  8351 consensus_queue.cc:1048] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:26.498134  8371 leader_election.cc:290] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:26.498435  8390 leader_election.cc:290] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:26.502453  8026 raft_consensus.cc:493] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.503011  8026 raft_consensus.cc:515] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:26.502879  7940 raft_consensus.cc:359] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.504885  7940 raft_consensus.cc:385] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.505182  7940 raft_consensus.cc:740] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.506891  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:26.508267  8026 leader_election.cc:290] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:26.508795  7940 consensus_queue.cc:260] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.515235  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:26.517546  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:26.519325  7785 leader_election.cc:343] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:26.520265  7940 ts_tablet_manager.cc:1434] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.333s	user 0.008s	sys 0.001s
I20260709 13:04:26.520517  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:26.521647  7940 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:26.522521  7638 leader_election.cc:304] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:26.474902  7710 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
W20260709 13:04:26.528992  7710 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 58993.7us
I20260709 13:04:26.531316  8357 raft_consensus.cc:2804] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:26.531953  8357 raft_consensus.cc:697] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:26.533228  8357 consensus_queue.cc:237] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:26.540294  8131 leader_election.cc:290] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:26.549845  7940 tablet_bootstrap.cc:654] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:26.556644  7786 leader_election.cc:343] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:26.557279  7786 leader_election.cc:304] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:26.559532  8313 raft_consensus.cc:2749] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:26.512053  7818 raft_consensus.cc:3060] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:26.463081  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 132970us
I20260709 13:04:26.574394  7742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:26.604017  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666216fc7a1f403992aed2103a1031ef" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:26.604808  7813 raft_consensus.cc:3060] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.594444  7943 tablet_bootstrap.cc:654] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.596524  7941 tablet_bootstrap.cc:654] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.505666  7745 raft_consensus.cc:3060] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.576223  8391 leader_election.cc:290] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:26.645707  7636 leader_election.cc:343] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:26.635787  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:26.664584  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:26.661022  8306 consensus_queue.cc:1048] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:04:26.672427  7821 raft_consensus.cc:2468] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:26.651324  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:26.679648  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666216fc7a1f403992aed2103a1031ef" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:26.722105  8371 raft_consensus.cc:493] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:26.729146  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 56821.6us
W20260709 13:04:26.730729  7859 leader_election.cc:343] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:26.732419  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 48184.8us
I20260709 13:04:26.737798  8334 consensus_queue.cc:1048] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:26.741966  7861 leader_election.cc:304] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:26.699472  8131 raft_consensus.cc:493] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:26.701578  7638 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 167261us
I20260709 13:04:26.748054  8404 raft_consensus.cc:2804] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:26.754011  7818 raft_consensus.cc:2468] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:26.770113  8397 raft_consensus.cc:2749] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:26.771209  7860 leader_election.cc:343] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:26.722803  8371 raft_consensus.cc:515] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
W20260709 13:04:26.776582  7784 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 76386.7us
I20260709 13:04:26.764010  8131 raft_consensus.cc:515] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
W20260709 13:04:26.789038  7786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 92953.8us
I20260709 13:04:26.791417  7713 leader_election.cc:304] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:26.777782  8404 raft_consensus.cc:493] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.793823  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:26.795398  8131 leader_election.cc:290] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:26.796223  8398 raft_consensus.cc:2804] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:26.803452  8371 leader_election.cc:290] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:26.815490  7942 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a: No bootstrap required, opened a new log
I20260709 13:04:26.837149  7942 ts_tablet_manager.cc:1403] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a: Time spent bootstrapping tablet: real 0.649s	user 0.028s	sys 0.022s
I20260709 13:04:26.816744  8308 raft_consensus.cc:515] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.841179  7892 raft_consensus.cc:2393] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 1: Already voted for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in this term.
I20260709 13:04:26.841300  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:26.842622  8308 leader_election.cc:290] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:26.823915  7820 raft_consensus.cc:2468] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:26.834911  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:26.844452  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:26.832382  7813 raft_consensus.cc:2468] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:26.846216  7942 raft_consensus.cc:359] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.849772  7942 raft_consensus.cc:385] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.850060  7942 raft_consensus.cc:740] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.851082  7942 consensus_queue.cc:260] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.853195  7942 ts_tablet_manager.cc:1434] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 13:04:26.863523  7820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:26.869796  7861 leader_election.cc:304] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:26.853976  8404 raft_consensus.cc:3060] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:26.898046  7636 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 169159us
I20260709 13:04:26.864708  8398 raft_consensus.cc:697] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:26.888423  8330 raft_consensus.cc:2804] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:26.911607  7638 leader_election.cc:304] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:26.929730  7940 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:26.930322  7940 ts_tablet_manager.cc:1403] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.409s	user 0.015s	sys 0.022s
I20260709 13:04:26.932909  8363 raft_consensus.cc:2804] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:26.933394  8363 raft_consensus.cc:493] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.933746  8363 raft_consensus.cc:3060] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:26.906029  7635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 135518us
I20260709 13:04:26.940025  7940 raft_consensus.cc:359] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.941988  7940 raft_consensus.cc:385] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.942327  8398 consensus_queue.cc:237] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.943270  7940 raft_consensus.cc:740] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.944249  7940 consensus_queue.cc:260] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.945916  7941 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:26.946537  7941 ts_tablet_manager.cc:1403] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.569s	user 0.015s	sys 0.034s
I20260709 13:04:26.948318  7940 ts_tablet_manager.cc:1434] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:04:26.916652  8330 raft_consensus.cc:697] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:26.956661  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:26.960186  8330 consensus_queue.cc:237] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.962368  7635 leader_election.cc:304] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:26.966866  7943 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:26.967753  7943 ts_tablet_manager.cc:1403] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.531s	user 0.023s	sys 0.036s
I20260709 13:04:26.980753  8404 raft_consensus.cc:515] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:26.982924  8404 leader_election.cc:290] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:26.967540  8417 raft_consensus.cc:2749] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:26.987758  7941 raft_consensus.cc:359] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.990629  7941 raft_consensus.cc:385] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.990979  7941 raft_consensus.cc:740] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.991740  7941 consensus_queue.cc:260] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:26.993417  7941 ts_tablet_manager.cc:1434] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:04:26.988081  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:26.994467  7941 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:26.994961  7813 raft_consensus.cc:3060] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.989120  7943 raft_consensus.cc:359] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:26.998113  7943 raft_consensus.cc:385] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.998569  7943 raft_consensus.cc:740] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.969938  8363 raft_consensus.cc:515] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.006879  8363 leader_election.cc:290] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:27.012025  7713 leader_election.cc:304] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:27.013665  7943 consensus_queue.cc:260] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.018654  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:27.035362  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:27.037664  7741 raft_consensus.cc:3060] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.054147  8392 consensus_queue.cc:1048] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:27.056150  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "814f68057304479398b938502ddb6f05" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:27.057152  7816 raft_consensus.cc:2393] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc40c50d1f1e4a7eb98877bf59aaf75d in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:27.061861  7943 ts_tablet_manager.cc:1434] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.089s	user 0.004s	sys 0.006s
I20260709 13:04:27.067587  7672 raft_consensus.cc:3060] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.075416  7940 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:27.076378  7740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:27.033002  7821 raft_consensus.cc:3060] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.088238  7741 raft_consensus.cc:2468] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
W20260709 13:04:27.095784  7859 leader_election.cc:343] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.099875  7821 raft_consensus.cc:2468] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:27.092351  8371 consensus_queue.cc:1048] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:04:27.111129  7638 leader_election.cc:304] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:27.111492  7667 raft_consensus.cc:3060] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.118336  8363 raft_consensus.cc:2804] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.118912  8363 raft_consensus.cc:697] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:27.119805  8363 consensus_queue.cc:237] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.123322  7943 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:27.123405  7859 leader_election.cc:304] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:27.126961  7940 tablet_bootstrap.cc:654] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.129750  7941 tablet_bootstrap.cc:654] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.140112  8393 raft_consensus.cc:2749] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:27.153566  8344 raft_consensus.cc:2749] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:27.173790  7813 raft_consensus.cc:2468] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:27.175391  7861 leader_election.cc:304] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:27.180878  7570 catalog_manager.cc:5697] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.186611  8308 raft_consensus.cc:2804] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.188463  8308 raft_consensus.cc:697] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:27.189401  8308 consensus_queue.cc:237] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:27.228179  8395 raft_consensus.cc:493] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.228814  8395 raft_consensus.cc:515] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:27.230700  7943 tablet_bootstrap.cc:654] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.231312  8395 leader_election.cc:290] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:27.233060  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd80ffcb91143aeb64f882f614e0817" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:27.234061  7815 raft_consensus.cc:2468] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 0.
I20260709 13:04:27.235154  7670 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd80ffcb91143aeb64f882f614e0817" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
W20260709 13:04:27.236804  7712 consensus_peers.cc:597] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.238482  7861 leader_election.cc:304] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:27.239969  8330 raft_consensus.cc:2804] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.240414  8330 raft_consensus.cc:493] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.240772  8330 raft_consensus.cc:3060] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:27.247126  7860 leader_election.cc:343] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.260002  7940 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:27.260596  7940 ts_tablet_manager.cc:1403] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.190s	user 0.021s	sys 0.000s
I20260709 13:04:27.263396  7940 raft_consensus.cc:359] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.264115  7940 raft_consensus.cc:385] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.264377  7940 raft_consensus.cc:740] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.265622  7940 consensus_queue.cc:260] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.267890  7940 ts_tablet_manager.cc:1434] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:27.277611  7941 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:27.280220  7941 ts_tablet_manager.cc:1403] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.286s	user 0.026s	sys 0.016s
I20260709 13:04:27.279186  8330 raft_consensus.cc:515] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:27.293260  7941 raft_consensus.cc:359] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.300231  7941 raft_consensus.cc:385] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.300621  7941 raft_consensus.cc:740] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.304212  7940 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:27.305644  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd80ffcb91143aeb64f882f614e0817" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:27.306562  7815 raft_consensus.cc:3060] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.307865  7941 consensus_queue.cc:260] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.323338  7941 ts_tablet_manager.cc:1434] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 13:04:27.338851  8330 leader_election.cc:290] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:27.342252  8417 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.345100  8417 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.347455  7940 tablet_bootstrap.cc:654] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.348155  8417 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:27.348654  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:27.349465  7813 raft_consensus.cc:2468] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:27.350620  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:27.353667  7943 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:27.354517  7943 ts_tablet_manager.cc:1403] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.253s	user 0.017s	sys 0.010s
I20260709 13:04:27.351629  7638 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:27.358960  7941 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d: Bootstrap starting.
I20260709 13:04:27.359337  8408 raft_consensus.cc:2804] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:27.359434  7636 leader_election.cc:343] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.359838  8408 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.360337  8408 raft_consensus.cc:3060] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.369918  7943 raft_consensus.cc:359] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.370818  7943 raft_consensus.cc:385] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.371090  7943 raft_consensus.cc:740] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.371806  7943 consensus_queue.cc:260] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.374240  7943 ts_tablet_manager.cc:1434] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:04:27.378140  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fd80ffcb91143aeb64f882f614e0817" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:27.379485  7943 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:27.381811  8408 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.391984  7943 tablet_bootstrap.cc:654] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.395947  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:27.396773  7813 raft_consensus.cc:3060] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:27.399118  7860 leader_election.cc:343] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.405584  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:27.406769  7746 raft_consensus.cc:3060] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.409251  7941 tablet_bootstrap.cc:654] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.410878  8408 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:27.413781  7813 raft_consensus.cc:2468] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:27.415689  7638 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:27.416699  8408 raft_consensus.cc:2804] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.417258  8408 raft_consensus.cc:697] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:27.419924  8408 consensus_queue.cc:237] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.432349  7815 raft_consensus.cc:2468] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:27.434541  7861 leader_election.cc:304] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:27.435943  8391 raft_consensus.cc:2804] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.436508  8391 raft_consensus.cc:697] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:27.440485  8391 consensus_queue.cc:237] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:27.441913  7940 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:27.442528  7940 ts_tablet_manager.cc:1403] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.139s	user 0.018s	sys 0.001s
I20260709 13:04:27.445935  7940 raft_consensus.cc:359] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.446652  7940 raft_consensus.cc:385] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.446921  7940 raft_consensus.cc:740] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.447445  7746 raft_consensus.cc:2468] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:27.447641  7940 consensus_queue.cc:260] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.453173  7940 ts_tablet_manager.cc:1434] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:04:27.454396  7940 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:27.460418  8308 raft_consensus.cc:493] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.461341  7940 tablet_bootstrap.cc:654] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.461045  8308 raft_consensus.cc:515] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.481577  8330 consensus_queue.cc:1048] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:27.483167  8344 consensus_queue.cc:1048] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:27.492203  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ddd1785584baaac825181369d1331" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:27.494985  7859 leader_election.cc:343] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.481720  8308 leader_election.cc:290] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:27.499912  8371 consensus_queue.cc:1048] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:27.507411  7943 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:27.508013  7943 ts_tablet_manager.cc:1403] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.129s	user 0.028s	sys 0.022s
I20260709 13:04:27.512567  7943 raft_consensus.cc:359] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.516120  7943 raft_consensus.cc:385] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.516462  7943 raft_consensus.cc:740] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.523439  7943 consensus_queue.cc:260] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.539263  7943 ts_tablet_manager.cc:1434] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:04:27.539661  7941 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d: No bootstrap required, opened a new log
I20260709 13:04:27.540326  7941 ts_tablet_manager.cc:1403] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent bootstrapping tablet: real 0.203s	user 0.023s	sys 0.000s
I20260709 13:04:27.540481  7943 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:27.543252  7941 raft_consensus.cc:359] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.544025  7941 raft_consensus.cc:385] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.546052  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ddd1785584baaac825181369d1331" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:27.546231  7941 raft_consensus.cc:740] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.569272  7941 consensus_queue.cc:260] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:27.573486  7860 consensus_peers.cc:597] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.563467  8408 consensus_queue.cc:1048] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
W20260709 13:04:27.582051  7860 leader_election.cc:343] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.582667  7860 leader_election.cc:304] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:27.584138  8308 raft_consensus.cc:2749] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:27.587414  7941 ts_tablet_manager.cc:1434] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:04:27.589068  7566 catalog_manager.cc:5697] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.593752  7943 tablet_bootstrap.cc:654] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.663738  7568 catalog_manager.cc:5697] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:27.673875  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:27.676798  7940 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:27.677735  7940 ts_tablet_manager.cc:1403] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.224s	user 0.021s	sys 0.007s
W20260709 13:04:27.680939  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 46388.5us
W20260709 13:04:27.691700  7859 consensus_peers.cc:597] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:27.719702  8287 consensus_queue.cc:1048] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:27.678565  7667 raft_consensus.cc:3060] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.769176  7943 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:27.769696  7943 ts_tablet_manager.cc:1403] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.229s	user 0.023s	sys 0.030s
W20260709 13:04:27.772615  8448 log.cc:927] Time spent T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:04:27.777706  8147 consensus_queue.cc:1048] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:27.780725  7566 catalog_manager.cc:5697] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.787249  7566 catalog_manager.cc:5697] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.801453  7940 raft_consensus.cc:359] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:27.804847  7940 raft_consensus.cc:385] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.805199  7940 raft_consensus.cc:740] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.808295  7940 consensus_queue.cc:260] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:27.811873  7943 raft_consensus.cc:359] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.812888  7943 raft_consensus.cc:385] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.813151  7943 raft_consensus.cc:740] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.798206  8344 raft_consensus.cc:493] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.814256  8344 raft_consensus.cc:515] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.817020  8344 leader_election.cc:290] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:27.821408  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ddd1785584baaac825181369d1331" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
W20260709 13:04:27.824415  7712 leader_election.cc:343] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.853288  8393 raft_consensus.cc:493] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.854089  8393 raft_consensus.cc:515] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.855170  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ddd1785584baaac825181369d1331" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:27.855609  7943 consensus_queue.cc:260] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.856339  7893 raft_consensus.cc:2468] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:27.858096  8392 raft_consensus.cc:493] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.858296  7943 ts_tablet_manager.cc:1434] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.000s
I20260709 13:04:27.858664  8392 raft_consensus.cc:515] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:27.859792  7940 ts_tablet_manager.cc:1434] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.182s	user 0.009s	sys 0.001s
I20260709 13:04:27.862322  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:27.864403  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:27.862648  8393 leader_election.cc:290] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:27.861171  8392 leader_election.cc:290] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:27.864547  7940 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:27.865352  7859 leader_election.cc:343] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:27.867158  7712 leader_election.cc:343] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.874323  7943 tablet_bootstrap.cc:492] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:27.875265  7710 leader_election.cc:304] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:27.876477  8392 raft_consensus.cc:2804] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.876840  8392 raft_consensus.cc:493] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.877133  8392 raft_consensus.cc:3060] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.875550  7671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" is_pre_election: true
I20260709 13:04:27.894685  7569 catalog_manager.cc:5697] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.898087  7569 catalog_manager.cc:5697] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 0 to 1, leader changed from <none> to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 1 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.899173  8417 raft_consensus.cc:493] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.929994  7940 tablet_bootstrap.cc:654] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.929136  8417 raft_consensus.cc:515] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:27.928882  7816 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:27.953866  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 52693.9us
W20260709 13:04:27.954711  7860 consensus_peers.cc:597] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:27.955327  7860 leader_election.cc:343] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.955680  7860 leader_election.cc:304] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:27.960218  8334 raft_consensus.cc:2749] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:27.957715  7816 raft_consensus.cc:2468] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 0.
I20260709 13:04:27.979985  8287 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:27.987336  8287 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:27.995870  7713 leader_election.cc:304] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:27.996938  8174 raft_consensus.cc:2804] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.997382  8174 raft_consensus.cc:493] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.997720  8174 raft_consensus.cc:3060] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.975684  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666216fc7a1f403992aed2103a1031ef" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:27.978826  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "666216fc7a1f403992aed2103a1031ef" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:28.005780  8174 raft_consensus.cc:515] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:28.013614  8417 leader_election.cc:290] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:28.045059  8174 leader_election.cc:290] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:27.982769  8462 consensus_queue.cc:1048] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.065s
I20260709 13:04:28.058346  7638 leader_election.cc:304] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
W20260709 13:04:28.056176  8458 log.cc:927] Time spent T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:04:28.068668  8459 log.cc:927] Time spent T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:04:28.072433  8287 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:28.077759  7943 tablet_bootstrap.cc:654] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.064278  8467 raft_consensus.cc:2749] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.093253  7887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:28.087828  8392 raft_consensus.cc:515] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.132095  8392 leader_election.cc:290] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:28.148854  7817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:28.149647  7817 raft_consensus.cc:3060] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.176642  8287 consensus_queue.cc:1048] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:04:28.183640  7940 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:28.184300  7940 ts_tablet_manager.cc:1403] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.320s	user 0.011s	sys 0.006s
I20260709 13:04:28.186573  7940 raft_consensus.cc:359] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.187150  7940 raft_consensus.cc:385] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.187610  7940 raft_consensus.cc:740] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.188482  7940 consensus_queue.cc:260] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.190763  7940 ts_tablet_manager.cc:1434] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:28.191881  7940 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:28.198277  7940 tablet_bootstrap.cc:654] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.201612  8455 consensus_queue.cc:1048] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.214836  7667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:28.221751  7672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ddd1785584baaac825181369d1331" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
I20260709 13:04:28.165056  7665 raft_consensus.cc:3060] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.260223  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:28.261456  7712 leader_election.cc:343] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:28.225461  7635 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 49719.4us
W20260709 13:04:28.273162  7712 leader_election.cc:343] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.276566  7943 tablet_bootstrap.cc:492] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:28.277235  7943 ts_tablet_manager.cc:1403] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.403s	user 0.042s	sys 0.038s
I20260709 13:04:28.280480  7943 raft_consensus.cc:359] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:28.281284  7943 raft_consensus.cc:385] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.281550  7943 raft_consensus.cc:740] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.282184  7943 consensus_queue.cc:260] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:28.290484  7943 ts_tablet_manager.cc:1434] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:28.291810  7943 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47: Bootstrap starting.
I20260709 13:04:28.310364  7943 tablet_bootstrap.cc:654] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.314677  7817 raft_consensus.cc:2468] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:28.318578  7940 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:28.319315  7940 ts_tablet_manager.cc:1403] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.128s	user 0.019s	sys 0.033s
I20260709 13:04:28.322880  7636 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
W20260709 13:04:28.325775  7786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 54328.1us
I20260709 13:04:28.326503  7713 leader_election.cc:304] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
W20260709 13:04:28.329913  7785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 175200us
I20260709 13:04:28.327255  8465 raft_consensus.cc:2749] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:28.331248  8392 raft_consensus.cc:2804] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.367573  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ddd1785584baaac825181369d1331" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:28.369000  7892 raft_consensus.cc:3060] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.374553  7940 raft_consensus.cc:359] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:28.375396  7940 raft_consensus.cc:385] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.375643  7940 raft_consensus.cc:740] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.384606  7940 consensus_queue.cc:260] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:28.412022  7940 ts_tablet_manager.cc:1434] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.092s	user 0.010s	sys 0.002s
I20260709 13:04:28.402856  8392 raft_consensus.cc:697] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
W20260709 13:04:28.414224  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 177958us
I20260709 13:04:28.438272  7940 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:28.457994  7943 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47: No bootstrap required, opened a new log
I20260709 13:04:28.458747  7943 ts_tablet_manager.cc:1403] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent bootstrapping tablet: real 0.167s	user 0.013s	sys 0.002s
I20260709 13:04:28.472879  7671 raft_consensus.cc:3060] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.436254  8392 consensus_queue.cc:237] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:28.491889  8465 raft_consensus.cc:493] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.507076  7747 raft_consensus.cc:3060] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.488384  7892 raft_consensus.cc:2468] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
W20260709 13:04:28.516865  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 77890.2us
I20260709 13:04:28.530963  7940 tablet_bootstrap.cc:654] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.497527  8465 raft_consensus.cc:515] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.536372  8465 leader_election.cc:290] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:28.542514  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:28.543371  7889 raft_consensus.cc:2468] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:28.549240  7943 raft_consensus.cc:359] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.550176  7943 raft_consensus.cc:385] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.550478  7943 raft_consensus.cc:740] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.551203  7943 consensus_queue.cc:260] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.552706  7635 leader_election.cc:304] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:28.553726  8467 raft_consensus.cc:2804] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.554196  8467 raft_consensus.cc:493] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.554560  8467 raft_consensus.cc:3060] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.576967  8467 raft_consensus.cc:515] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.583216  7943 ts_tablet_manager.cc:1434] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.000s
I20260709 13:04:28.597515  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:28.598371  7745 raft_consensus.cc:2468] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 0.
I20260709 13:04:28.602259  7940 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:28.602917  7940 ts_tablet_manager.cc:1403] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.168s	user 0.011s	sys 0.008s
I20260709 13:04:28.610430  8467 leader_election.cc:290] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:28.610797  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:28.611630  7892 raft_consensus.cc:3060] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.618677  7710 leader_election.cc:304] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:28.620244  8481 raft_consensus.cc:2804] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.620842  8481 raft_consensus.cc:697] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:28.622082  8481 consensus_queue.cc:237] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.637004  7566 catalog_manager.cc:5697] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.640441  7940 raft_consensus.cc:359] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:28.643411  7940 raft_consensus.cc:385] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.643728  7940 raft_consensus.cc:740] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.637434  7892 raft_consensus.cc:2468] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:28.646692  7940 consensus_queue.cc:260] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:28.657102  7940 ts_tablet_manager.cc:1434] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 13:04:28.658382  7940 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:28.678774  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 51701.1us
I20260709 13:04:28.681627  7635 leader_election.cc:304] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:28.683077  8465 raft_consensus.cc:2804] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.683645  8465 raft_consensus.cc:697] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:28.684624  8465 consensus_queue.cc:237] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.713258  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:28.714419  7745 raft_consensus.cc:3060] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:28.727193  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 72567.4us
W20260709 13:04:28.767760  7618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:28.784543  7940 tablet_bootstrap.cc:654] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.803542  7745 raft_consensus.cc:2468] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 1.
I20260709 13:04:28.852247  7569 catalog_manager.cc:5697] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 1 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.848968  7566 catalog_manager.cc:5697] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 0 to 1, leader changed from <none> to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.974737  7940 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: No bootstrap required, opened a new log
I20260709 13:04:28.975340  7940 ts_tablet_manager.cc:1403] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.317s	user 0.035s	sys 0.020s
I20260709 13:04:28.979584  7940 raft_consensus.cc:359] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:28.980485  7940 raft_consensus.cc:385] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.994998  7940 raft_consensus.cc:740] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.999411  7940 consensus_queue.cc:260] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:29.002573  8363 raft_consensus.cc:493] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.003109  8363 raft_consensus.cc:515] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:29.005383  8363 leader_election.cc:290] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:29.006721  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ddd1785584baaac825181369d1331" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:29.009152  7940 ts_tablet_manager.cc:1434] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
I20260709 13:04:29.007165  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a24ddd1785584baaac825181369d1331" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:29.010064  7888 raft_consensus.cc:2393] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in current term 1: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:29.012181  7636 leader_election.cc:304] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:29.015800  7665 raft_consensus.cc:3060] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.018481  8465 raft_consensus.cc:3060] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.046273  8465 raft_consensus.cc:2749] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.051826  8344 consensus_queue.cc:1048] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.079419  8344 consensus_queue.cc:1048] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.102392  8401 consensus_queue.cc:1048] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.134198  8476 consensus_queue.cc:1048] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.167323  8465 consensus_queue.cc:1048] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.192631   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:04:29.201551  7860 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:29.202111  8467 consensus_queue.cc:1048] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:04:29.280304  7860 consensus_peers.cc:597] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.280926  7860 consensus_peers.cc:597] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.281442  7860 consensus_peers.cc:597] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.283217  7860 consensus_peers.cc:597] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.285027  7712 consensus_peers.cc:597] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.289888  7712 consensus_peers.cc:597] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.299144  7860 consensus_peers.cc:597] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.339962  7860 consensus_peers.cc:597] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.335594  7712 consensus_peers.cc:597] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.345729  7860 consensus_peers.cc:597] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.357501  7712 consensus_peers.cc:597] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.358026  7860 consensus_peers.cc:597] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.379034  7860 consensus_peers.cc:597] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.381696  7860 consensus_peers.cc:597] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.400710  7712 consensus_peers.cc:597] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.418042  7712 consensus_peers.cc:597] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.421085   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:29.424124  7712 consensus_peers.cc:597] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.432787  7712 consensus_peers.cc:597] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.436774   431 tablet_replica.cc:333] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.441555   431 raft_consensus.cc:2243] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.442250   431 raft_consensus.cc:2272] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.464869  7786 consensus_peers.cc:597] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.468263  7786 consensus_peers.cc:597] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.469143   431 tablet_replica.cc:333] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.470270   431 raft_consensus.cc:2243] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.470937   431 raft_consensus.cc:2272] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.474812   431 tablet_replica.cc:333] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.475766   431 raft_consensus.cc:2243] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.476444   431 raft_consensus.cc:2272] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.484231  7786 consensus_peers.cc:597] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.485375   431 tablet_replica.cc:333] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.486474   431 raft_consensus.cc:2243] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.487110   431 raft_consensus.cc:2272] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.490077   431 tablet_replica.cc:333] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.495329   431 raft_consensus.cc:2243] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:29.496333  7712 consensus_peers.cc:597] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.496870  7786 consensus_peers.cc:597] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.497097   431 raft_consensus.cc:2272] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.506103  7786 consensus_peers.cc:597] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.510859  7786 consensus_peers.cc:597] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.500715   431 tablet_replica.cc:333] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.513813   431 raft_consensus.cc:2243] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.514400   431 raft_consensus.cc:2272] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.517190   431 tablet_replica.cc:333] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.518090   431 raft_consensus.cc:2243] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.518618   431 raft_consensus.cc:2272] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.520844   431 tablet_replica.cc:333] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.521530   431 raft_consensus.cc:2243] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.523545   431 raft_consensus.cc:2272] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.530805   431 tablet_replica.cc:333] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.531949   431 raft_consensus.cc:2243] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.532656   431 raft_consensus.cc:2272] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.535935   431 tablet_replica.cc:333] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.536922   431 raft_consensus.cc:2243] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.537490   431 raft_consensus.cc:2272] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.541431   431 tablet_replica.cc:333] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.542347   431 raft_consensus.cc:2243] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.542897   431 raft_consensus.cc:2272] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.545610   431 tablet_replica.cc:333] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.546566   431 raft_consensus.cc:2243] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.547138   431 raft_consensus.cc:2272] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.550107   431 tablet_replica.cc:333] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.551088   431 raft_consensus.cc:2243] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.551661   431 raft_consensus.cc:2272] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.554874   431 tablet_replica.cc:333] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.555801   431 raft_consensus.cc:2243] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.556442   431 raft_consensus.cc:2272] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.566042   431 tablet_replica.cc:333] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.567852   431 raft_consensus.cc:2243] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.568591   431 raft_consensus.cc:2272] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.571847   431 tablet_replica.cc:333] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.572829   431 raft_consensus.cc:2243] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.573375   431 raft_consensus.cc:2272] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.576704   431 tablet_replica.cc:333] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.577605   431 raft_consensus.cc:2243] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.578732   431 raft_consensus.cc:2272] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.582335  7860 consensus_peers.cc:597] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.586957  7860 consensus_peers.cc:597] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.589730   431 tablet_replica.cc:333] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.590795   431 raft_consensus.cc:2243] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.591751   431 raft_consensus.cc:2272] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.601670   431 tablet_replica.cc:333] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.602787   431 raft_consensus.cc:2243] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.603518   431 raft_consensus.cc:2272] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.605954  7860 consensus_peers.cc:597] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.609331  7860 consensus_peers.cc:597] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.610565   431 tablet_replica.cc:333] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.611487   431 raft_consensus.cc:2243] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.612147   431 raft_consensus.cc:2272] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.615267   431 tablet_replica.cc:333] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.616226   431 raft_consensus.cc:2243] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.616887   431 raft_consensus.cc:2272] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.621606   431 tablet_replica.cc:333] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.622587   431 raft_consensus.cc:2243] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.623311   431 raft_consensus.cc:2272] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.639087   431 tablet_replica.cc:333] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
W20260709 13:04:29.636951  7786 consensus_peers.cc:597] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.640075   431 raft_consensus.cc:2243] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.640682   431 raft_consensus.cc:2272] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.641870  7712 consensus_peers.cc:597] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:29.643071  7712 consensus_peers.cc:597] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.643784   431 tablet_replica.cc:333] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.644796   431 raft_consensus.cc:2243] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.645465   431 raft_consensus.cc:2272] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.648658   431 tablet_replica.cc:333] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.649459   431 raft_consensus.cc:2243] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.649979   431 raft_consensus.cc:2272] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.652810   431 tablet_replica.cc:333] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.653829   431 raft_consensus.cc:2243] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.654457   431 raft_consensus.cc:2272] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.657886   431 tablet_replica.cc:333] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.658763   431 raft_consensus.cc:2243] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.660027   431 raft_consensus.cc:2272] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.669240   431 tablet_replica.cc:333] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.670185   431 raft_consensus.cc:2243] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.670758   431 raft_consensus.cc:2272] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.673702   431 tablet_replica.cc:333] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.674639   431 raft_consensus.cc:2243] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.675853   431 raft_consensus.cc:2272] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.682456   431 tablet_replica.cc:333] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.683398   431 raft_consensus.cc:2243] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.684000   431 raft_consensus.cc:2272] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.691152   431 tablet_replica.cc:333] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.695851   431 raft_consensus.cc:2243] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.696553   431 raft_consensus.cc:2272] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.720530  7860 consensus_peers.cc:597] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.733552   431 tablet_replica.cc:333] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.734588   431 raft_consensus.cc:2243] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.735496   431 raft_consensus.cc:2272] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.738781   431 tablet_replica.cc:333] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.739490   431 raft_consensus.cc:2243] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.739954   431 raft_consensus.cc:2272] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:29.743467  7860 consensus_peers.cc:597] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.746690   431 tablet_replica.cc:333] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.749943   431 raft_consensus.cc:2243] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.756966   431 raft_consensus.cc:2272] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.760243   431 tablet_replica.cc:333] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.761011   431 raft_consensus.cc:2243] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.761592   431 raft_consensus.cc:2272] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.764695   431 tablet_replica.cc:333] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.770361   431 raft_consensus.cc:2243] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.771433   431 raft_consensus.cc:2272] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.782706   431 tablet_replica.cc:333] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.783519   431 raft_consensus.cc:2243] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.784116   431 raft_consensus.cc:2272] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.803378   431 tablet_replica.cc:333] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.804175   431 raft_consensus.cc:2243] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.804751   431 raft_consensus.cc:2272] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.807610   431 tablet_replica.cc:333] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.808559   431 raft_consensus.cc:2243] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.816423   431 raft_consensus.cc:2272] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.827260   431 tablet_replica.cc:333] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.834465   431 raft_consensus.cc:2243] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:29.840415  7712 consensus_peers.cc:597] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.846607   431 raft_consensus.cc:2272] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.852660   431 tablet_replica.cc:333] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
W20260709 13:04:29.860224  7860 consensus_peers.cc:597] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.867707   431 raft_consensus.cc:2243] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:29.891844   431 raft_consensus.cc:2272] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.895992   431 tablet_replica.cc:333] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:29.897112   431 raft_consensus.cc:2243] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:29.898037   431 raft_consensus.cc:2272] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:29.901684   431 tablet_replica.cc:333] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:30.012678   431 raft_consensus.cc:2243] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.013468   431 raft_consensus.cc:2272] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.085009   431 tablet_replica.cc:333] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:30.116559   431 raft_consensus.cc:2243] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:30.117388   431 raft_consensus.cc:2272] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:30.142146   431 tablet_replica.cc:333] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: stopping tablet replica
I20260709 13:04:30.162317   431 raft_consensus.cc:2243] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:30.174981   431 raft_consensus.cc:2272] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:30.237533  7786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 46833.4us
I20260709 13:04:30.416607   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:04:30.527256  8516 raft_consensus.cc:493] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:30.533752  8516 raft_consensus.cc:515] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:30.566953  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 55395.9us
I20260709 13:04:30.596125  8516 leader_election.cc:290] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:30.573491   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:04:30.576611  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:30.620390  7786 leader_election.cc:336] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:30.620889  7786 leader_election.cc:304] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:30.621610  8513 raft_consensus.cc:2749] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:30.669351  8522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:30.682025  8523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:30.682454   431 server_base.cc:1061] running on GCE node
W20260709 13:04:30.686650  8525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:30.695741   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:30.696821   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:30.697173   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602270697148 us; error 0 us; skew 500 ppm
I20260709 13:04:30.698220   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:30.715071   431 webserver.cc:533] Webserver started at http://127.0.107.193:34843/ using document root <none> and password file <none>
I20260709 13:04:30.716207   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:30.716601   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:04:30.730118   431 fs_manager.cc:714] Time spent opening directory manager: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:04:30.741029  8530 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:30.742125   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:04:30.742501   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
format_stamp: "Formatted at 2026-07-09 13:04:13 on dist-test-slave-smzk"
I20260709 13:04:30.742997   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:30.798200  8509 raft_consensus.cc:493] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:30.798956  8509 raft_consensus.cc:515] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:30.804131   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:30.806666   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:30.810776  8509 leader_election.cc:290] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:30.812798  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:30.840817  7860 leader_election.cc:336] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:30.841958  7860 leader_election.cc:304] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:30.843158  8509 raft_consensus.cc:2749] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:30.846639  8482 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:30.848006  8482 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:30.855293  8517 raft_consensus.cc:493] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:30.856212  8517 raft_consensus.cc:515] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:30.861441  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:30.861891  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:30.862577  7889 raft_consensus.cc:2468] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:30.871196  7710 leader_election.cc:304] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:30.872478  8392 raft_consensus.cc:2804] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:30.872954  8392 raft_consensus.cc:493] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:30.873332  8392 raft_consensus.cc:3060] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:30.876066  8517 leader_election.cc:290] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:30.883095  8392 raft_consensus.cc:515] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:30.894033  8392 leader_election.cc:290] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:30.906278  8482 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:30.907413  8516 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:30.908634  8516 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:30.916531  8392 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:30.917462  8392 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:30.921463  8392 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:30.938848  8516 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:30.945297  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b897e7d731a42678b1ecb79b5e2e468" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:30.945583  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:30.946238  7889 raft_consensus.cc:3060] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:30.956286  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 51025.2us
I20260709 13:04:30.960155   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:30.961305  7889 raft_consensus.cc:2468] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 2.
I20260709 13:04:30.971470  7710 leader_election.cc:304] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:30.976248  8517 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:30.976907  8517 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:30.977051  8481 raft_consensus.cc:2804] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:30.978193  8481 raft_consensus.cc:697] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:30.979818  8517 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:30.979904  8481 consensus_queue.cc:237] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:31.006623  7712 leader_election.cc:336] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.007612  7712 leader_election.cc:336] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.013372  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:31.017870  7786 leader_election.cc:336] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.035104  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:31.036304  7819 raft_consensus.cc:2468] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:31.038089  8513 raft_consensus.cc:493] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.039310  8513 raft_consensus.cc:515] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.045153  7746 raft_consensus.cc:2468] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:31.052297  7713 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:31.055106  8482 raft_consensus.cc:2804] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.056504  8392 raft_consensus.cc:493] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.057350  8392 raft_consensus.cc:515] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.070739  7785 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:31.055763  8482 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.072705  8482 raft_consensus.cc:3060] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.077651  8392 leader_election.cc:290] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:31.093569  7712 leader_election.cc:336] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.094091  8463 raft_consensus.cc:2804] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.094486  7712 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:31.095036  8463 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.095570  8463 raft_consensus.cc:3060] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.095582  8537 raft_consensus.cc:2749] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:31.102128  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 45668us
I20260709 13:04:31.107689  8463 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.114693  8463 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:31.115779  8255 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.118357  8255 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:31.122506  8255 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:31.125658  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
W20260709 13:04:31.095829  7712 leader_election.cc:336] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.138482  7712 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:31.139827  8537 raft_consensus.cc:2749] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:31.141274  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 45475.8us
W20260709 13:04:31.142746  7712 leader_election.cc:336] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.145315  8537 raft_consensus.cc:493] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.146858  8537 raft_consensus.cc:515] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.151348  8537 leader_election.cc:290] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:31.155167  8513 leader_election.cc:290] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:31.161322  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:31.162478  7744 raft_consensus.cc:2468] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
W20260709 13:04:31.171000  7860 leader_election.cc:336] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.172273  8392 raft_consensus.cc:493] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.173843  8392 raft_consensus.cc:515] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:31.180550  8255 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.181281  8255 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:31.184587  8255 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:31.190465  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:31.191730  7819 raft_consensus.cc:2468] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:31.195031  7888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00461ff939684b6fb3967bed0ebf0cd7" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:31.195919  7888 raft_consensus.cc:2468] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:31.201493  7710 leader_election.cc:304] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:31.203739  8517 raft_consensus.cc:2804] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.204367  8517 raft_consensus.cc:493] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.204874  8517 raft_consensus.cc:3060] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:31.205940  7860 leader_election.cc:336] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.226433  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 83710.8us
I20260709 13:04:31.230216  7785 leader_election.cc:304] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:31.231758  8463 raft_consensus.cc:2804] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.232314  8463 raft_consensus.cc:493] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.232858  8463 raft_consensus.cc:3060] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.243978  8463 raft_consensus.cc:515] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.253404  8463 leader_election.cc:290] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:31.263063  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:31.264219  7821 raft_consensus.cc:2393] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 2: Already voted for candidate 7873a3a04f1f4097ac2435c017ca346a in this term.
I20260709 13:04:31.266397  8392 leader_election.cc:290] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:31.274618  7566 catalog_manager.cc:5697] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 1 to 2, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:31.291457  7713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 65411.4us
I20260709 13:04:31.356416  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:31.359308  7746 raft_consensus.cc:2468] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:31.356518  8481 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.361925  8481 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.343458  8482 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.376559  7747 raft_consensus.cc:2393] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 2: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:31.376969  8482 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:31.377398  8481 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:31.380311  7713 leader_election.cc:304] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:31.381623  8392 raft_consensus.cc:2804] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.382077  8392 raft_consensus.cc:493] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.382504  8392 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.385133  7859 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:31.386544  8539 raft_consensus.cc:2804] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.386955  8539 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.387318  8539 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.390942  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:31.393688  7747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf11683974b449738775dd5a453c9b7c" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:31.400883  7747 raft_consensus.cc:3060] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.400920  7746 raft_consensus.cc:2468] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:31.401682  8517 raft_consensus.cc:515] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:31.396071  8481 raft_consensus.cc:493] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.404346  8481 raft_consensus.cc:515] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:31.406497  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00461ff939684b6fb3967bed0ebf0cd7" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:31.407262  7889 raft_consensus.cc:3060] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.410929  7747 raft_consensus.cc:2468] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:31.400024  7888 raft_consensus.cc:1275] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 146ed2d5dab84c27a16d479f2aa5eb47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.398252  8542 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:04:31.422058  7819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:31.412953  8481 leader_election.cc:290] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:31.414202  7892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:31.416087  8392 raft_consensus.cc:515] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.480968  8392 leader_election.cc:290] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:31.418395  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:31.482772  7821 raft_consensus.cc:2393] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 2: Already voted for candidate 7873a3a04f1f4097ac2435c017ca346a in this term.
I20260709 13:04:31.432242  7889 raft_consensus.cc:2468] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 2.
I20260709 13:04:31.424953  8517 leader_election.cc:290] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:31.429708  8544 consensus_queue.cc:1048] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:04:31.442795  8539 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:31.458621  8513 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.485230  8513 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.486481  8539 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:31.488070  7710 leader_election.cc:304] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:31.491734  8544 raft_consensus.cc:2804] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:31.492102  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:31.492424  8544 raft_consensus.cc:697] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:31.492906  7821 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.493418  8544 consensus_queue.cc:237] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:31.496668  7785 leader_election.cc:304] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:31.500115  8516 raft_consensus.cc:2804] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:31.500982  8516 raft_consensus.cc:697] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:31.502170  8516 consensus_queue.cc:237] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:31.511641  7860 leader_election.cc:336] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.407187  7712 leader_election.cc:336] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.490151  8513 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:31.464365  7786 leader_election.cc:336] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.517531  7786 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
W20260709 13:04:31.518719  7786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 54372.8us
I20260709 13:04:31.490375  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:31.518767  8463 raft_consensus.cc:2749] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:31.520087  7746 raft_consensus.cc:2468] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 1.
I20260709 13:04:31.490556  7819 raft_consensus.cc:2468] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 1.
I20260709 13:04:31.526074  7713 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:31.527109  8392 raft_consensus.cc:2804] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.527545  8392 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.527925  8392 raft_consensus.cc:3060] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.530507  7821 raft_consensus.cc:2468] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 2.
I20260709 13:04:31.533357  7785 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:31.534471  7713 leader_election.cc:304] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:31.535727  8517 raft_consensus.cc:2804] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:31.536631  8517 raft_consensus.cc:697] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:31.537784  8517 consensus_queue.cc:237] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.539902  8513 raft_consensus.cc:2804] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.540794  8513 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.541232  8513 raft_consensus.cc:3060] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.549511  8392 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.560124  7821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
W20260709 13:04:31.564107  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 156901us
W20260709 13:04:31.566182  7712 leader_election.cc:336] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.566695  7712 leader_election.cc:304] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:31.567466  8392 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:31.575037  7786 leader_election.cc:336] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.576020  7786 leader_election.cc:336] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.577747  8481 raft_consensus.cc:2749] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:31.579212  7712 leader_election.cc:336] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.586493  7859 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
W20260709 13:04:31.589389  7860 consensus_peers.cc:597] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:31.588182  8538 raft_consensus.cc:2804] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.590799  8538 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.591408  8538 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.588284  8539 raft_consensus.cc:493] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.592386  8539 raft_consensus.cc:515] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:31.596735  8539 leader_election.cc:290] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:31.633210  7712 leader_election.cc:336] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.634078  7712 leader_election.cc:336] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.638628  7786 leader_election.cc:336] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.634410  7712 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:31.641546  8481 raft_consensus.cc:2749] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:04:31.653229  7860 leader_election.cc:336] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.668251  7860 consensus_peers.cc:597] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:31.674269  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:31.675122  7746 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.689059  7746 raft_consensus.cc:2468] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 2.
I20260709 13:04:31.686059  8513 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:31.709605  7821 raft_consensus.cc:2393] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 146ed2d5dab84c27a16d479f2aa5eb47 in current term 2: Already voted for candidate 7873a3a04f1f4097ac2435c017ca346a in this term.
I20260709 13:04:31.714359  8538 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:31.714262  7568 catalog_manager.cc:5697] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 1 to 2, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.718297  7568 catalog_manager.cc:5697] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 1 to 2, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.725396  7569 catalog_manager.cc:5697] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 1 to 2, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:31.728360  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:31.730239  7746 raft_consensus.cc:2468] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 1.
I20260709 13:04:31.747571  8538 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:31.758515  8513 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:31.758790  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:31.761041  7741 raft_consensus.cc:2393] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7873a3a04f1f4097ac2435c017ca346a in current term 2: Already voted for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in this term.
I20260709 13:04:31.787911  7859 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:31.788949  8510 raft_consensus.cc:2804] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:31.789544  8510 raft_consensus.cc:697] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:31.790551  8510 consensus_queue.cc:237] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:31.797607  7859 leader_election.cc:304] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:31.798959  8539 raft_consensus.cc:2804] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:31.799422  8539 raft_consensus.cc:493] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:31.799873  8539 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:31.801826  7712 leader_election.cc:336] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.802465  7712 leader_election.cc:304] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
W20260709 13:04:31.807636  7786 leader_election.cc:336] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.808193  7786 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:31.809159  8554 raft_consensus.cc:2749] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:31.814221  8543 raft_consensus.cc:2749] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:31.815665  7712 leader_election.cc:336] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.816638  7712 leader_election.cc:336] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.817725  7712 leader_election.cc:336] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.818202  7712 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:31.813169  8539 raft_consensus.cc:515] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:31.829195  8539 leader_election.cc:290] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:31.839145  8543 raft_consensus.cc:2749] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:31.854264  7568 catalog_manager.cc:5697] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 1 to 2, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 2 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.857508  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:31.858306  7741 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.868528  7741 raft_consensus.cc:2468] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 2.
W20260709 13:04:31.872074  7860 consensus_peers.cc:597] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:31.872748  7860 leader_election.cc:336] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:31.881294  7712 consensus_peers.cc:597] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:31.882278  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:31.883064  7741 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:31.892789  7859 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:31.893867  8539 raft_consensus.cc:2804] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:04:31.894070  7712 consensus_peers.cc:597] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:31.894608  8539 raft_consensus.cc:697] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:31.895890  8539 consensus_queue.cc:237] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:31.894747  7712 consensus_peers.cc:597] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:31.901610  7712 consensus_peers.cc:597] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:31.904580  7860 leader_election.cc:336] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:31.905886  7741 raft_consensus.cc:2468] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc40c50d1f1e4a7eb98877bf59aaf75d in term 2.
I20260709 13:04:31.925695  7859 leader_election.cc:304] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:31.927243  8539 raft_consensus.cc:2804] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:31.930063  8539 raft_consensus.cc:697] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Becoming Leader. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:31.931145  8539 consensus_queue.cc:237] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
W20260709 13:04:31.933877  7712 consensus_peers.cc:597] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:31.939535  7820 raft_consensus.cc:1275] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 146ed2d5dab84c27a16d479f2aa5eb47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.941800  8476 consensus_queue.cc:1048] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:31.949247  7860 consensus_peers.cc:597] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:31.953020  7746 raft_consensus.cc:1275] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:31.957850  8554 consensus_queue.cc:1048] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:31.961450  7860 consensus_peers.cc:597] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:31.947252  7568 catalog_manager.cc:5697] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 1 to 2, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 2 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:31.972688  7786 consensus_peers.cc:597] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:31.976568  7860 consensus_peers.cc:597] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:31.990064  7860 consensus_peers.cc:597] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.007813  7712 consensus_peers.cc:597] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:32.010265  7712 consensus_peers.cc:597] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.012558  7786 consensus_peers.cc:597] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:32.013178  7786 consensus_peers.cc:597] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.025343  7712 consensus_peers.cc:597] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:32.028913  7889 raft_consensus.cc:1275] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 146ed2d5dab84c27a16d479f2aa5eb47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:32.033535  7712 consensus_peers.cc:597] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:32.039347  7569 catalog_manager.cc:5697] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d reported cstate change: term changed from 1 to 2, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196). New cstate: current_term: 2 leader_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.050199  8476 consensus_queue.cc:1048] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:32.052917  7860 consensus_peers.cc:597] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.054068  7860 consensus_peers.cc:597] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.127457  7860 consensus_peers.cc:597] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.140602  7786 consensus_peers.cc:597] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.160638  7860 consensus_peers.cc:597] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.161175  7860 consensus_peers.cc:597] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.162068  7712 consensus_peers.cc:597] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.178131  7860 consensus_peers.cc:597] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:32.203975  7741 raft_consensus.cc:1275] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer cc40c50d1f1e4a7eb98877bf59aaf75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.205891  8510 consensus_queue.cc:1048] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:32.261667  7860 consensus_peers.cc:597] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.262187  7860 consensus_peers.cc:597] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.270268  7712 consensus_peers.cc:597] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.288089  7860 consensus_peers.cc:597] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:32.304064  7786 consensus_peers.cc:597] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.320899  7786 consensus_peers.cc:597] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.347591  7712 consensus_peers.cc:597] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.366900  7712 consensus_peers.cc:597] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:32.400727  8542 ts_tablet_manager.cc:548] Loading tablet metadata (18/45 complete)
W20260709 13:04:32.434849  7860 consensus_peers.cc:597] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.470340  7786 consensus_peers.cc:597] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.473414  7860 consensus_peers.cc:597] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:32.474052  7860 consensus_peers.cc:597] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.496421  7712 consensus_peers.cc:597] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:32.503499  7741 raft_consensus.cc:1275] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer cc40c50d1f1e4a7eb98877bf59aaf75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.506273  8539 consensus_queue.cc:1048] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:32.569823  7786 consensus_peers.cc:597] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:32.576292  7746 raft_consensus.cc:1275] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer cc40c50d1f1e4a7eb98877bf59aaf75d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:32.578217  8255 consensus_queue.cc:1048] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:32.660499  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 73748.2us
W20260709 13:04:32.721874  7712 consensus_peers.cc:597] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:32.742905  7860 consensus_peers.cc:597] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.143615   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:04:33.144541   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 1.820s	user 0.015s	sys 0.013s
I20260709 13:04:33.145251   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:04:33.157572  8542 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.206105  8542 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:33.207450  8542 tablet_bootstrap.cc:492] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:33.210121  8542 ts_tablet_manager.cc:1403] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.026s
I20260709 13:04:33.215981  8542 raft_consensus.cc:359] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:33.217705  8542 raft_consensus.cc:740] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.218890  8542 consensus_queue.cc:260] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:33.244716  8542 ts_tablet_manager.cc:1434] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.031s	user 0.013s	sys 0.009s
I20260709 13:04:33.245947  8542 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.275887  8542 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:33.277155  8542 tablet_bootstrap.cc:492] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:33.278020  8542 ts_tablet_manager.cc:1403] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.008s
I20260709 13:04:33.281163  8542 raft_consensus.cc:359] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:33.282003  8542 raft_consensus.cc:740] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.283052  8542 consensus_queue.cc:260] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:33.285463  8542 ts_tablet_manager.cc:1434] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:33.286429  8542 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.336186  8542 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:33.337553  8542 tablet_bootstrap.cc:492] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:33.338372  8542 ts_tablet_manager.cc:1403] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.017s
I20260709 13:04:33.341810  8542 raft_consensus.cc:359] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:33.342700  8542 raft_consensus.cc:740] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.343798  8542 consensus_queue.cc:260] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:33.346714  8542 ts_tablet_manager.cc:1434] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:04:33.347832  8542 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.398283  8542 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:33.399678  8542 tablet_bootstrap.cc:492] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:33.400516  8542 ts_tablet_manager.cc:1403] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.014s
I20260709 13:04:33.403573  8542 raft_consensus.cc:359] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:33.404462  8542 raft_consensus.cc:740] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.405437  8542 consensus_queue.cc:260] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:33.412696  8542 ts_tablet_manager.cc:1434] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:33.413884  8542 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.461774  8542 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:33.469661  8542 tablet_bootstrap.cc:492] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:33.470579  8542 ts_tablet_manager.cc:1403] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.008s
I20260709 13:04:33.474102  8542 raft_consensus.cc:359] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:33.475016  8542 raft_consensus.cc:740] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.476089  8542 consensus_queue.cc:260] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:33.479053  8542 ts_tablet_manager.cc:1434] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:33.480240  8542 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.513969  8542 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:33.517913  8542 tablet_bootstrap.cc:492] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:33.518868  8542 ts_tablet_manager.cc:1403] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.007s
I20260709 13:04:33.523474  8542 raft_consensus.cc:359] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:33.524436  8542 raft_consensus.cc:740] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.525386  8542 consensus_queue.cc:260] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:33.529388  8542 ts_tablet_manager.cc:1434] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:33.530498  8542 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.568571  8542 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:33.569988  8542 tablet_bootstrap.cc:492] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:33.570880  8542 ts_tablet_manager.cc:1403] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.011s
I20260709 13:04:33.573701  8554 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.574097  8542 raft_consensus.cc:359] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:33.574493  8554 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:33.574980  8542 raft_consensus.cc:740] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.575980  8542 consensus_queue.cc:260] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:33.578563  8542 ts_tablet_manager.cc:1434] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:33.579486  8542 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.615790  8554 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:33.625568   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:04:33.626065   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.481s	user 0.304s	sys 0.014s
I20260709 13:04:33.631500  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:33.633224  7741 raft_consensus.cc:2468] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:33.656774  7785 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:33.659119  8572 raft_consensus.cc:2804] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:33.659866  8572 raft_consensus.cc:493] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.660496  8572 raft_consensus.cc:3060] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:33.690913  7786 leader_election.cc:336] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:33.712839  7785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 56332.1us
I20260709 13:04:33.716503  8573 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.717486  8573 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:33.758844  8573 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:33.825547  7785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 110397us
I20260709 13:04:33.834179  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:33.835575  7741 raft_consensus.cc:2468] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:33.839444  7785 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:33.841006  8586 raft_consensus.cc:2804] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:33.841521  8586 raft_consensus.cc:493] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.842016  8586 raft_consensus.cc:3060] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:04:33.909072  7860 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 84929.1us
W20260709 13:04:33.916803  7785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 77458.2us
I20260709 13:04:34.020563  8542 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.021898  8542 tablet_bootstrap.cc:492] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.022756  8542 ts_tablet_manager.cc:1403] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.443s	user 0.154s	sys 0.241s
I20260709 13:04:34.025915  8542 raft_consensus.cc:359] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:34.026575  8542 raft_consensus.cc:740] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.027683  8542 consensus_queue.cc:260] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:34.030777  8542 ts_tablet_manager.cc:1434] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:04:34.031890  8542 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:34.060883  8572 raft_consensus.cc:515] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:34.063387  8542 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.064949  8542 tablet_bootstrap.cc:492] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.065899  8542 ts_tablet_manager.cc:1403] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.011s
I20260709 13:04:34.069175  8572 leader_election.cc:290] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:34.069419  8542 raft_consensus.cc:359] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.070607  8542 raft_consensus.cc:740] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.071767  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72c94730189a4964ab34c7aefdbd813a" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:34.071753  8542 consensus_queue.cc:260] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.072867  7746 raft_consensus.cc:3060] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.074783  8542 ts_tablet_manager.cc:1434] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:34.075891  8542 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:33.970211  8586 raft_consensus.cc:515] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:34.086886  8586 leader_election.cc:290] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 election: Requested vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:34.101735  8542 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.103120  8542 tablet_bootstrap.cc:492] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.103977  8542 ts_tablet_manager.cc:1403] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 13:04:34.107323  8542 raft_consensus.cc:359] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:34.108323  8542 raft_consensus.cc:740] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.109373  8542 consensus_queue.cc:260] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:34.112388  8542 ts_tablet_manager.cc:1434] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:34.113399  8542 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:34.123862  7741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89b785eb056a414f897653597ab2eaf1" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:34.125239  7741 raft_consensus.cc:3060] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:34.158591  7746 raft_consensus.cc:2468] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 3.
W20260709 13:04:34.161397  7786 leader_election.cc:336] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:34.176332  7785 leader_election.cc:304] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
W20260709 13:04:34.177000  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 113367us
I20260709 13:04:34.177577  8586 raft_consensus.cc:2804] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:34.203552  8542 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.178066  8586 raft_consensus.cc:697] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 3 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:34.223001  8586 consensus_queue.cc:237] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:34.227348  7786 leader_election.cc:336] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:34.228009  7786 leader_election.cc:336] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:34.219040  7712 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111) [suppressed 380 similar messages]
I20260709 13:04:34.252635  8542 tablet_bootstrap.cc:492] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.253407  8542 ts_tablet_manager.cc:1403] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.140s	user 0.028s	sys 0.017s
I20260709 13:04:34.257958  7741 raft_consensus.cc:2468] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 3.
I20260709 13:04:34.262924  7785 leader_election.cc:304] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:34.265507  8572 raft_consensus.cc:2804] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:34.266284  8572 raft_consensus.cc:697] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 3 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:34.266875  8542 raft_consensus.cc:359] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:34.267647  8542 raft_consensus.cc:740] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.267274  8572 consensus_queue.cc:237] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:34.276517  8542 consensus_queue.cc:260] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:34.277768  7712 consensus_peers.cc:597] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.295428  7712 consensus_peers.cc:597] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:34.298777  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 47463.9us
W20260709 13:04:34.307250  7713 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 49077.6us
I20260709 13:04:34.317945  8542 ts_tablet_manager.cc:1434] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.001s
I20260709 13:04:34.319218  8542 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:34.390877  7712 consensus_peers.cc:597] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.428347  7569 catalog_manager.cc:5697] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 1 to 3, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:34.450347  7712 consensus_peers.cc:597] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.459604  7860 consensus_peers.cc:597] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.463238  7712 consensus_peers.cc:597] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.495822  7786 consensus_peers.cc:597] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:34.504896  8542 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.506146  8542 tablet_bootstrap.cc:492] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.506943  8542 ts_tablet_manager.cc:1403] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.188s	user 0.018s	sys 0.009s
W20260709 13:04:34.516244  7860 consensus_peers.cc:597] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.516901  7860 consensus_peers.cc:597] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.517307  7860 consensus_peers.cc:597] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.519678  8542 raft_consensus.cc:359] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.520458  8542 raft_consensus.cc:740] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.523209  8542 consensus_queue.cc:260] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.526149  8542 ts_tablet_manager.cc:1434] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:04:34.526953  8542 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:34.534511  8575 raft_consensus.cc:493] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.535138  8575 raft_consensus.cc:515] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:34.545027  7860 consensus_peers.cc:597] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.545671  8575 leader_election.cc:290] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:34.548198  7786 consensus_peers.cc:597] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.549647  7712 consensus_peers.cc:597] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:34.552351  7860 consensus_peers.cc:597] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.564450  7712 consensus_peers.cc:597] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.614097  7712 consensus_peers.cc:597] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:34.618918  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
W20260709 13:04:34.622360  7712 consensus_peers.cc:597] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.622900  7712 consensus_peers.cc:597] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.623530  7569 catalog_manager.cc:5697] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 1 to 3, leader changed from 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193) to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 3 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.626134  8542 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.627378  8542 tablet_bootstrap.cc:492] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.628355  8542 ts_tablet_manager.cc:1403] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.102s	user 0.024s	sys 0.002s
I20260709 13:04:34.632584  8542 raft_consensus.cc:359] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.634078  8542 raft_consensus.cc:740] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.635054  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:34.636018  8542 consensus_queue.cc:260] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.637156  8534 leader_election.cc:304] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:34.638667  8575 raft_consensus.cc:2749] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:34.640424  8542 ts_tablet_manager.cc:1434] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:04:34.641578  8542 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:34.665400  7786 consensus_peers.cc:597] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.688026  8542 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.689563  8542 tablet_bootstrap.cc:492] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.690533  8542 ts_tablet_manager.cc:1403] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.049s	user 0.025s	sys 0.005s
I20260709 13:04:34.709659  8542 raft_consensus.cc:359] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.712800  8542 raft_consensus.cc:740] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.713814  8542 consensus_queue.cc:260] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.716452  8542 ts_tablet_manager.cc:1434] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:04:34.717778  8542 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:34.747443  7786 consensus_peers.cc:597] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.749931  7744 raft_consensus.cc:1275] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:34.752105  8572 consensus_queue.cc:1048] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:34.755609  7786 consensus_peers.cc:597] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:34.822243  8575 raft_consensus.cc:493] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.823024  8575 raft_consensus.cc:515] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:34.830113  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c6a31a382c47888fc962c7a1a27921" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:34.832000  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5c6a31a382c47888fc962c7a1a27921" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:34.833957  8534 leader_election.cc:304] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:34.835891  8575 leader_election.cc:290] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:34.841355  8575 raft_consensus.cc:2749] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:34.849462  8542 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.856339  8542 tablet_bootstrap.cc:492] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.863722  8542 ts_tablet_manager.cc:1403] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.008s
I20260709 13:04:34.866978  8542 raft_consensus.cc:359] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:34.858866  7860 consensus_peers.cc:597] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.870822  8542 raft_consensus.cc:740] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
W20260709 13:04:34.871151  7860 consensus_peers.cc:597] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.872216  7860 consensus_peers.cc:597] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.872910  7745 raft_consensus.cc:1275] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:34.877282  8586 consensus_queue.cc:1048] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:34.886013  8542 consensus_queue.cc:260] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:34.892174  8542 ts_tablet_manager.cc:1434] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:04:34.893184  8542 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:34.899982  7860 consensus_peers.cc:597] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:34.906390  7860 consensus_peers.cc:597] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.907195  8660 raft_consensus.cc:493] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.907779  8660 raft_consensus.cc:515] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.914606  8660 leader_election.cc:290] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:34.916545  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6de6b4220944748b4c901c3f0e50bfe" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
W20260709 13:04:34.909850  7860 consensus_peers.cc:597] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:34.961578  8542 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:34.962900  8542 tablet_bootstrap.cc:492] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:34.963609  8542 ts_tablet_manager.cc:1403] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.013s
I20260709 13:04:34.966476  8542 raft_consensus.cc:359] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.967324  8542 raft_consensus.cc:740] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.968760  8542 consensus_queue.cc:260] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.970899  8542 ts_tablet_manager.cc:1434] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:04:34.971721  8542 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:34.973266  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6de6b4220944748b4c901c3f0e50bfe" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:34.975981  8531 leader_election.cc:304] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:34.977500  8660 raft_consensus.cc:493] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.977985  8660 raft_consensus.cc:515] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:34.980445  8575 raft_consensus.cc:2749] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:34.981594  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:34.982522  8660 leader_election.cc:290] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:34.985550  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:34.987648  8531 leader_election.cc:304] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:34.989548  8660 raft_consensus.cc:2749] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.042817  8660 raft_consensus.cc:493] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.043380  8660 raft_consensus.cc:515] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.045658  8660 leader_election.cc:290] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:35.050127  8542 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.051213  8542 tablet_bootstrap.cc:492] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.054857  7815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa1517a5fc74d25bb5d1b3fa8947cb5" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7873a3a04f1f4097ac2435c017ca346a" is_pre_election: true
I20260709 13:04:35.051896  8542 ts_tablet_manager.cc:1403] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.016s
I20260709 13:04:35.056155  7745 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa1517a5fc74d25bb5d1b3fa8947cb5" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:35.058431  8542 raft_consensus.cc:359] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.059209  8542 raft_consensus.cc:740] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.060135  8542 consensus_queue.cc:260] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.060515  8532 leader_election.cc:304] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:35.061404  8660 raft_consensus.cc:2749] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.063328  8542 ts_tablet_manager.cc:1434] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:35.064268  8542 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:35.080461  7860 consensus_peers.cc:597] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:35.112217  8542 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.113356  8542 tablet_bootstrap.cc:492] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.114118  8542 ts_tablet_manager.cc:1403] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.006s
I20260709 13:04:35.120481  8542 raft_consensus.cc:359] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.121366  8542 raft_consensus.cc:740] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.122736  8542 consensus_queue.cc:260] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
W20260709 13:04:35.126118  7860 consensus_peers.cc:597] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:35.131162  8542 ts_tablet_manager.cc:1434] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:04:35.133999  8542 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.150125  8660 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.150784  8660 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:35.154301  8660 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:35.154888  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:35.155010  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:35.169242  8531 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:35.186213  8660 raft_consensus.cc:2749] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:35.192309  7860 consensus_peers.cc:597] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:35.201746  8542 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.202800  8542 tablet_bootstrap.cc:492] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.204921  8542 ts_tablet_manager.cc:1403] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.071s	user 0.016s	sys 0.002s
I20260709 13:04:35.211724  8542 raft_consensus.cc:359] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:35.212651  8542 raft_consensus.cc:740] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.219597   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:39365
I20260709 13:04:35.219218  8542 consensus_queue.cc:260] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:35.219861  8682 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:39365 every 8 connection(s)
I20260709 13:04:35.222584  8542 ts_tablet_manager.cc:1434] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:04:35.223763  8542 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.239024  8660 raft_consensus.cc:493] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.239626  8660 raft_consensus.cc:515] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:35.244650  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6bac98b41745fab1ce373328ca0c8b" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" is_pre_election: true
I20260709 13:04:35.244711  7890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b6bac98b41745fab1ce373328ca0c8b" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
I20260709 13:04:35.247306  8532 leader_election.cc:304] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:35.248873  8660 leader_election.cc:290] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:35.248325  8575 raft_consensus.cc:2749] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.281711  8542 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.283139  8542 tablet_bootstrap.cc:492] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.284171  8542 ts_tablet_manager.cc:1403] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.000s
I20260709 13:04:35.287429  8542 raft_consensus.cc:359] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.288265  8542 raft_consensus.cc:740] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.289191  8542 consensus_queue.cc:260] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.296119  8542 ts_tablet_manager.cc:1434] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:35.297093  8542 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.309103  8683 heartbeater.cc:344] Connected to a master server at 127.0.107.254:33985
I20260709 13:04:35.309808  8683 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:35.310880  8683 heartbeater.cc:507] Master 127.0.107.254:33985 requested a full tablet report, sending...
I20260709 13:04:35.326535  8642 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.341786  8643 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.362668  8542 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.371526  8542 tablet_bootstrap.cc:492] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.420176  8542 ts_tablet_manager.cc:1403] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.123s	user 0.015s	sys 0.011s
W20260709 13:04:35.420814  7860 consensus_peers.cc:597] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:35.433779  8542 raft_consensus.cc:359] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.445024  7568 ts_manager.cc:194] Re-registered known tserver with Master: 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:35.459611  8542 raft_consensus.cc:740] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.462658  8542 consensus_queue.cc:260] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.467279  8542 ts_tablet_manager.cc:1434] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:04:35.468479  8542 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.517088  8645 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:35.540177  8542 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.541271  8542 tablet_bootstrap.cc:492] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.541978  8542 ts_tablet_manager.cc:1403] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.074s	user 0.024s	sys 0.002s
I20260709 13:04:35.567279  8542 raft_consensus.cc:359] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:35.580381  8542 raft_consensus.cc:740] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.581118  8542 consensus_queue.cc:260] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:35.584089  8542 ts_tablet_manager.cc:1434] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:04:35.584864  8542 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.599429  7568 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48888
I20260709 13:04:35.606304  8683 heartbeater.cc:499] Master 127.0.107.254:33985 was elected leader, sending a full tablet report...
I20260709 13:04:35.610462  8542 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.611500  8542 tablet_bootstrap.cc:492] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.612152  8542 ts_tablet_manager.cc:1403] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.006s
I20260709 13:04:35.614814  8542 raft_consensus.cc:359] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:35.615469  8542 raft_consensus.cc:740] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.616211  8542 consensus_queue.cc:260] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:35.618341  8542 ts_tablet_manager.cc:1434] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:35.619076  8542 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.665676  8542 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.666710  8542 tablet_bootstrap.cc:492] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.667481  8542 ts_tablet_manager.cc:1403] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.008s
I20260709 13:04:35.670372  8542 raft_consensus.cc:359] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.671111  8542 raft_consensus.cc:740] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.680729  8542 consensus_queue.cc:260] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:35.683115  8542 ts_tablet_manager.cc:1434] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:04:35.683918  8542 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.724784  8542 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.725764  8542 tablet_bootstrap.cc:492] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.726413  8542 ts_tablet_manager.cc:1403] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260709 13:04:35.729099  8542 raft_consensus.cc:359] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:35.729785  8542 raft_consensus.cc:740] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.735078  8542 consensus_queue.cc:260] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:35.737193  8542 ts_tablet_manager.cc:1434] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:35.738183  8542 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.779237  8542 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.780243  8542 tablet_bootstrap.cc:492] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.787510  8542 ts_tablet_manager.cc:1403] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.011s
I20260709 13:04:35.790184  8542 raft_consensus.cc:359] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:35.790866  8542 raft_consensus.cc:740] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.791528  8542 consensus_queue.cc:260] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:35.798558  8542 ts_tablet_manager.cc:1434] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:35.802824  8542 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.846246  8542 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.850062  8542 tablet_bootstrap.cc:492] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.850822  8542 ts_tablet_manager.cc:1403] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.000s
I20260709 13:04:35.853574  8542 raft_consensus.cc:359] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:35.854163  8542 raft_consensus.cc:740] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.854862  8542 consensus_queue.cc:260] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:35.856526  8542 ts_tablet_manager.cc:1434] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
W20260709 13:04:35.869844  7712 consensus_peers.cc:597] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:35.882531  8542 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:35.911002  8542 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:35.912161  8542 tablet_bootstrap.cc:492] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:35.914216  8542 ts_tablet_manager.cc:1403] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.032s	user 0.025s	sys 0.000s
I20260709 13:04:35.924365  8542 raft_consensus.cc:359] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:35.925146  8542 raft_consensus.cc:740] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.925884  8542 consensus_queue.cc:260] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:35.928189  8542 ts_tablet_manager.cc:1434] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:04:35.929116  8542 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:35.970322  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 43974.1us
I20260709 13:04:36.000310  8642 raft_consensus.cc:3060] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:04:36.004726  7712 consensus_peers.cc:597] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:36.014309  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 71902.3us
I20260709 13:04:36.027725  8636 raft_consensus.cc:3060] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:04:36.039108  7786 consensus_peers.cc:597] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:04:36.052809  7786 consensus_peers.cc:597] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:36.102967  8642 raft_consensus.cc:1275] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:36.122709  8542 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:04:36.122129  7786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 66441.6us
W20260709 13:04:36.125886  7785 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 61251.6us
I20260709 13:04:36.153049  8542 tablet_bootstrap.cc:492] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.154130  8542 ts_tablet_manager.cc:1403] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.225s	user 0.030s	sys 0.028s
I20260709 13:04:36.193426  8711 consensus_queue.cc:1048] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:04:36.271970  8542 raft_consensus.cc:359] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:36.273193  8542 raft_consensus.cc:740] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.274279  8542 consensus_queue.cc:260] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:36.276676  8542 ts_tablet_manager.cc:1434] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.004s
I20260709 13:04:36.278017  8542 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:36.289687  7712 consensus_peers.cc:597] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:04:36.334085  8636 raft_consensus.cc:3060] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.344154  8642 raft_consensus.cc:3060] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:36.407804  8542 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.409466  8542 tablet_bootstrap.cc:492] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.412140  8542 ts_tablet_manager.cc:1403] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.017s
I20260709 13:04:36.419255  8542 raft_consensus.cc:359] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:36.420157  8542 raft_consensus.cc:740] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.420956  8542 consensus_queue.cc:260] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:36.436470  8542 ts_tablet_manager.cc:1434] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:36.447256  8542 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:36.498745  8542 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.499984  8542 tablet_bootstrap.cc:492] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.500705  8542 ts_tablet_manager.cc:1403] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.004s
I20260709 13:04:36.503535  8542 raft_consensus.cc:359] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:36.504340  8542 raft_consensus.cc:740] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.505079  8542 consensus_queue.cc:260] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:36.525163  8542 ts_tablet_manager.cc:1434] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:04:36.536538  8542 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:36.562824  8542 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.563889  8542 tablet_bootstrap.cc:492] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.564693  8542 ts_tablet_manager.cc:1403] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 13:04:36.568114  8542 raft_consensus.cc:359] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:36.568895  8542 raft_consensus.cc:740] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.569809  8542 consensus_queue.cc:260] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:36.585356  8542 ts_tablet_manager.cc:1434] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:04:36.589728  8542 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:36.636534  8542 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.637488  8542 tablet_bootstrap.cc:492] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.638015  8542 ts_tablet_manager.cc:1403] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.011s
I20260709 13:04:36.639951  8542 raft_consensus.cc:359] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:36.640697  8542 raft_consensus.cc:740] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.641597  8542 consensus_queue.cc:260] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:36.648056  8542 ts_tablet_manager.cc:1434] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:36.648924  8542 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:36.678248  8542 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.679380  8542 tablet_bootstrap.cc:492] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.680248  8542 ts_tablet_manager.cc:1403] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.004s
I20260709 13:04:36.683094  8542 raft_consensus.cc:359] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:36.683796  8542 raft_consensus.cc:740] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.684515  8542 consensus_queue.cc:260] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:36.686770  8542 ts_tablet_manager.cc:1434] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:36.687687  8542 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:36.751194  8542 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.752321  8542 tablet_bootstrap.cc:492] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.753125  8542 ts_tablet_manager.cc:1403] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.015s
W20260709 13:04:36.753280  7860 consensus_peers.cc:597] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:36.755596  8542 raft_consensus.cc:359] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:36.756366  8542 raft_consensus.cc:740] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.757073  8542 consensus_queue.cc:260] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:36.759617  8542 ts_tablet_manager.cc:1434] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:04:36.760528  8542 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:36.806902  8542 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.808497  8542 tablet_bootstrap.cc:492] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.809314  8542 ts_tablet_manager.cc:1403] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.020s
I20260709 13:04:36.814519  8542 raft_consensus.cc:359] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:36.823956  8542 raft_consensus.cc:740] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.826663  8542 consensus_queue.cc:260] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:36.839001  8542 ts_tablet_manager.cc:1434] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.003s
I20260709 13:04:36.840164  8542 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
W20260709 13:04:36.895093  7860 consensus_peers.cc:597] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:04:36.910656  8542 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.911962  8542 tablet_bootstrap.cc:492] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.912809  8542 ts_tablet_manager.cc:1403] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.005s
I20260709 13:04:36.917503  8542 raft_consensus.cc:359] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:36.918320  8542 raft_consensus.cc:740] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.919269  8542 consensus_queue.cc:260] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:36.921841  8542 ts_tablet_manager.cc:1434] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:04:36.922816  8542 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:36.948477  8542 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.949923  8542 tablet_bootstrap.cc:492] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.950779  8542 ts_tablet_manager.cc:1403] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.004s
I20260709 13:04:36.953732  8542 raft_consensus.cc:359] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:36.954553  8542 raft_consensus.cc:740] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:36.955452  8542 consensus_queue.cc:260] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:36.957875  8542 ts_tablet_manager.cc:1434] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:36.959846  8542 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:36.993077  8542 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:36.994243  8542 tablet_bootstrap.cc:492] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:36.995194  8542 ts_tablet_manager.cc:1403] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.010s
I20260709 13:04:36.998144  8542 raft_consensus.cc:359] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:36.999950  8542 raft_consensus.cc:740] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.000803  8542 consensus_queue.cc:260] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:37.005497  8542 ts_tablet_manager.cc:1434] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:37.011070  8542 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:37.051426  8542 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:37.052312  8542 tablet_bootstrap.cc:492] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:37.052865  8542 ts_tablet_manager.cc:1403] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.013s
I20260709 13:04:37.054811  8542 raft_consensus.cc:359] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:37.055321  8542 raft_consensus.cc:740] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.055907  8542 consensus_queue.cc:260] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:37.057840  8542 ts_tablet_manager.cc:1434] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:04:37.059957  8542 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:37.090413  8542 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:37.091426  8542 tablet_bootstrap.cc:492] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:37.092163  8542 ts_tablet_manager.cc:1403] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.010s
I20260709 13:04:37.094456  8542 raft_consensus.cc:359] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:37.095031  8542 raft_consensus.cc:740] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.095654  8542 consensus_queue.cc:260] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:37.098053  8542 ts_tablet_manager.cc:1434] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:37.106540  8542 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:37.152150  8542 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:37.168172  8542 tablet_bootstrap.cc:492] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:37.168797  8542 ts_tablet_manager.cc:1403] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.001s
I20260709 13:04:37.172432  8542 raft_consensus.cc:359] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:37.173321  8542 raft_consensus.cc:740] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.175127  8542 consensus_queue.cc:260] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:37.177201  8542 ts_tablet_manager.cc:1434] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:04:37.188741  8542 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:37.234165  8542 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:37.235363  8542 tablet_bootstrap.cc:492] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:37.236177  8542 ts_tablet_manager.cc:1403] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.008s
I20260709 13:04:37.240420  8542 raft_consensus.cc:359] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:37.241278  8542 raft_consensus.cc:740] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.242444  8542 consensus_queue.cc:260] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:37.244818  8542 ts_tablet_manager.cc:1434] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:37.245962  8542 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:37.273458  8542 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:37.274501  8542 tablet_bootstrap.cc:492] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:37.275238  8542 ts_tablet_manager.cc:1403] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.009s
I20260709 13:04:37.278308  8542 raft_consensus.cc:359] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:37.279002  8542 raft_consensus.cc:740] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.279688  8542 consensus_queue.cc:260] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:37.287381  8542 ts_tablet_manager.cc:1434] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:04:37.298909  8542 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap starting.
I20260709 13:04:37.341058  8542 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:37.342201  8542 tablet_bootstrap.cc:492] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Bootstrap complete.
I20260709 13:04:37.342931  8542 ts_tablet_manager.cc:1403] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.015s
I20260709 13:04:37.346052  8542 raft_consensus.cc:359] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:37.346818  8542 raft_consensus.cc:740] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Initialized, Role: FOLLOWER
I20260709 13:04:37.347695  8542 consensus_queue.cc:260] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:37.350534  8542 ts_tablet_manager.cc:1434] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 13:04:37.458062  8634 raft_consensus.cc:3060] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:37.511416  8636 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:37.537544  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 64082.7us
W20260709 13:04:38.104251  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 58336.8us
W20260709 13:04:39.633378  7859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 91347.4us
W20260709 13:04:39.635641  7861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:44219, user_credentials={real_user=slave}} blocked reactor thread for 93476.9us
I20260709 13:04:45.242689   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:45.308928  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f531d2e532f4a488a87413159704294"
dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
mode: GRACEFUL
new_leader_uuid: "7873a3a04f1f4097ac2435c017ca346a"
 from {username='slave'} at 127.0.0.1:57212
I20260709 13:04:45.309906  7746 raft_consensus.cc:606] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Received request to transfer leadership to TS 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:45.313622  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071"
dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:57212
I20260709 13:04:45.314369  7746 raft_consensus.cc:606] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:45.317721  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab"
dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:57212
I20260709 13:04:45.318599  7746 raft_consensus.cc:606] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:45.347662  7891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:45.348327  7891 raft_consensus.cc:606] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:45.355924  7746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fce1a8da8e024329904347c281ae405a"
dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:57212
I20260709 13:04:45.357807  7746 raft_consensus.cc:606] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:45.359244   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:45.364933   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:45.532234  8780 raft_consensus.cc:993] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:45.533068  8772 raft_consensus.cc:1081] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:45.535341  8645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37208
I20260709 13:04:45.536088  8645 raft_consensus.cc:493] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.536661  8645 raft_consensus.cc:3060] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.547930  8645 raft_consensus.cc:515] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.550776  8645 leader_election.cc:290] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:45.551918  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:45.552948  7746 raft_consensus.cc:3055] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.553107  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82f41c2981eb4e27bb7a90979e8ef071" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:45.553341  7746 raft_consensus.cc:740] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:45.554018  7818 raft_consensus.cc:3060] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.554674  7746 consensus_queue.cc:260] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.556470  7746 raft_consensus.cc:3060] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.574482  7818 raft_consensus.cc:2468] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:45.577620  8534 leader_election.cc:304] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:45.582006  7746 raft_consensus.cc:2468] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:45.586372  8789 raft_consensus.cc:2804] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.587942  8789 raft_consensus.cc:697] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:45.589126  8789 consensus_queue.cc:237] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.602083  7568 catalog_manager.cc:5697] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.651669  8788 raft_consensus.cc:993] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:45.652325  8788 raft_consensus.cc:1081] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:45.654347  8636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37366
I20260709 13:04:45.655082  8636 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.655417  8636 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.663730  8636 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:45.665565  8636 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 3 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:45.666712  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:45.666730  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc8445b7cffa4e0886197daf4d7f765e" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:45.667546  7746 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.667695  7891 raft_consensus.cc:3055] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:45.668260  7891 raft_consensus.cc:740] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:45.669229  7891 consensus_queue.cc:260] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:45.670914  7891 raft_consensus.cc:3060] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.673789  7746 raft_consensus.cc:2468] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 3.
I20260709 13:04:45.675310  8532 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:45.676220  8789 raft_consensus.cc:2804] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:45.676787  8789 raft_consensus.cc:697] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:45.677757  8789 consensus_queue.cc:237] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:45.679296  7891 raft_consensus.cc:2468] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 3.
I20260709 13:04:45.693491  7568 catalog_manager.cc:5697] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 2 to 3, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.713464  8781 raft_consensus.cc:993] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:45.714083  8781 raft_consensus.cc:1081] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:45.715867  8636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fce1a8da8e024329904347c281ae405a"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37208
I20260709 13:04:45.716452  8636 raft_consensus.cc:493] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.716758  8636 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.721657  8636 raft_consensus.cc:515] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.723798  8636 leader_election.cc:290] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 3 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:45.724267  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:45.724455  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fce1a8da8e024329904347c281ae405a" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:45.725327  7746 raft_consensus.cc:3055] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:45.725381  7818 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.725903  7746 raft_consensus.cc:740] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:45.726897  7746 consensus_queue.cc:260] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.728178  7746 raft_consensus.cc:3060] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:45.730803  7818 raft_consensus.cc:2468] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 3.
I20260709 13:04:45.731956  8534 leader_election.cc:304] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:45.732795  8789 raft_consensus.cc:2804] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:45.733239  8789 raft_consensus.cc:697] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:45.733914  7746 raft_consensus.cc:2468] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 3.
I20260709 13:04:45.734308  8789 consensus_queue.cc:237] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.752755  7568 catalog_manager.cc:5697] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 2 to 3, leader changed from 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.789770  8772 raft_consensus.cc:993] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:45.790620  8781 raft_consensus.cc:1081] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:45.792400  8636 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37208
I20260709 13:04:45.792979  8636 raft_consensus.cc:493] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.793318  8636 raft_consensus.cc:3060] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.799609  8636 raft_consensus.cc:515] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.801412  8636 leader_election.cc:290] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:45.802125  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:45.802779  7746 raft_consensus.cc:3055] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.803064  7746 raft_consensus.cc:740] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:45.803803  7746 consensus_queue.cc:260] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.804754  7746 raft_consensus.cc:3060] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.809574  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6fb13ccbedb42ada1f3add822434eab" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:45.810746  7818 raft_consensus.cc:3060] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.816982  7746 raft_consensus.cc:2468] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:45.818264  8532 leader_election.cc:304] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:45.819260  8789 raft_consensus.cc:2804] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.819782  8789 raft_consensus.cc:697] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:45.820736  8789 consensus_queue.cc:237] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:45.820983  7818 raft_consensus.cc:2468] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:45.832372  7568 catalog_manager.cc:5697] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:45.845953  8772 raft_consensus.cc:993] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47: : Instructing follower 7873a3a04f1f4097ac2435c017ca346a to start an election
I20260709 13:04:45.846557  8781 raft_consensus.cc:1081] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Signalling peer 7873a3a04f1f4097ac2435c017ca346a to start an election
I20260709 13:04:45.848964  7818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f531d2e532f4a488a87413159704294"
dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
 from {username='slave'} at 127.0.0.1:44022
I20260709 13:04:45.849745  7818 raft_consensus.cc:493] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:45.850170  7818 raft_consensus.cc:3060] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.858047  7818 raft_consensus.cc:515] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:45.860105  7818 leader_election.cc:290] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:45.860951  7746 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f531d2e532f4a488a87413159704294" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:45.861192  7891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f531d2e532f4a488a87413159704294" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:45.861707  7746 raft_consensus.cc:3055] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:45.861958  7891 raft_consensus.cc:3060] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.862108  7746 raft_consensus.cc:740] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:45.863296  7746 consensus_queue.cc:260] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:45.865527  7746 raft_consensus.cc:3060] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:45.868732  7891 raft_consensus.cc:2468] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:45.870452  7784 leader_election.cc:304] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:45.871534  8785 raft_consensus.cc:2804] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:45.871984  8785 raft_consensus.cc:697] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:45.872867  8785 consensus_queue.cc:237] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:45.873366  7746 raft_consensus.cc:2468] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:45.884578  7568 catalog_manager.cc:5697] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 1 to 2, leader changed from 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194) to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.028770  7746 raft_consensus.cc:1275] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.030907  8789 consensus_queue.cc:1048] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:46.049479  7818 raft_consensus.cc:1275] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.051270  8790 consensus_queue.cc:1048] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:46.082278  7891 raft_consensus.cc:1275] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.083825  8790 consensus_queue.cc:1048] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:46.100452  7746 raft_consensus.cc:1275] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.104193  8789 consensus_queue.cc:1048] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:04:46.208639  7818 raft_consensus.cc:1275] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.210767  8807 consensus_queue.cc:1048] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:46.218422  7744 raft_consensus.cc:1275] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.220999  8789 consensus_queue.cc:1048] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.239142  7818 raft_consensus.cc:1275] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:46.240825  8790 consensus_queue.cc:1048] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.241219  7744 raft_consensus.cc:1275] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.249120  8789 consensus_queue.cc:1048] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:46.269758  7891 raft_consensus.cc:1275] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.272074  8785 consensus_queue.cc:1048] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:46.292784  7744 raft_consensus.cc:1275] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:46.296417  8775 consensus_queue.cc:1048] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:46.370096   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.470769   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.789670  7893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:46.790445  7893 raft_consensus.cc:606] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:46.796334  7893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:46.797013  7893 raft_consensus.cc:606] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:46.807264  7893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:46.808077  7893 raft_consensus.cc:606] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:46.817314  7889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "7873a3a04f1f4097ac2435c017ca346a"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:46.817950  7889 raft_consensus.cc:606] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Received request to transfer leadership to TS 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:46.825155  7889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:46.825901  7889 raft_consensus.cc:606] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:46.827522   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:46.832479  8788 raft_consensus.cc:993] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 7873a3a04f1f4097ac2435c017ca346a to start an election
I20260709 13:04:46.833114  8788 raft_consensus.cc:1081] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Signalling peer 7873a3a04f1f4097ac2435c017ca346a to start an election
I20260709 13:04:46.835008  7816 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6"
dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
 from {username='slave'} at 127.0.0.1:44046
I20260709 13:04:46.835638  7816 raft_consensus.cc:493] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.836217  7816 raft_consensus.cc:3060] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.838176   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:46.844007  7816 raft_consensus.cc:515] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:46.846978  7816 leader_election.cc:290] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:46.848214  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:46.849090  7743 raft_consensus.cc:3060] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.854952  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dca217a028ce41ac86f47980a41103f6" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:46.855710  7889 raft_consensus.cc:3055] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:46.856020  7889 raft_consensus.cc:740] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:46.856937  7889 consensus_queue.cc:260] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:46.858332  7889 raft_consensus.cc:3060] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.872480  7743 raft_consensus.cc:2468] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:46.874294  7785 leader_election.cc:304] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:46.875556  8822 raft_consensus.cc:2804] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.876121  8822 raft_consensus.cc:697] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:46.877111  7889 raft_consensus.cc:2468] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:46.878291  8817 raft_consensus.cc:993] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:46.879061  8817 raft_consensus.cc:1081] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:46.877141  8822 consensus_queue.cc:237] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:46.881069  8645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37366
I20260709 13:04:46.881709  8645 raft_consensus.cc:493] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.882133  8645 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.891484  8645 raft_consensus.cc:515] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:46.894330  8645 leader_election.cc:290] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 3 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:46.894484  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:46.894789  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "598a30719fa04ef1b9c9486bacdf0e39" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:46.895263  7744 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.895299  7889 raft_consensus.cc:3055] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:46.895843  7889 raft_consensus.cc:740] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:46.895023  7569 catalog_manager.cc:5697] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 1 to 2, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.896636  7889 consensus_queue.cc:260] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:46.897791  7889 raft_consensus.cc:3060] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:46.903128  7744 raft_consensus.cc:2468] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 3.
I20260709 13:04:46.906174  8532 leader_election.cc:304] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:46.907809  8827 raft_consensus.cc:2804] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:46.908512  8827 raft_consensus.cc:697] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:46.909643  8827 consensus_queue.cc:237] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:46.917718  7889 raft_consensus.cc:2468] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 3.
I20260709 13:04:46.937079  7569 catalog_manager.cc:5697] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 2 to 3, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.999626  8764 raft_consensus.cc:993] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:47.000168  8817 raft_consensus.cc:1081] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:47.002749  8646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37366
I20260709 13:04:47.003582  8646 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.004585  8646 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.014581  8646 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:47.017145  8646 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 3 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:47.018006  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:47.018724  7744 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.026608  7744 raft_consensus.cc:2468] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 3.
I20260709 13:04:47.028218  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff75938660e94825aaa4dc33fe595037" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:47.028748  8532 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:47.028945  7889 raft_consensus.cc:3055] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:47.029422  7889 raft_consensus.cc:740] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:47.030145  8827 raft_consensus.cc:2804] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:47.030359  7889 consensus_queue.cc:260] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:47.030862  8827 raft_consensus.cc:697] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:47.031926  7889 raft_consensus.cc:3060] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:47.039943  7889 raft_consensus.cc:2468] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 3.
I20260709 13:04:47.031980  8827 consensus_queue.cc:237] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:47.051605  7569 catalog_manager.cc:5697] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 2 to 3, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 3 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.148162  8817 raft_consensus.cc:993] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:47.148721  8764 raft_consensus.cc:1081] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:47.150363  8645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37366
I20260709 13:04:47.150965  8645 raft_consensus.cc:493] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.151249  8645 raft_consensus.cc:3060] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.155932  8645 raft_consensus.cc:515] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:47.158031  8645 leader_election.cc:290] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:47.158519  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:47.158605  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dfb59fc67914cce94336c08b2fa4e19" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:47.159209  7818 raft_consensus.cc:3060] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.159408  7889 raft_consensus.cc:3055] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.159745  7889 raft_consensus.cc:740] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:47.160457  7889 consensus_queue.cc:260] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:47.161455  7889 raft_consensus.cc:3060] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.165139  7818 raft_consensus.cc:2468] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:47.166426  8534 leader_election.cc:304] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:47.167402  8827 raft_consensus.cc:2804] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:47.168139  8827 raft_consensus.cc:697] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:47.169699  7889 raft_consensus.cc:2468] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:47.170249  8827 consensus_queue.cc:237] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:47.186858  7569 catalog_manager.cc:5697] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.263862  8764 raft_consensus.cc:993] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:47.264410  8817 raft_consensus.cc:1081] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:47.265875  8645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37366
I20260709 13:04:47.266433  8645 raft_consensus.cc:493] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.266721  8645 raft_consensus.cc:3060] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.272943  8645 raft_consensus.cc:515] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:47.274808  8645 leader_election.cc:290] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:47.275578  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:47.275856  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:47.276217  7818 raft_consensus.cc:3060] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.276582  7889 raft_consensus.cc:3055] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.276868  7889 raft_consensus.cc:740] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:47.277552  7889 consensus_queue.cc:260] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:47.278882  7889 raft_consensus.cc:3060] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.283915  7818 raft_consensus.cc:2468] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:47.285250  8534 leader_election.cc:304] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:47.285990  8827 raft_consensus.cc:2804] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:47.286455  8827 raft_consensus.cc:697] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:47.287740  8827 consensus_queue.cc:237] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:47.288537  7889 raft_consensus.cc:2468] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:47.300777  7569 catalog_manager.cc:5697] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:47.311474  7744 raft_consensus.cc:1275] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:47.313534  8827 consensus_queue.cc:1048] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:47.324878  7889 raft_consensus.cc:1275] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:47.326699  8812 consensus_queue.cc:1048] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:47.395533  7743 raft_consensus.cc:1275] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.397107  8822 consensus_queue.cc:1048] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.408751  7889 raft_consensus.cc:1275] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.411038  8822 consensus_queue.cc:1048] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:47.561913  7842 debug-util.cc:398] Leaking SignalData structure 0x7b08000d3960 after lost signal to thread 434
W20260709 13:04:47.563105  7842 debug-util.cc:398] Leaking SignalData structure 0x7b08001d41a0 after lost signal to thread 7604
W20260709 13:04:47.564538  7842 debug-util.cc:398] Leaking SignalData structure 0x7b0800275ec0 after lost signal to thread 7771
W20260709 13:04:47.565757  7842 debug-util.cc:398] Leaking SignalData structure 0x7b08000da440 after lost signal to thread 7845
W20260709 13:04:47.567021  7842 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8120 after lost signal to thread 7919
W20260709 13:04:47.568799  7842 debug-util.cc:398] Leaking SignalData structure 0x7b08003179a0 after lost signal to thread 8682
I20260709 13:04:47.592721  7743 raft_consensus.cc:1275] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:47.598562  8789 consensus_queue.cc:1048] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:47.617219  7889 raft_consensus.cc:1275] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:47.620445  8827 consensus_queue.cc:1048] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:47.639274  7893 raft_consensus.cc:1275] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.641657  8789 consensus_queue.cc:1048] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:47.647037  7813 raft_consensus.cc:1275] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.652915  8827 consensus_queue.cc:1048] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:47.831573  7889 raft_consensus.cc:1275] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.833141  8807 consensus_queue.cc:1048] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.841288   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:47.884021  7813 raft_consensus.cc:1275] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:47.888420  8812 consensus_queue.cc:1048] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:47.920881   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:48.027010  7893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "7873a3a04f1f4097ac2435c017ca346a"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:48.027710  7893 raft_consensus.cc:606] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Received request to transfer leadership to TS 7873a3a04f1f4097ac2435c017ca346a
W20260709 13:04:48.030377  7712 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 49622.5us
W20260709 13:04:48.030465  8854 log.cc:927] Time spent T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:04:48.032263  7893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:48.034586  7893 raft_consensus.cc:606] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:48.051270  7893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:48.052001  7893 raft_consensus.cc:606] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Received request to transfer leadership to TS 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:48.062395  7889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b2bd913427444e4a532f350222d496d"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:48.063221  7889 raft_consensus.cc:606] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:48.066777  8764 raft_consensus.cc:993] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 146ed2d5dab84c27a16d479f2aa5eb47 to start an election
I20260709 13:04:48.068097  8764 raft_consensus.cc:1081] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Signalling peer 146ed2d5dab84c27a16d479f2aa5eb47 to start an election
I20260709 13:04:48.069412  7889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:48.070290  7889 raft_consensus.cc:606] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Received request to transfer leadership to TS 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:48.072854   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:48.075165   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:48.083441  7744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8"
dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
 from {username='slave'} at 127.0.0.1:57312
I20260709 13:04:48.084438  7744 raft_consensus.cc:493] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.084843  7744 raft_consensus.cc:3060] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.102836  7744 raft_consensus.cc:515] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.106539  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:48.106833  7744 leader_election.cc:290] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:48.107290  7813 raft_consensus.cc:3060] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.109465  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7985bf73aa8b418389701bac6f2257f8" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:48.110478  7893 raft_consensus.cc:3055] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.110888  7893 raft_consensus.cc:740] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:48.112330  7893 consensus_queue.cc:260] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.113978  7893 raft_consensus.cc:3060] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.116022  7813 raft_consensus.cc:2468] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 2.
I20260709 13:04:48.117532  7713 leader_election.cc:304] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:48.118223  8772 raft_consensus.cc:2804] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.118640  8772 raft_consensus.cc:697] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:48.119451  8772 consensus_queue.cc:237] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.137568  7893 raft_consensus.cc:2468] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 2.
I20260709 13:04:48.139734  8858 raft_consensus.cc:993] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 146ed2d5dab84c27a16d479f2aa5eb47 to start an election
I20260709 13:04:48.140630  8845 raft_consensus.cc:1081] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Signalling peer 146ed2d5dab84c27a16d479f2aa5eb47 to start an election
I20260709 13:04:48.145037  7744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708"
dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
 from {username='slave'} at 127.0.0.1:57312
I20260709 13:04:48.145687  7744 raft_consensus.cc:493] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.146059  7744 raft_consensus.cc:3060] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.158018  7568 catalog_manager.cc:5697] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 1 to 2, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.161727  8858 raft_consensus.cc:993] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:48.162618  8845 raft_consensus.cc:1081] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:48.166149  8645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b2bd913427444e4a532f350222d496d"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37366
I20260709 13:04:48.166695  8645 raft_consensus.cc:493] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.167030  8645 raft_consensus.cc:3060] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.167603  7744 raft_consensus.cc:515] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.172107  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:48.174816  7813 raft_consensus.cc:3060] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.179550  8645 raft_consensus.cc:515] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:48.180125  7744 leader_election.cc:290] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:48.181255  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c67ee10cce2a4cf68ce49c4c20fcd708" candidate_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:48.182883  7893 raft_consensus.cc:3055] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.183015  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:48.183218  7893 raft_consensus.cc:740] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:48.183569  7889 raft_consensus.cc:3055] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.183946  7889 raft_consensus.cc:740] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:48.184136  7893 consensus_queue.cc:260] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.184638  7889 consensus_queue.cc:260] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:48.185257  7893 raft_consensus.cc:3060] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.185662  7889 raft_consensus.cc:3060] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.181886  8645 leader_election.cc:290] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:48.182102  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:48.191964  7818 raft_consensus.cc:3060] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.193656  7889 raft_consensus.cc:2468] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:48.195185  8531 leader_election.cc:304] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:48.195940  8789 raft_consensus.cc:2804] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.196481  8789 raft_consensus.cc:697] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:48.197438  8789 consensus_queue.cc:237] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:48.207726  7813 raft_consensus.cc:2468] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 2.
I20260709 13:04:48.213864  7713 leader_election.cc:304] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:48.211100  7818 raft_consensus.cc:2468] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:48.215818  8772 raft_consensus.cc:2804] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.216449  8772 raft_consensus.cc:697] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Becoming Leader. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:48.217262  8772 consensus_queue.cc:237] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.222112  7893 raft_consensus.cc:2468] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 146ed2d5dab84c27a16d479f2aa5eb47 in term 2.
I20260709 13:04:48.232944  7569 catalog_manager.cc:5697] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.251691  7569 catalog_manager.cc:5697] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 reported cstate change: term changed from 1 to 2, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.274901  8845 raft_consensus.cc:993] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 7873a3a04f1f4097ac2435c017ca346a to start an election
I20260709 13:04:48.275429  8845 raft_consensus.cc:1081] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Signalling peer 7873a3a04f1f4097ac2435c017ca346a to start an election
I20260709 13:04:48.277488  7813 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc"
dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
 from {username='slave'} at 127.0.0.1:44046
I20260709 13:04:48.278241  7813 raft_consensus.cc:493] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.278649  7813 raft_consensus.cc:3060] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.288079  7813 raft_consensus.cc:515] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.290652  7813 leader_election.cc:290] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:48.291220  7743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:48.291966  7743 raft_consensus.cc:3060] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.292019  7889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68d8efcb62f44723b004455b1a44abbc" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:48.292694  7889 raft_consensus.cc:3055] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:48.293037  7889 raft_consensus.cc:740] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:48.293838  7889 consensus_queue.cc:260] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.295039  7889 raft_consensus.cc:3060] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.299084  7743 raft_consensus.cc:2468] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:48.300648  7785 leader_election.cc:304] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:48.301537  8852 raft_consensus.cc:2804] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.302105  8852 raft_consensus.cc:697] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:48.303013  8852 consensus_queue.cc:237] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:48.307288  7889 raft_consensus.cc:2468] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 2.
I20260709 13:04:48.321437  7569 catalog_manager.cc:5697] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a reported cstate change: term changed from 1 to 2, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7873a3a04f1f4097ac2435c017ca346a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.505017  8858 raft_consensus.cc:993] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:48.505610  8817 raft_consensus.cc:1081] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:48.507438  8646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37366
I20260709 13:04:48.508544  8646 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:48.508996  8646 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.518972  8646 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:48.522769  8646 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 4 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:48.523022  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:48.523900  7893 raft_consensus.cc:3055] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:48.527792  7893 raft_consensus.cc:740] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:48.528649  7893 consensus_queue.cc:260] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:48.530031  7893 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.534219  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:48.534946  7813 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:48.541050  7893 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 4.
I20260709 13:04:48.542339  8531 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:48.543144  8789 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:48.543617  8789 raft_consensus.cc:697] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 4 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:48.544704  8789 consensus_queue.cc:237] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:48.547448  7813 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 4.
I20260709 13:04:48.560663  7569 catalog_manager.cc:5697] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 3 to 4, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 4 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.605238  7889 raft_consensus.cc:1275] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.606724  8789 consensus_queue.cc:1048] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.643527  7889 raft_consensus.cc:1275] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 146ed2d5dab84c27a16d479f2aa5eb47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.647696  8772 consensus_queue.cc:1048] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.651504  7813 raft_consensus.cc:1275] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.659127  7818 raft_consensus.cc:1275] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 146ed2d5dab84c27a16d479f2aa5eb47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.661285  8772 consensus_queue.cc:1048] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.665627  8807 consensus_queue.cc:1048] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:48.668210  7786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 51064.3us
I20260709 13:04:48.730150  7889 raft_consensus.cc:1275] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.738111  8868 consensus_queue.cc:1048] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:48.762605  7893 raft_consensus.cc:1275] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 146ed2d5dab84c27a16d479f2aa5eb47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.769366  8857 consensus_queue.cc:1048] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:48.788355  7744 raft_consensus.cc:1275] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 7873a3a04f1f4097ac2435c017ca346a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.792516  8852 consensus_queue.cc:1048] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.806054  7816 raft_consensus.cc:1275] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 146ed2d5dab84c27a16d479f2aa5eb47: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:48.808939  8857 consensus_queue.cc:1048] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.047549  7813 raft_consensus.cc:1275] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 4 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:49.049813  8807 consensus_queue.cc:1048] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:49.077157   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:49.090369  7893 raft_consensus.cc:1275] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 4 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:49.096604  8812 consensus_queue.cc:1048] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:49.234359   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:49.306133  7818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54d5fb6202ad4fb1b17b5bd822d19b47"
dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:38236
I20260709 13:04:49.306841  7818 raft_consensus.cc:606] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:49.310909  7893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62"
dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:04:49.311667  7893 raft_consensus.cc:606] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:49.315689  7744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c"
dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:57212
I20260709 13:04:49.316329  7744 raft_consensus.cc:606] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:49.322031  7744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3"
dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
mode: GRACEFUL
new_leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:57212
I20260709 13:04:49.322916  7744 raft_consensus.cc:606] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Received request to transfer leadership to TS 04f00c3bcb1e4bf59b3b88a72e0751cd
I20260709 13:04:49.327102   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:49.329351   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:49.367168  8858 raft_consensus.cc:993] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:49.367905  8817 raft_consensus.cc:1081] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:49.369724  8645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37366
I20260709 13:04:49.370247  8645 raft_consensus.cc:493] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.370563  8645 raft_consensus.cc:3060] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.375383  8645 raft_consensus.cc:515] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:49.378605  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:49.381798  7744 raft_consensus.cc:3060] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.379285  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82d30e47b0db4941b31196032e1bbe62" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:49.382678  7893 raft_consensus.cc:3055] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.383109  7893 raft_consensus.cc:740] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cc40c50d1f1e4a7eb98877bf59aaf75d, State: Running, Role: LEADER
I20260709 13:04:49.378957  8645 leader_election.cc:290] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:49.387068  7893 consensus_queue.cc:260] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:49.389503  7893 raft_consensus.cc:3060] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.402946  7744 raft_consensus.cc:2468] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:49.404374  8532 leader_election.cc:304] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47; no voters: 
I20260709 13:04:49.405557  8789 raft_consensus.cc:2804] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.406023  8789 raft_consensus.cc:697] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:49.406934  8789 consensus_queue.cc:237] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:49.424474  7893 raft_consensus.cc:2468] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:49.434163  7569 catalog_manager.cc:5697] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.476369  8852 raft_consensus.cc:993] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:49.476944  8852 raft_consensus.cc:1081] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:49.484912  8634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54d5fb6202ad4fb1b17b5bd822d19b47"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37220
I20260709 13:04:49.485672  8634 raft_consensus.cc:493] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.486143  8634 raft_consensus.cc:3060] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.497641  8634 raft_consensus.cc:515] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:49.500447  8634 leader_election.cc:290] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377)
I20260709 13:04:49.500874  7818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d5fb6202ad4fb1b17b5bd822d19b47" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:49.501648  7818 raft_consensus.cc:3055] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.502027  7818 raft_consensus.cc:740] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:49.502893  7818 consensus_queue.cc:260] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:49.501664  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54d5fb6202ad4fb1b17b5bd822d19b47" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:49.505162  7893 raft_consensus.cc:3060] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.504330  7818 raft_consensus.cc:3060] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.521050  7893 raft_consensus.cc:2468] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:49.521826  7818 raft_consensus.cc:2468] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:49.522694  8531 leader_election.cc:304] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:49.523936  8789 raft_consensus.cc:2804] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.524457  8789 raft_consensus.cc:697] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:49.525378  8789 consensus_queue.cc:237] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:49.527482  8889 raft_consensus.cc:993] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:49.528123  8889 raft_consensus.cc:1081] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:49.531648  8645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37208
I20260709 13:04:49.532759  8645 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.533140  8645 raft_consensus.cc:3060] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.543931  8645 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:49.547996  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:49.548858  7893 raft_consensus.cc:3060] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.549399  8645 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:49.550769  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e898dd859544a1ebf030fc90a64701c" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:49.551734  7744 raft_consensus.cc:3055] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.552182  7744 raft_consensus.cc:740] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:49.553247  7744 consensus_queue.cc:260] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:49.556478  7744 raft_consensus.cc:3060] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.555877  7893 raft_consensus.cc:2468] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:49.562374  8531 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:49.565310  8789 raft_consensus.cc:2804] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.566031  8789 raft_consensus.cc:697] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:49.567428  8789 consensus_queue.cc:237] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:49.577263  7744 raft_consensus.cc:2468] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:49.569751  7569 catalog_manager.cc:5697] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.612310  7569 catalog_manager.cc:5697] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.646603  8889 raft_consensus.cc:993] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47: : Instructing follower 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:49.647208  8889 raft_consensus.cc:1081] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Signalling peer 04f00c3bcb1e4bf59b3b88a72e0751cd to start an election
I20260709 13:04:49.649312  8634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3"
dest_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd"
 from {username='slave'} at 127.0.0.1:37208
I20260709 13:04:49.650030  8634 raft_consensus.cc:493] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.650364  8634 raft_consensus.cc:3060] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.660812  8634 raft_consensus.cc:515] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:49.663208  8634 leader_election.cc:290] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Requested vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:49.664211  7744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "146ed2d5dab84c27a16d479f2aa5eb47"
I20260709 13:04:49.664994  7744 raft_consensus.cc:3055] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.665326  7744 raft_consensus.cc:740] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 146ed2d5dab84c27a16d479f2aa5eb47, State: Running, Role: LEADER
I20260709 13:04:49.666179  7744 consensus_queue.cc:260] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:49.665753  7813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db9df6f7183e4b2eb63befcccb8c2fa3" candidate_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7873a3a04f1f4097ac2435c017ca346a"
I20260709 13:04:49.667528  7813 raft_consensus.cc:3060] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.667750  7744 raft_consensus.cc:3060] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.675981  7813 raft_consensus.cc:2468] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:49.676807  7744 raft_consensus.cc:2468] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04f00c3bcb1e4bf59b3b88a72e0751cd in term 2.
I20260709 13:04:49.677379  8534 leader_election.cc:304] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a; no voters: 
I20260709 13:04:49.678610  8807 raft_consensus.cc:2804] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.679183  8807 raft_consensus.cc:697] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Becoming Leader. State: Replica: 04f00c3bcb1e4bf59b3b88a72e0751cd, State: Running, Role: LEADER
I20260709 13:04:49.680182  8807 consensus_queue.cc:237] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:49.694495  7569 catalog_manager.cc:5697] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd reported cstate change: term changed from 1 to 2, leader changed from 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194) to 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193). New cstate: current_term: 2 leader_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.808159  7742 raft_consensus.cc:1275] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.810009  8807 consensus_queue.cc:1048] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.811380  7893 raft_consensus.cc:1275] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.812949  8807 consensus_queue.cc:1048] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:49.992266  7893 raft_consensus.cc:1275] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.992708  7813 raft_consensus.cc:1275] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.993928  8807 consensus_queue.cc:1048] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.994316  8812 consensus_queue.cc:1048] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.017635  7742 raft_consensus.cc:1275] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.039788  8789 consensus_queue.cc:1048] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:04:50.080314  7893 raft_consensus.cc:1275] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:50.100975  8532 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:43589, user_credentials={real_user=slave}} blocked reactor thread for 71404.2us
W20260709 13:04:50.145466  8531 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:38377, user_credentials={real_user=slave}} blocked reactor thread for 115287us
I20260709 13:04:50.149504  8904 consensus_queue.cc:1048] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:50.201287  7744 raft_consensus.cc:1275] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.203055  8812 consensus_queue.cc:1048] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.211867  7818 raft_consensus.cc:1275] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Refusing update from remote peer 04f00c3bcb1e4bf59b3b88a72e0751cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.216634  8812 consensus_queue.cc:1048] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:50.330483   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:50.384965   431 tablet_server.cc:179] TabletServer@127.0.107.193:39365 shutting down...
W20260709 13:04:50.399473  7786 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 85 similar messages]
W20260709 13:04:50.416616  7712 consensus_peers.cc:597] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.432801  7860 consensus_peers.cc:597] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.450340  7786 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:39365, user_credentials={real_user=slave}} blocked reactor thread for 50889.8us
W20260709 13:04:50.458352  7786 consensus_peers.cc:597] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.465422   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:04:50.467535  7712 consensus_peers.cc:597] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.468474   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:50.468539  7712 consensus_peers.cc:597] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.469882   431 raft_consensus.cc:2243] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.470678   431 raft_consensus.cc:2272] T ffc78460a31e44259913b287fcc501a6 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.472785  7860 consensus_peers.cc:597] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.474375   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.476054   431 raft_consensus.cc:2243] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.476743   431 raft_consensus.cc:2272] T f5a5ed5a8b8146bba4818317966c6707 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.475695  7860 consensus_peers.cc:597] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.479206  7712 consensus_peers.cc:597] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.480616   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.481853   431 raft_consensus.cc:2243] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.482963   431 raft_consensus.cc:2272] T 82d30e47b0db4941b31196032e1bbe62 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.489194   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.490312   431 raft_consensus.cc:2243] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.491516   431 raft_consensus.cc:2272] T e96bceeac5554814ab33aee056d166c2 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.495376   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.496769   431 raft_consensus.cc:2243] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.497398   431 raft_consensus.cc:2272] T c5d149138d084c9db0b0266c1877f04f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.500938   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.501767   431 raft_consensus.cc:2243] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.502928   431 raft_consensus.cc:2272] T 1dfb59fc67914cce94336c08b2fa4e19 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.505992  7712 consensus_peers.cc:597] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.506987  7786 consensus_peers.cc:597] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.509145   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.510736   431 raft_consensus.cc:2243] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.511430   431 raft_consensus.cc:2272] T 9c4c4442b3ae45928f37714c97e92bbd P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.515455   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.518373   431 raft_consensus.cc:2243] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.519068   431 raft_consensus.cc:2272] T c5e8e2d38d164dcfbef72067d4328f65 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.523209   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.524181   431 raft_consensus.cc:2243] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:50.524595  7860 consensus_peers.cc:597] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.524873   431 raft_consensus.cc:2272] T bc39bf2ad6844beb8466b427508830f9 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.527915   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.528720   431 raft_consensus.cc:2243] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.529253   431 raft_consensus.cc:2272] T 4acc87afffa74c29bd1e7e9d5d3c207e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.532622   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.533818   431 raft_consensus.cc:2243] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.534454   431 raft_consensus.cc:2272] T 00461ff939684b6fb3967bed0ebf0cd7 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.537760   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.538703   431 raft_consensus.cc:2243] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.539306   431 raft_consensus.cc:2272] T 5d0a2a6ec6a1432b9f925ef0927de924 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.542647   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:50.543452  7860 consensus_peers.cc:597] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.543613   431 raft_consensus.cc:2243] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.545151   431 raft_consensus.cc:2272] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.551131   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:50.551469  7860 consensus_peers.cc:597] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.552161   431 raft_consensus.cc:2243] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.552743   431 raft_consensus.cc:2272] T a24ddd1785584baaac825181369d1331 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.555303   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.555984   431 raft_consensus.cc:2243] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.556977   431 raft_consensus.cc:2272] T 5654cc6cdd4a43588ca31774035b64ed P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.559691   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.560634   431 raft_consensus.cc:2243] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.561187   431 raft_consensus.cc:2272] T 89b785eb056a414f897653597ab2eaf1 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.563848  7712 consensus_peers.cc:597] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.564725   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.565678   431 raft_consensus.cc:2243] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.566231   431 raft_consensus.cc:2272] T bb3bf96c4c6049efa4ec3725c681de10 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.569661   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:04:50.570323  7786 consensus_peers.cc:597] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.570355   431 raft_consensus.cc:2243] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.571523   431 raft_consensus.cc:2272] T 72c94730189a4964ab34c7aefdbd813a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.574640   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.575469   431 raft_consensus.cc:2243] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.576022   431 raft_consensus.cc:2272] T cf11683974b449738775dd5a453c9b7c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.579042   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.579749   431 raft_consensus.cc:2243] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.580323   431 raft_consensus.cc:2272] T 4cf6e495d139410392594c5345bd5306 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.582859   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.583688   431 raft_consensus.cc:2243] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.584782   431 raft_consensus.cc:2272] T 598a30719fa04ef1b9c9486bacdf0e39 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.587849   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.588796   431 raft_consensus.cc:2243] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:04:50.589540  7786 consensus_peers.cc:597] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.589895   431 raft_consensus.cc:2272] T fce1a8da8e024329904347c281ae405a P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.593387   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.594362   431 raft_consensus.cc:2243] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.594928   431 raft_consensus.cc:2272] T a1d7a48d13f746369b2ee192d52214bc P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.597957   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.598852   431 raft_consensus.cc:2243] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.599815   431 raft_consensus.cc:2272] T 82f41c2981eb4e27bb7a90979e8ef071 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.602833   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.603833   431 raft_consensus.cc:2243] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.604534   431 raft_consensus.cc:2272] T 7fd80ffcb91143aeb64f882f614e0817 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.607743   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.608580   431 raft_consensus.cc:2243] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.609134   431 raft_consensus.cc:2272] T 2887a0ab539d41ecba648e3621ce28a0 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.612002   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.612926   431 raft_consensus.cc:2243] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.614020   431 raft_consensus.cc:2272] T 6ec80c3084b643f3a77a25d471dace7f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.616422   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.617159   431 raft_consensus.cc:2243] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.617592   431 raft_consensus.cc:2272] T 666216fc7a1f403992aed2103a1031ef P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.620447   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.621183   431 raft_consensus.cc:2243] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.621666   431 raft_consensus.cc:2272] T 33813684ca014951b1442b91c51b0c2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.624828   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.625598   431 raft_consensus.cc:2243] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.626217   431 raft_consensus.cc:2272] T 7d9465bf05df47b988f23dac9f545177 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.630368   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.631260   431 raft_consensus.cc:2243] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.631856   431 raft_consensus.cc:2272] T e5c6a31a382c47888fc962c7a1a27921 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.635236   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.636277   431 raft_consensus.cc:2243] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.637395   431 raft_consensus.cc:2272] T db9df6f7183e4b2eb63befcccb8c2fa3 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.641703   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.642760   431 raft_consensus.cc:2243] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.643388   431 raft_consensus.cc:2272] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.646209   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.646873   431 raft_consensus.cc:2243] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.647377   431 raft_consensus.cc:2272] T 8b6bac98b41745fab1ce373328ca0c8b P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.650236   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.650858   431 raft_consensus.cc:2243] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.651667   431 raft_consensus.cc:2272] T 9b2bd913427444e4a532f350222d496d P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.654584   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.655217   431 raft_consensus.cc:2243] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.655628   431 raft_consensus.cc:2272] T d6de6b4220944748b4c901c3f0e50bfe P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.657869   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.658493   431 raft_consensus.cc:2243] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.658989   431 raft_consensus.cc:2272] T 6b897e7d731a42678b1ecb79b5e2e468 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.662009   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.662773   431 raft_consensus.cc:2243] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.663370   431 raft_consensus.cc:2272] T bda007baac86482589feb8c8a9761337 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.666419   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.667146   431 raft_consensus.cc:2243] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.668238   431 raft_consensus.cc:2272] T a6fb13ccbedb42ada1f3add822434eab P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.671224   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.671900   431 raft_consensus.cc:2243] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.672799   431 raft_consensus.cc:2272] T cc8445b7cffa4e0886197daf4d7f765e P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.675048   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.675832   431 raft_consensus.cc:2243] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.676801   431 raft_consensus.cc:2272] T 9e898dd859544a1ebf030fc90a64701c P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.679972   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.680876   431 raft_consensus.cc:2243] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.681435   431 raft_consensus.cc:2272] T e968d46ff0984f6b958e5378d07c3d32 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.681283  7860 consensus_peers.cc:597] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.684178   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.684988   431 raft_consensus.cc:2243] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.685532   431 raft_consensus.cc:2272] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.688473   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.689162   431 raft_consensus.cc:2243] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:50.690218   431 raft_consensus.cc:2272] T ff75938660e94825aaa4dc33fe595037 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.693351   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:04:50.693994   431 raft_consensus.cc:2243] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.694518   431 raft_consensus.cc:2272] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 04f00c3bcb1e4bf59b3b88a72e0751cd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:50.719676  7860 consensus_peers.cc:597] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.769551  7712 consensus_peers.cc:597] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.771430  7786 consensus_peers.cc:597] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.775156  7712 consensus_peers.cc:597] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.776696  7860 connection.cc:769] client connection to 127.0.107.193:39365 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:04:50.787506  7860 consensus_peers.cc:597] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.788650  7860 consensus_peers.cc:597] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.799149   431 tablet_server.cc:196] TabletServer@127.0.107.193:39365 shutdown complete.
W20260709 13:04:50.817266  7786 consensus_peers.cc:597] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.838212  7860 consensus_peers.cc:597] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.877285  7860 consensus_peers.cc:597] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.895327  7712 consensus_peers.cc:597] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.900008  7786 consensus_peers.cc:597] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:50.928751   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:04:50.931768  7786 consensus_peers.cc:597] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.956367  7859 consensus_peers.cc:597] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.961529  7712 consensus_peers.cc:597] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:50.978682  7786 consensus_peers.cc:597] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.006356  7785 consensus_peers.cc:597] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.062021  7785 consensus_peers.cc:597] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.077174  7859 consensus_peers.cc:597] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.083320   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:51.085701   431 tablet_replica.cc:333] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.086563   431 raft_consensus.cc:2243] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.087461   431 raft_consensus.cc:2272] T 6b897e7d731a42678b1ecb79b5e2e468 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.092221   431 tablet_replica.cc:333] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
W20260709 13:04:51.092788  7785 consensus_peers.cc:597] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.093912   431 raft_consensus.cc:2243] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.094589   431 raft_consensus.cc:2272] T 82f41c2981eb4e27bb7a90979e8ef071 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.097587  7785 consensus_peers.cc:597] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.098078   431 tablet_replica.cc:333] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.099103   431 raft_consensus.cc:2243] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.100143   431 raft_consensus.cc:2272] T a24ddd1785584baaac825181369d1331 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.102875   431 tablet_replica.cc:333] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.103600   431 raft_consensus.cc:2243] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.104108   431 raft_consensus.cc:2272] T 9e898dd859544a1ebf030fc90a64701c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.107683   431 tablet_replica.cc:333] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.108677   431 raft_consensus.cc:2243] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.109565   431 raft_consensus.cc:2272] T 814f68057304479398b938502ddb6f05 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.112005   431 tablet_replica.cc:333] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.112922   431 raft_consensus.cc:2243] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.113571   431 raft_consensus.cc:2272] T c5e8e2d38d164dcfbef72067d4328f65 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.116693   431 tablet_replica.cc:333] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.117596   431 raft_consensus.cc:2243] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.118101   431 raft_consensus.cc:2272] T a6fb13ccbedb42ada1f3add822434eab P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.120878   431 tablet_replica.cc:333] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.121531   431 raft_consensus.cc:2243] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.122043   431 raft_consensus.cc:2272] T 0911fc9d471948a3878933bd85d9b5e9 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.124505   431 tablet_replica.cc:333] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.125118   431 raft_consensus.cc:2243] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.126001   431 raft_consensus.cc:2272] T 2887a0ab539d41ecba648e3621ce28a0 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.128118   431 tablet_replica.cc:333] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.128772   431 raft_consensus.cc:2243] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.129277   431 raft_consensus.cc:2272] T a1d7a48d13f746369b2ee192d52214bc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.132325   431 tablet_replica.cc:333] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.133234   431 raft_consensus.cc:2243] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.133793   431 raft_consensus.cc:2272] T fce1a8da8e024329904347c281ae405a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.136181   431 tablet_replica.cc:333] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.136890   431 raft_consensus.cc:2243] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.137328   431 raft_consensus.cc:2272] T 7f531d2e532f4a488a87413159704294 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.139403   431 tablet_replica.cc:333] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.140129   431 raft_consensus.cc:2243] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.140704   431 raft_consensus.cc:2272] T 0287ecd0addf408bbf1e25813f68a5df P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.142796   431 tablet_replica.cc:333] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.143396   431 raft_consensus.cc:2243] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.144444   431 raft_consensus.cc:2272] T e96bceeac5554814ab33aee056d166c2 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.146909   431 tablet_replica.cc:333] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.147495   431 raft_consensus.cc:2243] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.148449   431 raft_consensus.cc:2272] T 33813684ca014951b1442b91c51b0c2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.150761   431 tablet_replica.cc:333] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.151357   431 raft_consensus.cc:2243] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.152245   431 raft_consensus.cc:2272] T 7d9465bf05df47b988f23dac9f545177 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.154547   431 tablet_replica.cc:333] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.155177   431 raft_consensus.cc:2243] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.156240   431 raft_consensus.cc:2272] T b497b4caeba049e0bcdcef814028ecea P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.159271  7785 consensus_peers.cc:597] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.159591   431 tablet_replica.cc:333] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.160493   431 raft_consensus.cc:2243] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.161047   431 raft_consensus.cc:2272] T e5c6a31a382c47888fc962c7a1a27921 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.163841   431 tablet_replica.cc:333] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.164604   431 raft_consensus.cc:2243] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.165217   431 raft_consensus.cc:2272] T db9df6f7183e4b2eb63befcccb8c2fa3 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.169252   431 tablet_replica.cc:333] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
W20260709 13:04:51.169539  7859 consensus_peers.cc:597] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.170297   431 raft_consensus.cc:2243] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.171079   431 raft_consensus.cc:2272] T cf11683974b449738775dd5a453c9b7c P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.174808   431 tablet_replica.cc:333] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.175781   431 raft_consensus.cc:2243] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.176476   431 raft_consensus.cc:2272] T 68d8efcb62f44723b004455b1a44abbc P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.179939   431 tablet_replica.cc:333] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.181049   431 raft_consensus.cc:2243] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.182216   431 raft_consensus.cc:2272] T c67ee10cce2a4cf68ce49c4c20fcd708 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.185508   431 tablet_replica.cc:333] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.186408   431 raft_consensus.cc:2243] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.187662   431 raft_consensus.cc:2272] T 00461ff939684b6fb3967bed0ebf0cd7 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.191516   431 tablet_replica.cc:333] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
W20260709 13:04:51.192147  7785 consensus_peers.cc:597] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.192493   431 raft_consensus.cc:2243] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.193271   431 raft_consensus.cc:2272] T 89b785eb056a414f897653597ab2eaf1 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.193521  7785 consensus_peers.cc:597] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.197013   431 tablet_replica.cc:333] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.198099   431 raft_consensus.cc:2243] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:51.198499  7785 consensus_peers.cc:597] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.198733   431 raft_consensus.cc:2272] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.201813  7859 consensus_peers.cc:597] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.202212   431 tablet_replica.cc:333] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.203276   431 raft_consensus.cc:2243] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:51.203867  7785 consensus_peers.cc:597] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.203914   431 raft_consensus.cc:2272] T 7e5b29cc10794a339c482492d5fbaa75 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.207926   431 tablet_replica.cc:333] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.208904   431 raft_consensus.cc:2243] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.209548   431 raft_consensus.cc:2272] T ff75938660e94825aaa4dc33fe595037 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.212765   431 tablet_replica.cc:333] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.213677   431 raft_consensus.cc:2243] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.214303   431 raft_consensus.cc:2272] T 8b6bac98b41745fab1ce373328ca0c8b P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.216588  7785 consensus_peers.cc:597] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.217752   431 tablet_replica.cc:333] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.218650   431 raft_consensus.cc:2243] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.219942   431 raft_consensus.cc:2272] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.223699   431 tablet_replica.cc:333] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.224684   431 raft_consensus.cc:2243] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.225378   431 raft_consensus.cc:2272] T e968d46ff0984f6b958e5378d07c3d32 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.229877   431 tablet_replica.cc:333] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.230800   431 raft_consensus.cc:2243] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.231478   431 raft_consensus.cc:2272] T dca217a028ce41ac86f47980a41103f6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.235618   431 tablet_replica.cc:333] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.236601   431 raft_consensus.cc:2243] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.237773   431 raft_consensus.cc:2272] T 7985bf73aa8b418389701bac6f2257f8 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.238664  7785 consensus_peers.cc:597] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.239506  7785 consensus_peers.cc:597] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.241040   431 tablet_replica.cc:333] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.242213   431 raft_consensus.cc:2243] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.243546   431 raft_consensus.cc:2272] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.246958   431 tablet_replica.cc:333] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.249528   431 raft_consensus.cc:2243] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.250965   431 raft_consensus.cc:2272] T 78b1fb849b894694b44d527478e929ad P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.256652   431 tablet_replica.cc:333] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.257630   431 raft_consensus.cc:2243] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.258360   431 raft_consensus.cc:2272] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.265134   431 tablet_replica.cc:333] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.266083   431 raft_consensus.cc:2243] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.266768   431 raft_consensus.cc:2272] T 4f69f4370f9c45b5a22013b2937db5fb P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.269946   431 tablet_replica.cc:333] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.270927   431 raft_consensus.cc:2243] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.271545   431 raft_consensus.cc:2272] T cc8445b7cffa4e0886197daf4d7f765e P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.274770   431 tablet_replica.cc:333] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.275646   431 raft_consensus.cc:2243] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.276315   431 raft_consensus.cc:2272] T ffc78460a31e44259913b287fcc501a6 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.280939   431 tablet_replica.cc:333] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.281783   431 raft_consensus.cc:2243] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.282407   431 raft_consensus.cc:2272] T 72c94730189a4964ab34c7aefdbd813a P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.284725  7859 consensus_peers.cc:597] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.285432   431 tablet_replica.cc:333] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.286369   431 raft_consensus.cc:2243] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.287523   431 raft_consensus.cc:2272] T bb3bf96c4c6049efa4ec3725c681de10 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.296671   431 tablet_replica.cc:333] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.297513   431 raft_consensus.cc:2243] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.298122   431 raft_consensus.cc:2272] T 82d30e47b0db4941b31196032e1bbe62 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.301227   431 tablet_replica.cc:333] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.301985   431 raft_consensus.cc:2243] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:51.302178  7785 consensus_peers.cc:597] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.302616   431 raft_consensus.cc:2272] T f5a5ed5a8b8146bba4818317966c6707 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.305874   431 tablet_replica.cc:333] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.306658   431 raft_consensus.cc:2243] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.307502   431 raft_consensus.cc:2272] T 25fc0069dd6948f0979c733fd0ac5343 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.310720   431 tablet_replica.cc:333] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47: stopping tablet replica
I20260709 13:04:51.311473   431 raft_consensus.cc:2243] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.312117   431 raft_consensus.cc:2272] T 598a30719fa04ef1b9c9486bacdf0e39 P 146ed2d5dab84c27a16d479f2aa5eb47 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.351298  7859 consensus_peers.cc:597] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.361232  7859 consensus_peers.cc:597] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.520569   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:04:51.611722  8925 raft_consensus.cc:493] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.612596  8925 raft_consensus.cc:515] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.615329  8925 leader_election.cc:290] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:51.616479  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5654cc6cdd4a43588ca31774035b64ed" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:51.622042  7786 leader_election.cc:336] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.622628  7786 leader_election.cc:304] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:51.623564  8925 raft_consensus.cc:2749] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.634164   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:04:51.659885  8817 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.660701  8817 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.662043  8926 raft_consensus.cc:493] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.662672  8926 raft_consensus.cc:515] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.667945  8926 leader_election.cc:290] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:51.668159  8925 raft_consensus.cc:493] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.668902  8925 raft_consensus.cc:515] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:51.671504  8925 leader_election.cc:290] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:51.676158  7860 leader_election.cc:336] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.680181  8817 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:51.687052  7785 leader_election.cc:336] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:51.688601  8925 raft_consensus.cc:493] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.691418  8925 raft_consensus.cc:515] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:51.692731  8923 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.693440  8923 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.694626  8925 leader_election.cc:290] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:51.695564  8923 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:51.696672  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:51.700821  7786 leader_election.cc:336] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.705681  8924 raft_consensus.cc:493] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.710727  7893 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 4.
I20260709 13:04:51.710912  8924 raft_consensus.cc:515] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.713491  8924 leader_election.cc:290] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:51.714582  7784 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:51.715715  8924 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:51.716081  8924 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.716382  8924 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:51.721472  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2bd913427444e4a532f350222d496d" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" is_pre_election: true
W20260709 13:04:51.708153  7785 leader_election.cc:336] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:51.690659  7860 leader_election.cc:336] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.724180  7786 leader_election.cc:304] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:51.729300  8868 raft_consensus.cc:2749] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:51.733410  7861 leader_election.cc:336] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:51.733834  7861 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:51.737583  8926 raft_consensus.cc:2749] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:51.739297   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:51.740391   431 tablet_replica.cc:333] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
W20260709 13:04:51.741204  7861 leader_election.cc:336] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:51.741628  7861 leader_election.cc:304] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:51.741928   431 raft_consensus.cc:2243] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.742511   431 raft_consensus.cc:2272] T 7fd80ffcb91143aeb64f882f614e0817 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.742921  8817 raft_consensus.cc:2749] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.745455   431 tablet_replica.cc:333] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
W20260709 13:04:51.745600  7786 leader_election.cc:336] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.723944  8924 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.746361   431 raft_consensus.cc:2243] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.747032   431 raft_consensus.cc:2272] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.749459  7893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec80c3084b643f3a77a25d471dace7f" candidate_uuid: "7873a3a04f1f4097ac2435c017ca346a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d"
I20260709 13:04:51.749917   431 tablet_replica.cc:333] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.750041  7893 raft_consensus.cc:3060] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:51.750770   431 raft_consensus.cc:2243] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.751765   431 raft_consensus.cc:2272] T 72c94730189a4964ab34c7aefdbd813a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.754536   431 tablet_replica.cc:333] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.755331   431 raft_consensus.cc:2243] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.755820   431 raft_consensus.cc:2272] T c67ee10cce2a4cf68ce49c4c20fcd708 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.757072  7893 raft_consensus.cc:2468] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7873a3a04f1f4097ac2435c017ca346a in term 5.
I20260709 13:04:51.758857  7784 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a, cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 
I20260709 13:04:51.759675  8925 raft_consensus.cc:2804] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:51.760160  8925 raft_consensus.cc:697] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 5 LEADER]: Becoming Leader. State: Replica: 7873a3a04f1f4097ac2435c017ca346a, State: Running, Role: LEADER
I20260709 13:04:51.760339   431 tablet_replica.cc:333] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.761401   431 raft_consensus.cc:2243] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.761209  8925 consensus_queue.cc:237] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.761969   431 raft_consensus.cc:2272] T 814f68057304479398b938502ddb6f05 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.765154   431 tablet_replica.cc:333] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.766687  8924 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 5 election: Requested vote from peers cc40c50d1f1e4a7eb98877bf59aaf75d (127.0.107.196:38377), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:51.767845  8817 raft_consensus.cc:493] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.768114   431 raft_consensus.cc:2243] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.769011   431 raft_consensus.cc:2272] T 25fc0069dd6948f0979c733fd0ac5343 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.769204  8923 raft_consensus.cc:493] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.769850  8923 raft_consensus.cc:515] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:51.772373   431 tablet_replica.cc:333] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.772403  8923 leader_election.cc:290] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:51.768505  8817 raft_consensus.cc:515] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.773413   431 raft_consensus.cc:2243] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.774044   431 raft_consensus.cc:2272] T 33813684ca014951b1442b91c51b0c2f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.774914  8817 leader_election.cc:290] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:51.776765   431 tablet_replica.cc:333] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.777704   431 raft_consensus.cc:2243] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:51.778005  7785 leader_election.cc:336] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:51.778614   431 raft_consensus.cc:2272] T 7e5b29cc10794a339c482492d5fbaa75 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.760241  7786 leader_election.cc:304] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
W20260709 13:04:51.779605  7786 raft_consensus.cc:2686] T 82f41c2981eb4e27bb7a90979e8ef071 P 7873a3a04f1f4097ac2435c017ca346a: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:04:51.780373  7786 leader_election.cc:336] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:51.781205  7786 leader_election.cc:336] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.781814   431 tablet_replica.cc:333] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.782701   431 raft_consensus.cc:2243] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.783221   431 raft_consensus.cc:2272] T 54d5fb6202ad4fb1b17b5bd822d19b47 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.785929   431 tablet_replica.cc:333] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.786767   431 raft_consensus.cc:2243] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.787299   431 raft_consensus.cc:2272] T 9c4c4442b3ae45928f37714c97e92bbd P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.790561   431 tablet_replica.cc:333] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.791428   431 raft_consensus.cc:2243] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.781646  7786 leader_election.cc:304] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, cc40c50d1f1e4a7eb98877bf59aaf75d
I20260709 13:04:51.793295  8925 raft_consensus.cc:2749] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:51.797868  7861 consensus_peers.cc:597] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.798472  7861 consensus_peers.cc:597] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:51.800459  7786 leader_election.cc:336] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:51.801775  7786 leader_election.cc:336] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.802136  7786 leader_election.cc:304] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:51.803229  8925 raft_consensus.cc:2749] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.792021   431 raft_consensus.cc:2272] T 1dfb59fc67914cce94336c08b2fa4e19 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.806952   431 tablet_replica.cc:333] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.807787   431 raft_consensus.cc:2243] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.808363   431 raft_consensus.cc:2272] T a6fb13ccbedb42ada1f3add822434eab P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.808651  7860 leader_election.cc:336] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.813858   431 tablet_replica.cc:333] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.814551   431 raft_consensus.cc:2243] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.815006   431 raft_consensus.cc:2272] T 0911fc9d471948a3878933bd85d9b5e9 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.816699  7861 leader_election.cc:336] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:51.817217  7861 leader_election.cc:304] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:51.817456   431 tablet_replica.cc:333] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.818281  8913 raft_consensus.cc:2749] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.818388   431 raft_consensus.cc:2243] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:04:51.819597  7861 consensus_peers.cc:597] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.819751   431 raft_consensus.cc:2272] T c5e8e2d38d164dcfbef72067d4328f65 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.822822   431 tablet_replica.cc:333] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.823632   431 raft_consensus.cc:2243] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.824205   431 raft_consensus.cc:2272] T 9b2bd913427444e4a532f350222d496d P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.826972   431 tablet_replica.cc:333] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.827773   431 raft_consensus.cc:2243] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.828756   431 raft_consensus.cc:2272] T d6de6b4220944748b4c901c3f0e50bfe P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.831624   431 tablet_replica.cc:333] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.832517   431 raft_consensus.cc:2243] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.833114   431 raft_consensus.cc:2272] T 666216fc7a1f403992aed2103a1031ef P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.835942   431 tablet_replica.cc:333] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.836807   431 raft_consensus.cc:2243] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.837625   431 pending_rounds.cc:70] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a: Trying to abort 1 pending ops.
I20260709 13:04:51.837859   431 pending_rounds.cc:77] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a: Aborting op as it isn't in flight: id { term: 5 index: 4 } timestamp: 7305634987063562240 op_type: NO_OP noop_request { }
I20260709 13:04:51.838253   431 raft_consensus.cc:2889] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 5 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:51.838611   431 raft_consensus.cc:2272] T 6ec80c3084b643f3a77a25d471dace7f P 7873a3a04f1f4097ac2435c017ca346a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.841521   431 tablet_replica.cc:333] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.842376   431 raft_consensus.cc:2243] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.842958   431 raft_consensus.cc:2272] T 2887a0ab539d41ecba648e3621ce28a0 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.846887   431 tablet_replica.cc:333] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.847663   431 raft_consensus.cc:2243] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.848266   431 raft_consensus.cc:2272] T bda007baac86482589feb8c8a9761337 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.851150   431 tablet_replica.cc:333] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.852057   431 raft_consensus.cc:2243] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.853199   431 raft_consensus.cc:2272] T cf11683974b449738775dd5a453c9b7c P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.856376   431 tablet_replica.cc:333] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
W20260709 13:04:51.856710  7861 consensus_peers.cc:597] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.857308   431 raft_consensus.cc:2243] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.857904   431 raft_consensus.cc:2272] T 4cf6e495d139410392594c5345bd5306 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.860541   431 tablet_replica.cc:333] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.861171   431 raft_consensus.cc:2243] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.862113   431 raft_consensus.cc:2272] T 68d8efcb62f44723b004455b1a44abbc P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.864686   431 tablet_replica.cc:333] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.865545   431 raft_consensus.cc:2243] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.866667   431 raft_consensus.cc:2272] T e5c6a31a382c47888fc962c7a1a27921 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.869840   431 tablet_replica.cc:333] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.870537   431 raft_consensus.cc:2243] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.871011   431 raft_consensus.cc:2272] T b497b4caeba049e0bcdcef814028ecea P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.874065   431 tablet_replica.cc:333] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.874990   431 raft_consensus.cc:2243] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.875564   431 raft_consensus.cc:2272] T db9df6f7183e4b2eb63befcccb8c2fa3 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.877969   431 tablet_replica.cc:333] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.878695   431 raft_consensus.cc:2243] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.879161   431 raft_consensus.cc:2272] T 5654cc6cdd4a43588ca31774035b64ed P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.881377   431 tablet_replica.cc:333] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.882035   431 raft_consensus.cc:2243] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.882917   431 raft_consensus.cc:2272] T 4f69f4370f9c45b5a22013b2937db5fb P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.885150   431 tablet_replica.cc:333] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.885730   431 raft_consensus.cc:2243] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.886658  8817 raft_consensus.cc:493] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.887313  8817 raft_consensus.cc:515] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:51.889487  8817 leader_election.cc:290] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:51.891500   431 raft_consensus.cc:2272] T 89b785eb056a414f897653597ab2eaf1 P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.894761   431 tablet_replica.cc:333] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.895642   431 raft_consensus.cc:2243] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.896307   431 raft_consensus.cc:2272] T 5d0a2a6ec6a1432b9f925ef0927de924 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.899432   431 tablet_replica.cc:333] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.900216   431 raft_consensus.cc:2243] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:04:51.899464  7859 leader_election.cc:336] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:51.901469   431 raft_consensus.cc:2272] T bc39bf2ad6844beb8466b427508830f9 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.904711   431 tablet_replica.cc:333] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
W20260709 13:04:51.904799  7861 consensus_peers.cc:597] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.905632   431 raft_consensus.cc:2243] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.906260   431 raft_consensus.cc:2272] T 4acc87afffa74c29bd1e7e9d5d3c207e P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.906661  7860 leader_election.cc:336] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.907114  7860 leader_election.cc:304] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:51.907769  8913 raft_consensus.cc:2749] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.909330   431 tablet_replica.cc:333] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.910295   431 raft_consensus.cc:2243] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.910892   431 raft_consensus.cc:2272] T c3ccaa93d3a94f34a4ab6ea95c7bb67d P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.913980   431 tablet_replica.cc:333] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.914817   431 raft_consensus.cc:2243] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.915928   431 raft_consensus.cc:2272] T e968d46ff0984f6b958e5378d07c3d32 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.918983   431 tablet_replica.cc:333] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.919798   431 raft_consensus.cc:2243] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.920619   431 raft_consensus.cc:2272] T 78b1fb849b894694b44d527478e929ad P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.923501   431 tablet_replica.cc:333] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.924292  8924 raft_consensus.cc:493] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.924405   431 raft_consensus.cc:2243] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.925408   431 raft_consensus.cc:2272] T 44ed68b66f2c4a59a2e1c334ec6380a5 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.925143  8924 raft_consensus.cc:515] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } }
I20260709 13:04:51.928625   431 tablet_replica.cc:333] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.929544   431 raft_consensus.cc:2243] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.930625   431 raft_consensus.cc:2272] T dca217a028ce41ac86f47980a41103f6 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.933914   431 tablet_replica.cc:333] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.934772   431 raft_consensus.cc:2243] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.935875   431 raft_consensus.cc:2272] T 0287ecd0addf408bbf1e25813f68a5df P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.936092  7785 leader_election.cc:336] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:51.927842  8924 leader_election.cc:290] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:51.936839  7786 leader_election.cc:336] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.937404  7786 leader_election.cc:304] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7873a3a04f1f4097ac2435c017ca346a; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:51.938082  8924 raft_consensus.cc:2749] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:51.938979   431 tablet_replica.cc:333] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.939518  8927 raft_consensus.cc:493] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.939894   431 raft_consensus.cc:2243] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.940119  8927 raft_consensus.cc:515] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.940661   431 raft_consensus.cc:2272] T c5d149138d084c9db0b0266c1877f04f P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.942912  8927 leader_election.cc:290] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
I20260709 13:04:51.945108   431 tablet_replica.cc:333] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.945878   431 raft_consensus.cc:2243] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.946797   431 raft_consensus.cc:2272] T f5a5ed5a8b8146bba4818317966c6707 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.948761  7861 consensus_peers.cc:597] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.950064   431 tablet_replica.cc:333] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
I20260709 13:04:51.950857   431 raft_consensus.cc:2243] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.951345   431 raft_consensus.cc:2272] T 7985bf73aa8b418389701bac6f2257f8 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:51.953120  7861 leader_election.cc:336] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:51.954440   431 tablet_replica.cc:333] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
W20260709 13:04:51.954325  7860 leader_election.cc:336] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:51.955029  7860 leader_election.cc:304] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:51.955288   431 raft_consensus.cc:2243] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.955834  8927 raft_consensus.cc:2749] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:51.956022   431 raft_consensus.cc:2272] T 4fa1517a5fc74d25bb5d1b3fa8947cb5 P 7873a3a04f1f4097ac2435c017ca346a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.959483   431 tablet_replica.cc:333] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
W20260709 13:04:51.959353  7861 consensus_peers.cc:597] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.960412   431 raft_consensus.cc:2243] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:51.961030   431 raft_consensus.cc:2272] T fce1a8da8e024329904347c281ae405a P 7873a3a04f1f4097ac2435c017ca346a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.963775   431 tablet_replica.cc:333] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a: stopping tablet replica
W20260709 13:04:51.963912  7861 consensus_peers.cc:597] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:51.964486   431 raft_consensus.cc:2243] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:51.965512   431 raft_consensus.cc:2272] T 7f531d2e532f4a488a87413159704294 P 7873a3a04f1f4097ac2435c017ca346a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:51.984243  8927 raft_consensus.cc:493] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:51.985124  8927 raft_consensus.cc:515] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:51.987668  8927 leader_election.cc:290] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:51.995329  7860 leader_election.cc:336] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:51.997097  7859 leader_election.cc:336] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:51.997651  7859 leader_election.cc:304] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:51.998602  8927 raft_consensus.cc:2749] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:52.017379  7861 consensus_peers.cc:597] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:52.021643  7861 consensus_peers.cc:597] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:52.076743  8927 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:52.077280  8927 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:52.079079  8927 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:52.083887  7860 leader_election.cc:336] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:52.084667  7859 leader_election.cc:336] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.085192  7859 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:52.086036  8927 raft_consensus.cc:2749] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.094619  8927 raft_consensus.cc:493] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:52.095261  8927 raft_consensus.cc:515] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:52.097266  8927 leader_election.cc:290] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:52.102036  7861 leader_election.cc:336] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
W20260709 13:04:52.103199  7860 leader_election.cc:336] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:52.103546  7860 leader_election.cc:304] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:52.104322  8927 raft_consensus.cc:2749] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.114372  8927 raft_consensus.cc:493] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.114974  8927 raft_consensus.cc:515] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:52.117059  8927 leader_election.cc:290] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:52.122423  7859 leader_election.cc:336] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:52.124079  7860 leader_election.cc:336] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:52.124586  7860 leader_election.cc:304] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:52.125813  8927 raft_consensus.cc:2749] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:52.132319  7861 consensus_peers.cc:597] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:52.132277  8927 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:52.133092  8927 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:52.134935  8927 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:52.138711  8927 raft_consensus.cc:493] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.139362  8927 raft_consensus.cc:515] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
W20260709 13:04:52.140540  7859 leader_election.cc:336] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:52.141185  7860 leader_election.cc:336] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:52.141682  7860 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:52.144481  8913 raft_consensus.cc:2749] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.141922  8927 leader_election.cc:290] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:52.147294  7859 leader_election.cc:336] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.148150  8913 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:52.148646  8913 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
W20260709 13:04:52.148670  7861 leader_election.cc:336] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:52.150573  7861 leader_election.cc:304] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:52.151305  8913 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:52.152351  8927 raft_consensus.cc:2749] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:52.156148  7860 leader_election.cc:336] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:52.157114  7859 leader_election.cc:336] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.157622  7859 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:52.158420  8913 raft_consensus.cc:2749] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:52.295075  8913 raft_consensus.cc:493] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.295699  8913 raft_consensus.cc:515] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:52.298029  8913 leader_election.cc:290] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:52.302130  7859 leader_election.cc:336] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:52.303423  7861 leader_election.cc:336] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:52.303844  7861 leader_election.cc:304] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:52.304553  8913 raft_consensus.cc:2749] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.335146  8913 raft_consensus.cc:493] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.335654  8913 raft_consensus.cc:515] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:52.337769  8913 leader_election.cc:290] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:52.340888  7859 leader_election.cc:336] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:52.342454  7861 leader_election.cc:336] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:52.342586  8913 raft_consensus.cc:493] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.342897  7861 leader_election.cc:304] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:52.343158  8913 raft_consensus.cc:515] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:52.343685  8817 raft_consensus.cc:2749] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.344925  8817 raft_consensus.cc:493] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.345481  8817 raft_consensus.cc:515] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:52.347047  8913 leader_election.cc:290] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:52.347877  8817 leader_election.cc:290] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:52.351251  7860 leader_election.cc:336] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:52.354027  7861 leader_election.cc:336] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
W20260709 13:04:52.354450  7859 leader_election.cc:336] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.354988  7859 leader_election.cc:304] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
W20260709 13:04:52.355659  7859 leader_election.cc:336] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.355631  8817 raft_consensus.cc:2749] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.356379  7859 leader_election.cc:304] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:52.357116  8817 raft_consensus.cc:2749] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.377940  8817 raft_consensus.cc:493] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.378660  8817 raft_consensus.cc:515] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:52.381430  8817 leader_election.cc:290] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:52.385661  7859 leader_election.cc:336] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:52.386325  7861 leader_election.cc:336] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:52.386652  7861 leader_election.cc:304] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:52.387264  8817 raft_consensus.cc:2749] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.451009  8913 raft_consensus.cc:493] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.451571  8913 raft_consensus.cc:515] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:52.453898  8913 leader_election.cc:290] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:52.460687  7860 leader_election.cc:336] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:52.463033  7859 leader_election.cc:336] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.463610  7859 leader_election.cc:304] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:52.464480  8913 raft_consensus.cc:2749] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.485239  8913 raft_consensus.cc:493] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.485894  8913 raft_consensus.cc:515] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:52.496019  8913 leader_election.cc:290] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:52.508814  7860 leader_election.cc:336] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:52.510931  7859 leader_election.cc:336] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.511430  7859 leader_election.cc:304] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:52.512130  8913 raft_consensus.cc:2749] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:52.550530  8913 raft_consensus.cc:493] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.551060  8913 raft_consensus.cc:515] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:52.554222  8913 leader_election.cc:290] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:52.557808  7860 leader_election.cc:336] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:52.559315  7859 leader_election.cc:336] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.559671  7859 leader_election.cc:304] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:52.560325  8913 raft_consensus.cc:2749] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:52.619634  8913 raft_consensus.cc:493] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:52.620364  8913 raft_consensus.cc:515] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:52.623003  8913 leader_election.cc:290] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:52.627667  7860 leader_election.cc:336] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:52.628886  7859 leader_election.cc:336] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:52.629406  7859 leader_election.cc:304] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:52.630251  8913 raft_consensus.cc:2749] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:52.677382  7860 consensus_peers.cc:597] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:52.742697  7860 consensus_peers.cc:597] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:52.848912  8913 raft_consensus.cc:493] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7873a3a04f1f4097ac2435c017ca346a)
I20260709 13:04:52.849445  8913 raft_consensus.cc:515] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:52.851267  8913 leader_election.cc:290] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:52.855084  7861 leader_election.cc:336] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
W20260709 13:04:52.855724  7860 leader_election.cc:336] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:52.856257  7860 leader_election.cc:304] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:52.857029  8913 raft_consensus.cc:2749] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:52.878062  7860 consensus_peers.cc:597] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:52.884430  7860 consensus_peers.cc:597] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.051407   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 7842)
W20260709 13:04:53.066112  7860 consensus_peers.cc:597] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.066771  7860 consensus_peers.cc:597] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.093197  8913 raft_consensus.cc:493] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7873a3a04f1f4097ac2435c017ca346a)
I20260709 13:04:53.094372  8913 raft_consensus.cc:515] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:53.099073  8913 leader_election.cc:290] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:53.104337  7859 leader_election.cc:336] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:53.105427  7861 leader_election.cc:336] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:53.105940  7861 leader_election.cc:304] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.106976  8817 raft_consensus.cc:2749] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:53.122736  7860 consensus_peers.cc:597] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.180974  7860 consensus_peers.cc:597] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.206032  7860 consensus_peers.cc:597] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.211651  8817 raft_consensus.cc:493] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7873a3a04f1f4097ac2435c017ca346a)
I20260709 13:04:53.213346  8817 raft_consensus.cc:515] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:53.215574  8817 leader_election.cc:290] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:53.219825  7859 leader_election.cc:336] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:53.220413  7861 leader_election.cc:336] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:53.220793  7861 leader_election.cc:304] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.221481  8817 raft_consensus.cc:2749] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.225093  8817 raft_consensus.cc:493] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7873a3a04f1f4097ac2435c017ca346a)
I20260709 13:04:53.225951  8817 raft_consensus.cc:515] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:53.228471  8817 leader_election.cc:290] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:53.233213  7861 leader_election.cc:336] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
W20260709 13:04:53.234045  7860 leader_election.cc:336] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:53.234383  7860 leader_election.cc:304] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.235191  8817 raft_consensus.cc:2749] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.268607  8817 raft_consensus.cc:493] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7873a3a04f1f4097ac2435c017ca346a)
I20260709 13:04:53.269621  8817 raft_consensus.cc:515] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:53.272559  8817 leader_election.cc:290] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:53.279021  7859 leader_election.cc:336] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:53.279867  7860 consensus_peers.cc:597] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.281584  8913 raft_consensus.cc:493] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7873a3a04f1f4097ac2435c017ca346a)
W20260709 13:04:53.281718  7861 leader_election.cc:336] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:53.282431  7861 leader_election.cc:304] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.282613  8913 raft_consensus.cc:515] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:53.283694  8817 raft_consensus.cc:2749] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.285267  8913 leader_election.cc:290] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:53.286110  7859 consensus_peers.cc:597] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.288188  7859 leader_election.cc:336] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:53.291173  7861 leader_election.cc:336] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:53.291761  7861 leader_election.cc:304] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.293231  8913 raft_consensus.cc:2749] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.297633  8913 raft_consensus.cc:493] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:53.298364  8913 raft_consensus.cc:515] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:53.300716  8913 leader_election.cc:290] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:53.305063  7861 leader_election.cc:336] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
W20260709 13:04:53.305667  7860 leader_election.cc:336] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:53.306082  7860 leader_election.cc:304] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.306952  8817 raft_consensus.cc:2749] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.353307  8817 raft_consensus.cc:493] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7873a3a04f1f4097ac2435c017ca346a)
I20260709 13:04:53.354022  8817 raft_consensus.cc:515] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:53.356007  8817 leader_election.cc:290] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:53.360067  7859 leader_election.cc:336] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:53.360948  7861 leader_election.cc:336] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:53.361297  7861 leader_election.cc:304] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.362071  8817 raft_consensus.cc:2749] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:53.375871  8817 raft_consensus.cc:493] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7873a3a04f1f4097ac2435c017ca346a)
I20260709 13:04:53.376772  8817 raft_consensus.cc:515] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:53.379210  8817 leader_election.cc:290] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:53.383785  7861 leader_election.cc:336] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
W20260709 13:04:53.384434  7859 leader_election.cc:336] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:53.384908  7859 leader_election.cc:304] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.385782  8817 raft_consensus.cc:2749] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:53.415853  7860 consensus_peers.cc:597] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.427492  7860 consensus_peers.cc:597] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Couldn't send request to peer 04f00c3bcb1e4bf59b3b88a72e0751cd. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.430605  8817 raft_consensus.cc:493] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:53.431631  8817 raft_consensus.cc:515] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:53.434737  8817 leader_election.cc:290] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:53.437948  7859 consensus_peers.cc:597] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.438743  8817 raft_consensus.cc:493] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
W20260709 13:04:53.440675  7860 leader_election.cc:336] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:53.441418  7861 leader_election.cc:336] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:53.440924  8817 raft_consensus.cc:515] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:53.441962  7861 leader_election.cc:304] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.442878  8913 raft_consensus.cc:2749] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:53.443974  8817 leader_election.cc:290] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:53.448489  7859 leader_election.cc:336] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:53.449057  7860 leader_election.cc:336] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:53.449522  7860 leader_election.cc:304] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:53.450217  8817 raft_consensus.cc:2749] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:53.494711  7859 consensus_peers.cc:597] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.581048  7859 consensus_peers.cc:597] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.696660  8817 raft_consensus.cc:493] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:53.697726  8817 raft_consensus.cc:515] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:53.700349  8817 leader_election.cc:290] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:53.704630  7859 consensus_peers.cc:597] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:53.706002  7860 leader_election.cc:336] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:53.708662  7861 leader_election.cc:336] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:53.709221  7861 leader_election.cc:304] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:53.710141  8817 raft_consensus.cc:2749] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:53.801222  7859 consensus_peers.cc:597] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:53.856017  8817 raft_consensus.cc:493] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:53.856890  8817 raft_consensus.cc:515] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:53.858880  8817 leader_election.cc:290] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:53.863082  7859 leader_election.cc:336] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:53.863907  7860 leader_election.cc:336] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:53.864326  7860 leader_election.cc:304] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:53.865199  8817 raft_consensus.cc:2749] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:53.912762  7859 consensus_peers.cc:597] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Couldn't send request to peer 146ed2d5dab84c27a16d479f2aa5eb47. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:54.017606  7861 consensus_peers.cc:597] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:54.052263   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 7842)
W20260709 13:04:54.065476  7861 consensus_peers.cc:597] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:54.081825  8934 raft_consensus.cc:493] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.082523  8934 raft_consensus.cc:515] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:54.084900  8934 leader_election.cc:290] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:54.089176  7861 leader_election.cc:336] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
W20260709 13:04:54.089766  7860 leader_election.cc:336] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:54.090163  7860 leader_election.cc:304] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:54.090772  8934 raft_consensus.cc:2749] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:54.100111   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:04:54.131937  8934 raft_consensus.cc:493] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:54.132858  8934 raft_consensus.cc:515] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:54.135115  8934 leader_election.cc:290] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:54.139761  7859 leader_election.cc:336] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:54.140724  7861 leader_election.cc:336] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:54.140672  8934 raft_consensus.cc:493] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:54.141500  7861 leader_election.cc:304] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:54.141671  8934 raft_consensus.cc:515] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:54.142524  8913 raft_consensus.cc:2749] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.143599  8913 raft_consensus.cc:493] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:54.144490  8913 raft_consensus.cc:515] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:54.145537  8934 leader_election.cc:290] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
I20260709 13:04:54.147565  8913 leader_election.cc:290] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:54.150130  7860 leader_election.cc:336] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:54.150710  7859 leader_election.cc:336] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:54.151338  7859 leader_election.cc:304] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
W20260709 13:04:54.152899  7860 leader_election.cc:336] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
I20260709 13:04:54.153059  8913 raft_consensus.cc:2749] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:04:54.156255  7859 leader_election.cc:336] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:54.156828  7859 leader_election.cc:304] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:54.158022  8913 raft_consensus.cc:2749] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:54.174212  7861 consensus_peers.cc:597] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:54.184700  8913 raft_consensus.cc:493] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:54.185511  8913 raft_consensus.cc:515] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:54.187922  8913 leader_election.cc:290] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:54.192889  7859 leader_election.cc:336] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:54.193825  7861 leader_election.cc:336] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:54.194254  7861 leader_election.cc:304] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:54.195019  8817 raft_consensus.cc:2749] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.222635  8817 raft_consensus.cc:493] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:54.223517  8817 raft_consensus.cc:515] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:54.226047  8817 leader_election.cc:290] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:54.231892  7860 leader_election.cc:336] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:54.232527  7859 leader_election.cc:336] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:54.233039  7859 leader_election.cc:304] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:54.233762  8817 raft_consensus.cc:2749] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.235311  8817 raft_consensus.cc:493] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:54.235865  8817 raft_consensus.cc:515] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:54.237931  8817 leader_election.cc:290] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:54.242198  7860 leader_election.cc:336] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:54.244464  7859 leader_election.cc:336] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:54.244899  7859 leader_election.cc:304] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:54.245342  8817 raft_consensus.cc:493] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:54.245759  8913 raft_consensus.cc:2749] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.246055  8817 raft_consensus.cc:515] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } }
I20260709 13:04:54.248312  8817 leader_election.cc:290] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219), 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365)
W20260709 13:04:54.252238  7860 leader_election.cc:336] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:54.258337  7861 leader_election.cc:336] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:54.258780  7861 leader_election.cc:304] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:54.259419  8817 raft_consensus.cc:2749] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.271951   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:04:54.280644  8817 raft_consensus.cc:493] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 04f00c3bcb1e4bf59b3b88a72e0751cd)
I20260709 13:04:54.281391  8817 raft_consensus.cc:515] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } } peers { permanent_uuid: "04f00c3bcb1e4bf59b3b88a72e0751cd" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 39365 } } peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } }
I20260709 13:04:54.283196  8817 leader_election.cc:290] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365), 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589)
W20260709 13:04:54.287710  7860 leader_election.cc:336] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 04f00c3bcb1e4bf59b3b88a72e0751cd (127.0.107.193:39365): Network error: Client connection negotiation failed: client connection to 127.0.107.193:39365: connect: Connection refused (error 111)
W20260709 13:04:54.288379  7859 leader_election.cc:336] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:54.288750  7859 leader_election.cc:304] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 04f00c3bcb1e4bf59b3b88a72e0751cd, 146ed2d5dab84c27a16d479f2aa5eb47
I20260709 13:04:54.289453  8817 raft_consensus.cc:2749] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:54.322314  8817 raft_consensus.cc:493] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:54.322962  8817 raft_consensus.cc:515] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:54.324779  8817 leader_election.cc:290] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
W20260709 13:04:54.328919  7859 leader_election.cc:336] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
W20260709 13:04:54.330479  7861 leader_election.cc:336] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:54.330983  7861 leader_election.cc:304] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:54.331789  8817 raft_consensus.cc:2749] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:54.334332   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:54.335525   431 tablet_replica.cc:333] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.337194   431 raft_consensus.cc:2243] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.338891   431 raft_consensus.cc:2272] T 7fd80ffcb91143aeb64f882f614e0817 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.343251   431 tablet_replica.cc:333] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.343251  8817 raft_consensus.cc:493] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 146ed2d5dab84c27a16d479f2aa5eb47)
I20260709 13:04:54.344235  8817 raft_consensus.cc:515] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "146ed2d5dab84c27a16d479f2aa5eb47" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 43589 } } peers { permanent_uuid: "7873a3a04f1f4097ac2435c017ca346a" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44219 } } peers { permanent_uuid: "cc40c50d1f1e4a7eb98877bf59aaf75d" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 38377 } }
I20260709 13:04:54.344794   431 raft_consensus.cc:2243] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.345722   431 raft_consensus.cc:2272] T 7985bf73aa8b418389701bac6f2257f8 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.346803  8817 leader_election.cc:290] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589), 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219)
I20260709 13:04:54.350005   431 tablet_replica.cc:333] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.351029   431 raft_consensus.cc:2243] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:04:54.351675  7861 leader_election.cc:336] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111)
I20260709 13:04:54.351882   431 raft_consensus.cc:2272] T 814f68057304479398b938502ddb6f05 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:54.352792  7859 leader_election.cc:336] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 146ed2d5dab84c27a16d479f2aa5eb47 (127.0.107.194:43589): Network error: Client connection negotiation failed: client connection to 127.0.107.194:43589: connect: Connection refused (error 111)
I20260709 13:04:54.353294  7859 leader_election.cc:304] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc40c50d1f1e4a7eb98877bf59aaf75d; no voters: 146ed2d5dab84c27a16d479f2aa5eb47, 7873a3a04f1f4097ac2435c017ca346a
I20260709 13:04:54.354176  8817 raft_consensus.cc:2749] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:54.356202   431 tablet_replica.cc:333] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.357100   431 raft_consensus.cc:2243] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.357753   431 raft_consensus.cc:2272] T 9e898dd859544a1ebf030fc90a64701c P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.360306   431 tablet_replica.cc:333] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.361004   431 raft_consensus.cc:2243] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.362155   431 raft_consensus.cc:2272] T 8b6bac98b41745fab1ce373328ca0c8b P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.365753   431 tablet_replica.cc:333] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.366926   431 raft_consensus.cc:2243] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.367588   431 raft_consensus.cc:2272] T 54d5fb6202ad4fb1b17b5bd822d19b47 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:54.367755  7861 consensus_peers.cc:597] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:54.370321   431 tablet_replica.cc:333] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.371003   431 raft_consensus.cc:2243] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.371498   431 raft_consensus.cc:2272] T 82d30e47b0db4941b31196032e1bbe62 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.373977   431 tablet_replica.cc:333] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.374670   431 raft_consensus.cc:2243] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.375716   431 raft_consensus.cc:2272] T 0911fc9d471948a3878933bd85d9b5e9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.378213   431 tablet_replica.cc:333] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.378786   431 raft_consensus.cc:2243] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.379897   431 raft_consensus.cc:2272] T 9c4c4442b3ae45928f37714c97e92bbd P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.382347   431 tablet_replica.cc:333] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.382920   431 raft_consensus.cc:2243] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.383381   431 raft_consensus.cc:2272] T 1dfb59fc67914cce94336c08b2fa4e19 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.385782   431 tablet_replica.cc:333] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.386606   431 raft_consensus.cc:2243] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.387054   431 raft_consensus.cc:2272] T 0287ecd0addf408bbf1e25813f68a5df P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.389420   431 tablet_replica.cc:333] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.390023   431 raft_consensus.cc:2243] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.390472   431 raft_consensus.cc:2272] T 9b2bd913427444e4a532f350222d496d P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.393143   431 tablet_replica.cc:333] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.394059   431 raft_consensus.cc:2243] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.394667   431 raft_consensus.cc:2272] T d6de6b4220944748b4c901c3f0e50bfe P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.397586   431 tablet_replica.cc:333] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.398353   431 raft_consensus.cc:2243] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.399014   431 raft_consensus.cc:2272] T e96bceeac5554814ab33aee056d166c2 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.402150   431 tablet_replica.cc:333] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.402817   431 raft_consensus.cc:2243] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.403375   431 raft_consensus.cc:2272] T 7d9465bf05df47b988f23dac9f545177 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.405923   431 tablet_replica.cc:333] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.406579   431 raft_consensus.cc:2243] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.407646   431 raft_consensus.cc:2272] T 44ed68b66f2c4a59a2e1c334ec6380a5 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.411095   431 tablet_replica.cc:333] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.411923   431 raft_consensus.cc:2243] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.412663   431 raft_consensus.cc:2272] T 78b1fb849b894694b44d527478e929ad P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.415174   431 tablet_replica.cc:333] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.415848   431 raft_consensus.cc:2243] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.416446   431 raft_consensus.cc:2272] T 6b897e7d731a42678b1ecb79b5e2e468 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.419070   431 tablet_replica.cc:333] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.419808   431 raft_consensus.cc:2243] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.420928   431 raft_consensus.cc:2272] T bda007baac86482589feb8c8a9761337 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.423799   431 tablet_replica.cc:333] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.424510   431 raft_consensus.cc:2243] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.425071   431 raft_consensus.cc:2272] T c67ee10cce2a4cf68ce49c4c20fcd708 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.427819   431 tablet_replica.cc:333] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.428519   431 raft_consensus.cc:2243] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.429075   431 raft_consensus.cc:2272] T 00461ff939684b6fb3967bed0ebf0cd7 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.431329   431 tablet_replica.cc:333] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.431923   431 raft_consensus.cc:2243] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.432842   431 raft_consensus.cc:2272] T a24ddd1785584baaac825181369d1331 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.436235   431 tablet_replica.cc:333] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.437136   431 raft_consensus.cc:2243] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.437852   431 raft_consensus.cc:2272] T 5654cc6cdd4a43588ca31774035b64ed P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.440302   431 tablet_replica.cc:333] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.440920   431 raft_consensus.cc:2243] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.441428   431 raft_consensus.cc:2272] T bc39bf2ad6844beb8466b427508830f9 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.443630   431 tablet_replica.cc:333] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.444345   431 raft_consensus.cc:2243] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.445310   431 raft_consensus.cc:2272] T 4acc87afffa74c29bd1e7e9d5d3c207e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.448312   431 tablet_replica.cc:333] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.449122   431 raft_consensus.cc:2243] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.450579   431 raft_consensus.cc:2272] T 4cf6e495d139410392594c5345bd5306 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:54.451995  7861 consensus_peers.cc:597] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d -> Peer 7873a3a04f1f4097ac2435c017ca346a (127.0.107.195:44219): Couldn't send request to peer 7873a3a04f1f4097ac2435c017ca346a. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:44219: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:04:54.453893   431 tablet_replica.cc:333] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.454587   431 raft_consensus.cc:2243] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.455045   431 raft_consensus.cc:2272] T 68d8efcb62f44723b004455b1a44abbc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.457449   431 tablet_replica.cc:333] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.458024   431 raft_consensus.cc:2243] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.458480   431 raft_consensus.cc:2272] T cc8445b7cffa4e0886197daf4d7f765e P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.460980   431 tablet_replica.cc:333] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.461560   431 raft_consensus.cc:2243] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.461995   431 raft_consensus.cc:2272] T 4f69f4370f9c45b5a22013b2937db5fb P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.464511   431 tablet_replica.cc:333] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.465111   431 raft_consensus.cc:2243] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.466257   431 raft_consensus.cc:2272] T fbbddc9b10cc4f5aabaa9e3b135ffc2f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.468608   431 tablet_replica.cc:333] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.469172   431 raft_consensus.cc:2243] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.469722   431 raft_consensus.cc:2272] T 7e5b29cc10794a339c482492d5fbaa75 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.472013   431 tablet_replica.cc:333] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.472729   431 raft_consensus.cc:2243] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.473256   431 raft_consensus.cc:2272] T ff75938660e94825aaa4dc33fe595037 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.475575   431 tablet_replica.cc:333] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.476213   431 raft_consensus.cc:2243] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.477224   431 raft_consensus.cc:2272] T 666216fc7a1f403992aed2103a1031ef P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.479635   431 tablet_replica.cc:333] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.480310   431 raft_consensus.cc:2243] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.480847   431 raft_consensus.cc:2272] T 6ec80c3084b643f3a77a25d471dace7f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.483019   431 tablet_replica.cc:333] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.483611   431 raft_consensus.cc:2243] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.484128   431 raft_consensus.cc:2272] T b497b4caeba049e0bcdcef814028ecea P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.486433   431 tablet_replica.cc:333] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.487030   431 raft_consensus.cc:2243] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.488175   431 raft_consensus.cc:2272] T 5d0a2a6ec6a1432b9f925ef0927de924 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.490670   431 tablet_replica.cc:333] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.491307   431 raft_consensus.cc:2243] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.492347   431 raft_consensus.cc:2272] T a1d7a48d13f746369b2ee192d52214bc P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.494647   431 tablet_replica.cc:333] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.495235   431 raft_consensus.cc:2243] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.495781   431 raft_consensus.cc:2272] T 7f531d2e532f4a488a87413159704294 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.497936   431 tablet_replica.cc:333] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.498521   431 raft_consensus.cc:2243] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.499493   431 raft_consensus.cc:2272] T c5d149138d084c9db0b0266c1877f04f P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.501919   431 tablet_replica.cc:333] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.502478   431 raft_consensus.cc:2243] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.503031   431 raft_consensus.cc:2272] T dca217a028ce41ac86f47980a41103f6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.505441   431 tablet_replica.cc:333] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.506050   431 raft_consensus.cc:2243] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.507057   431 raft_consensus.cc:2272] T 25fc0069dd6948f0979c733fd0ac5343 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.509313   431 tablet_replica.cc:333] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.510025   431 raft_consensus.cc:2243] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.510545   431 raft_consensus.cc:2272] T 598a30719fa04ef1b9c9486bacdf0e39 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.512972   431 tablet_replica.cc:333] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.513515   431 raft_consensus.cc:2243] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.514539   431 raft_consensus.cc:2272] T ffc78460a31e44259913b287fcc501a6 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.516964   431 tablet_replica.cc:333] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d: stopping tablet replica
I20260709 13:04:54.517452   431 raft_consensus.cc:2243] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.517974   431 raft_consensus.cc:2272] T bb3bf96c4c6049efa4ec3725c681de10 P cc40c50d1f1e4a7eb98877bf59aaf75d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.598541   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:04:54.694253   431 master.cc:562] Master@127.0.107.254:33985 shutting down...
I20260709 13:04:54.729069   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:54.729825   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.730201   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P d190d2b02b9244a7b2a41036d32bfe70: stopping tablet replica
I20260709 13:04:54.785673   431 master.cc:584] Master@127.0.107.254:33985 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (41173 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:04:54.888010   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46219
I20260709 13:04:54.889499   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:54.896270  8935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.896448  8936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:54.896943  8938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:54.897557   431 server_base.cc:1061] running on GCE node
I20260709 13:04:54.898849   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:54.899088   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:54.899209   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602294899197 us; error 0 us; skew 500 ppm
I20260709 13:04:54.899673   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:54.902417   431 webserver.cc:533] Webserver started at http://127.0.107.254:33105/ using document root <none> and password file <none>
I20260709 13:04:54.902907   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:54.903064   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:54.903355   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:54.904652   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/master-0-root/instance:
uuid: "bae0c7a9681644628d666237dec7fc00"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-smzk"
I20260709 13:04:54.909431   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:54.913131  8943 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:54.914069   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:54.914412   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/master-0-root
uuid: "bae0c7a9681644628d666237dec7fc00"
format_stamp: "Formatted at 2026-07-09 13:04:54 on dist-test-slave-smzk"
I20260709 13:04:54.914755   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:54.935581   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:54.937036   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:54.983089   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46219
I20260709 13:04:54.983250  8994 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46219 every 8 connection(s)
I20260709 13:04:54.987555  8995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.001739  8995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00: Bootstrap starting.
I20260709 13:04:55.007875  8995 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.013453  8995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00: No bootstrap required, opened a new log
I20260709 13:04:55.016405  8995 raft_consensus.cc:359] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae0c7a9681644628d666237dec7fc00" member_type: VOTER }
I20260709 13:04:55.016950  8995 raft_consensus.cc:385] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.017160  8995 raft_consensus.cc:740] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bae0c7a9681644628d666237dec7fc00, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.017854  8995 consensus_queue.cc:260] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae0c7a9681644628d666237dec7fc00" member_type: VOTER }
I20260709 13:04:55.018376  8995 raft_consensus.cc:399] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:55.018610  8995 raft_consensus.cc:493] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:55.018857  8995 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:55.025043  8995 raft_consensus.cc:515] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae0c7a9681644628d666237dec7fc00" member_type: VOTER }
I20260709 13:04:55.025698  8995 leader_election.cc:304] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bae0c7a9681644628d666237dec7fc00; no voters: 
I20260709 13:04:55.027079  8995 leader_election.cc:290] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:55.027704  8998 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:55.029481  8998 raft_consensus.cc:697] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 1 LEADER]: Becoming Leader. State: Replica: bae0c7a9681644628d666237dec7fc00, State: Running, Role: LEADER
I20260709 13:04:55.030316  8998 consensus_queue.cc:237] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae0c7a9681644628d666237dec7fc00" member_type: VOTER }
I20260709 13:04:55.030846  8995 sys_catalog.cc:565] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:55.038683  8999 sys_catalog.cc:455] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bae0c7a9681644628d666237dec7fc00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae0c7a9681644628d666237dec7fc00" member_type: VOTER } }
I20260709 13:04:55.039691  8999 sys_catalog.cc:458] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:55.048656  9007 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:55.047200  9000 sys_catalog.cc:455] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bae0c7a9681644628d666237dec7fc00. Latest consensus state: current_term: 1 leader_uuid: "bae0c7a9681644628d666237dec7fc00" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bae0c7a9681644628d666237dec7fc00" member_type: VOTER } }
I20260709 13:04:55.052608  9000 sys_catalog.cc:458] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:55.055481  9007 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:55.056499   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:55.066164  9007 catalog_manager.cc:1383] Generated new cluster ID: 34f203fac0824e50908cc22c307382f3
I20260709 13:04:55.066565  9007 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:55.087389  9007 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:55.089098  9007 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:55.107076  9007 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00: Generated new TSK 0
I20260709 13:04:55.107908  9007 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:55.123272   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:55.130522  9016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:55.131641  9017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:55.133417  9019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:55.133778   431 server_base.cc:1061] running on GCE node
I20260709 13:04:55.135231   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:55.135473   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:55.135607   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602295135594 us; error 0 us; skew 500 ppm
I20260709 13:04:55.136232   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:55.139235   431 webserver.cc:533] Webserver started at http://127.0.107.193:40895/ using document root <none> and password file <none>
I20260709 13:04:55.139732   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:55.139922   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:55.140266   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:55.141533   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root/instance:
uuid: "f4806c167f014f00aec4fa5de21fbedc"
format_stamp: "Formatted at 2026-07-09 13:04:55 on dist-test-slave-smzk"
I20260709 13:04:55.146695   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:55.150496  9024 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.151450   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:55.151937   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "f4806c167f014f00aec4fa5de21fbedc"
format_stamp: "Formatted at 2026-07-09 13:04:55 on dist-test-slave-smzk"
I20260709 13:04:55.152354   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:55.171713   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:55.173218   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:55.174969   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:55.177649   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:55.177902   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.178153   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:55.178346   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.228451   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40685
I20260709 13:04:55.228556  9086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40685 every 8 connection(s)
I20260709 13:04:55.234422   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:55.243146  9091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:55.243872  9092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:55.246522  9094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:55.246855   431 server_base.cc:1061] running on GCE node
I20260709 13:04:55.248929   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:55.249188   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:55.249374   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602295249351 us; error 0 us; skew 500 ppm
I20260709 13:04:55.250170   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:55.252933  9087 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46219
I20260709 13:04:55.253369  9087 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:55.253654   431 webserver.cc:533] Webserver started at http://127.0.107.194:41423/ using document root <none> and password file <none>
I20260709 13:04:55.254284  9087 heartbeater.cc:507] Master 127.0.107.254:46219 requested a full tablet report, sending...
I20260709 13:04:55.254297   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:55.254972   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:55.255244   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:55.256855   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-1-root/instance:
uuid: "153a206e54f742dfad45af86fdd8ba8d"
format_stamp: "Formatted at 2026-07-09 13:04:55 on dist-test-slave-smzk"
I20260709 13:04:55.256932  8960 ts_manager.cc:194] Registered new tserver with Master: f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:04:55.258971  8960 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52936
I20260709 13:04:55.262459   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:55.266731  9099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.267701   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:55.268150   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-1-root
uuid: "153a206e54f742dfad45af86fdd8ba8d"
format_stamp: "Formatted at 2026-07-09 13:04:55 on dist-test-slave-smzk"
I20260709 13:04:55.268513   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:55.283131   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:55.284729   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:55.286490   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:55.289036   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:55.289268   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.289525   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:55.289697   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.343711   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:35399
I20260709 13:04:55.343787  9161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:35399 every 8 connection(s)
I20260709 13:04:55.350124   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:55.360924  9166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:55.361126  9165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:55.364786  9162 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46219
W20260709 13:04:55.365216  9168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:55.365289  9162 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:55.366544  9162 heartbeater.cc:507] Master 127.0.107.254:46219 requested a full tablet report, sending...
I20260709 13:04:55.367136   431 server_base.cc:1061] running on GCE node
I20260709 13:04:55.368485   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:55.368805   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:55.369035   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602295369013 us; error 0 us; skew 500 ppm
I20260709 13:04:55.369410  8960 ts_manager.cc:194] Registered new tserver with Master: 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:55.369845   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:55.372300  8960 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52952
I20260709 13:04:55.374279   431 webserver.cc:533] Webserver started at http://127.0.107.195:37265/ using document root <none> and password file <none>
I20260709 13:04:55.375041   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:55.375290   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:55.375599   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:55.377033   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-2-root/instance:
uuid: "583be3faf9fc43b0a0eb708425901bdd"
format_stamp: "Formatted at 2026-07-09 13:04:55 on dist-test-slave-smzk"
I20260709 13:04:55.382398   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:04:55.386674  9173 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.387614   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:55.388025   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-2-root
uuid: "583be3faf9fc43b0a0eb708425901bdd"
format_stamp: "Formatted at 2026-07-09 13:04:55 on dist-test-slave-smzk"
I20260709 13:04:55.388443   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:55.428134   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:55.429656   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:55.431591   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:55.434490   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:55.434765   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.435056   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:55.435267   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:55.492115   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:37003
I20260709 13:04:55.492273  9235 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:37003 every 8 connection(s)
I20260709 13:04:55.508837  9236 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46219
I20260709 13:04:55.509497  9236 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:55.510452  9236 heartbeater.cc:507] Master 127.0.107.254:46219 requested a full tablet report, sending...
I20260709 13:04:55.512913  8960 ts_manager.cc:194] Registered new tserver with Master: 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:55.513664   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017528181s
I20260709 13:04:55.514544  8960 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52958
I20260709 13:04:55.546674  8960 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52964:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:55.550040  8960 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:55.648314  9127 tablet_service.cc:1511] Processing CreateTablet for tablet 7434e8754c334ff58af799b5f0fe4d30 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:55.648965  9126 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5db7b1f17f4270866f0a813e2dfbd0 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:55.650008  9127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7434e8754c334ff58af799b5f0fe4d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.650669  9126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5db7b1f17f4270866f0a813e2dfbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.650333  9200 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5db7b1f17f4270866f0a813e2dfbd0 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:55.652060  9200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5db7b1f17f4270866f0a813e2dfbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.648782  9201 tablet_service.cc:1511] Processing CreateTablet for tablet 7434e8754c334ff58af799b5f0fe4d30 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:55.656477  9201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7434e8754c334ff58af799b5f0fe4d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.661278  9052 tablet_service.cc:1511] Processing CreateTablet for tablet 7434e8754c334ff58af799b5f0fe4d30 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:55.662072  9125 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef79c24d2624c928e7ef410388387f0 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:55.662950  9052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7434e8754c334ff58af799b5f0fe4d30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.663606  9125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef79c24d2624c928e7ef410388387f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.665628  9051 tablet_service.cc:1511] Processing CreateTablet for tablet 5a5db7b1f17f4270866f0a813e2dfbd0 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:55.668769  9050 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef79c24d2624c928e7ef410388387f0 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:55.671761  9049 tablet_service.cc:1511] Processing CreateTablet for tablet fe8228ea34704826a221a2ef72d2fe4e (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:55.680619  9051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a5db7b1f17f4270866f0a813e2dfbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.686977  9199 tablet_service.cc:1511] Processing CreateTablet for tablet 3ef79c24d2624c928e7ef410388387f0 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:55.688421  9050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef79c24d2624c928e7ef410388387f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.687865  9124 tablet_service.cc:1511] Processing CreateTablet for tablet fe8228ea34704826a221a2ef72d2fe4e (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:55.688846  9199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ef79c24d2624c928e7ef410388387f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.690441  9124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8228ea34704826a221a2ef72d2fe4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.691432  9049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8228ea34704826a221a2ef72d2fe4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.694773  9198 tablet_service.cc:1511] Processing CreateTablet for tablet fe8228ea34704826a221a2ef72d2fe4e (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:55.698586  9198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8228ea34704826a221a2ef72d2fe4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.716289  9048 tablet_service.cc:1511] Processing CreateTablet for tablet 5dff878d846e4d399d9f253772badf26 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:55.718622  9048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dff878d846e4d399d9f253772badf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.719687  9251 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:55.729251  9047 tablet_service.cc:1511] Processing CreateTablet for tablet 67dbae942ab248fa91a99e872b3418b9 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:55.730885  9047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dbae942ab248fa91a99e872b3418b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.731030  9126 tablet_service.cc:1511] Processing CreateTablet for tablet 5dff878d846e4d399d9f253772badf26 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:55.732590  9126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dff878d846e4d399d9f253772badf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.742298  9197 tablet_service.cc:1511] Processing CreateTablet for tablet 5dff878d846e4d399d9f253772badf26 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:55.744021  9197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dff878d846e4d399d9f253772badf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.747524  9123 tablet_service.cc:1511] Processing CreateTablet for tablet 67dbae942ab248fa91a99e872b3418b9 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:55.749483  9123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dbae942ab248fa91a99e872b3418b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.765221  9196 tablet_service.cc:1511] Processing CreateTablet for tablet 67dbae942ab248fa91a99e872b3418b9 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:55.767149  9196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dbae942ab248fa91a99e872b3418b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.781409  9252 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:55.790446  9195 tablet_service.cc:1511] Processing CreateTablet for tablet d08805b2d06e4b0b85425c54f1b83436 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:55.791975  9195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08805b2d06e4b0b85425c54f1b83436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.783020  9251 tablet_bootstrap.cc:654] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.785822  9046 tablet_service.cc:1511] Processing CreateTablet for tablet d08805b2d06e4b0b85425c54f1b83436 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:55.786985  9122 tablet_service.cc:1511] Processing CreateTablet for tablet d08805b2d06e4b0b85425c54f1b83436 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:55.798655  9046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08805b2d06e4b0b85425c54f1b83436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.796545  9127 tablet_service.cc:1511] Processing CreateTablet for tablet fc15f780faa94e578d3a3babc11ff5cf (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:55.800762  9200 tablet_service.cc:1511] Processing CreateTablet for tablet fc15f780faa94e578d3a3babc11ff5cf (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:55.802120  9200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc15f780faa94e578d3a3babc11ff5cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.804968  9122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d08805b2d06e4b0b85425c54f1b83436. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.812639  9127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc15f780faa94e578d3a3babc11ff5cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.813261  9052 tablet_service.cc:1511] Processing CreateTablet for tablet fe9df3206f0c488eabf9af3c3e859cd5 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:55.813381  9051 tablet_service.cc:1511] Processing CreateTablet for tablet fc15f780faa94e578d3a3babc11ff5cf (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:55.814662  9052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9df3206f0c488eabf9af3c3e859cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.817055  9051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc15f780faa94e578d3a3babc11ff5cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.821059  9124 tablet_service.cc:1511] Processing CreateTablet for tablet fe9df3206f0c488eabf9af3c3e859cd5 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:55.822446  9124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9df3206f0c488eabf9af3c3e859cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.825311  9252 tablet_bootstrap.cc:654] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.826702  9199 tablet_service.cc:1511] Processing CreateTablet for tablet fe9df3206f0c488eabf9af3c3e859cd5 (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:55.836436  9049 tablet_service.cc:1511] Processing CreateTablet for tablet 6c69cf48cb0e4e6db10a6be2da5fdd9a (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:55.837846  9049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c69cf48cb0e4e6db10a6be2da5fdd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.837014  9199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9df3206f0c488eabf9af3c3e859cd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.847118  9125 tablet_service.cc:1511] Processing CreateTablet for tablet 6c69cf48cb0e4e6db10a6be2da5fdd9a (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:55.848697  9125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c69cf48cb0e4e6db10a6be2da5fdd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.829547  9253 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:55.815470  9251 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:55.852608  9251 ts_tablet_manager.cc:1403] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.133s	user 0.012s	sys 0.004s
I20260709 13:04:55.861545  9252 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:55.862259  9252 ts_tablet_manager.cc:1403] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.008s
I20260709 13:04:55.863955  9198 tablet_service.cc:1511] Processing CreateTablet for tablet 6c69cf48cb0e4e6db10a6be2da5fdd9a (DEFAULT_TABLE table=test-workload [id=ad439b44ca3242beb8b0d0a8993de0c1]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:55.865406  9198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c69cf48cb0e4e6db10a6be2da5fdd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:55.864256  9251 raft_consensus.cc:359] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:55.867441  9251 raft_consensus.cc:385] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.867802  9251 raft_consensus.cc:740] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.868822  9251 consensus_queue.cc:260] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:55.869469  9252 raft_consensus.cc:359] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:55.880635  9252 raft_consensus.cc:385] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.880992  9252 raft_consensus.cc:740] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.882018  9252 consensus_queue.cc:260] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:55.920295  9253 tablet_bootstrap.cc:654] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.923041  9087 heartbeater.cc:499] Master 127.0.107.254:46219 was elected leader, sending a full tablet report...
I20260709 13:04:55.925139  9252 ts_tablet_manager.cc:1434] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.062s	user 0.014s	sys 0.023s
I20260709 13:04:55.926044  9162 heartbeater.cc:499] Master 127.0.107.254:46219 was elected leader, sending a full tablet report...
I20260709 13:04:55.937165  9251 ts_tablet_manager.cc:1434] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.084s	user 0.019s	sys 0.023s
I20260709 13:04:55.937057  9252 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:55.938547  9251 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:55.945684  9251 tablet_bootstrap.cc:654] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:55.951447  9252 tablet_bootstrap.cc:654] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:55.983769  9088 tablet.cc:2406] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:55.987011  9251 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:55.987035  9253 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:55.987501  9252 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:55.987780  9251 ts_tablet_manager.cc:1403] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.020s
I20260709 13:04:55.987944  9253 ts_tablet_manager.cc:1403] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.159s	user 0.009s	sys 0.025s
I20260709 13:04:55.988293  9252 ts_tablet_manager.cc:1403] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.052s	user 0.026s	sys 0.016s
I20260709 13:04:55.991408  9251 raft_consensus.cc:359] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:55.991633  9253 raft_consensus.cc:359] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:55.992267  9251 raft_consensus.cc:385] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.992385  9253 raft_consensus.cc:385] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.991889  9252 raft_consensus.cc:359] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:55.992719  9251 raft_consensus.cc:740] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.992799  9253 raft_consensus.cc:740] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.992965  9252 raft_consensus.cc:385] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:55.993558  9252 raft_consensus.cc:740] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:55.993844  9253 consensus_queue.cc:260] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:55.993896  9251 consensus_queue.cc:260] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:55.994417  9252 consensus_queue.cc:260] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:55.996908  9252 ts_tablet_manager.cc:1434] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:04:55.998056  9252 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:56.000526  9251 ts_tablet_manager.cc:1434] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.006s
I20260709 13:04:56.001953  9251 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:56.003737  9253 ts_tablet_manager.cc:1434] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:04:56.004555  9236 heartbeater.cc:499] Master 127.0.107.254:46219 was elected leader, sending a full tablet report...
I20260709 13:04:56.005529  9252 tablet_bootstrap.cc:654] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.009259  9251 tablet_bootstrap.cc:654] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.013171  9256 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.013758  9256 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:56.018428  9256 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003), f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:04:56.018937  9256 raft_consensus.cc:493] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.019321  9257 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.019421  9256 raft_consensus.cc:515] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.019996  9257 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:56.021694  9256 leader_election.cc:290] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.024966  9267 raft_consensus.cc:493] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.025632  9267 raft_consensus.cc:515] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.028106  9267 leader_election.cc:290] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.034816  9257 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
W20260709 13:04:56.045951  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:56.053996  9253 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.082634  9211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.083703  9211 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 0.
I20260709 13:04:56.085287  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.086835  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:56.087630  9137 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 0.
I20260709 13:04:56.077508  9253 tablet_bootstrap.cc:654] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.088618  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:56.089524  9136 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 0.
I20260709 13:04:56.091231  9025 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.092882  9025 leader_election.cc:304] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.093132  9251 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:56.093672  9251 ts_tablet_manager.cc:1403] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.092s	user 0.020s	sys 0.016s
I20260709 13:04:56.094120  9257 raft_consensus.cc:2804] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.094574  9257 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.094933  9257 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.096958  9251 raft_consensus.cc:359] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.097757  9251 raft_consensus.cc:385] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.098075  9251 raft_consensus.cc:740] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.097767  9267 raft_consensus.cc:2804] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.100535  9267 raft_consensus.cc:493] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.098879  9251 consensus_queue.cc:260] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.100962  9267 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.101370  9252 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:56.102027  9252 ts_tablet_manager.cc:1403] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.104s	user 0.034s	sys 0.046s
I20260709 13:04:56.106086  9251 ts_tablet_manager.cc:1434] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:56.105865  9252 raft_consensus.cc:359] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.106684  9252 raft_consensus.cc:385] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.107079  9252 raft_consensus.cc:740] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.107373  9251 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:56.108004  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.107916  9252 consensus_queue.cc:260] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.109563  9210 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:56.111204  9100 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: 
I20260709 13:04:56.112751  9264 raft_consensus.cc:2804] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.113143  9264 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.113471  9264 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.114845  9251 tablet_bootstrap.cc:654] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.120072  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.123144  9253 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.124521  9253 ts_tablet_manager.cc:1403] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.011s
W20260709 13:04:56.125116  9100 leader_election.cc:343] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:56.093842  9025 leader_election.cc:343] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.129133  9253 raft_consensus.cc:359] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.130383  9253 raft_consensus.cc:385] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.131814  9253 raft_consensus.cc:740] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.132025  9267 raft_consensus.cc:515] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.137441  9257 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:56.140786  9267 leader_election.cc:290] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Requested vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.141619  9251 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:56.137529  9264 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:56.142035  9257 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Requested vote from peers 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:56.142189  9251 ts_tablet_manager.cc:1403] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.026s
I20260709 13:04:56.142926  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:56.134768  9253 consensus_queue.cc:260] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.132889  9252 ts_tablet_manager.cc:1434] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.031s	user 0.018s	sys 0.013s
I20260709 13:04:56.144853  9252 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:56.145376  9253 ts_tablet_manager.cc:1434] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:04:56.145408  9211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:56.146163  9211 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.146695  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:04:56.147482  9136 raft_consensus.cc:2393] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f4806c167f014f00aec4fa5de21fbedc in current term 1: Already voted for candidate 153a206e54f742dfad45af86fdd8ba8d in this term.
I20260709 13:04:56.142477  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:04:56.148628  9137 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.150879  9264 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Requested vote from peers 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003), f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:04:56.154525  9251 raft_consensus.cc:359] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.155442  9251 raft_consensus.cc:385] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.155741  9251 raft_consensus.cc:740] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.156584  9252 tablet_bootstrap.cc:654] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.156756  9251 consensus_queue.cc:260] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.157235  9211 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 1.
I20260709 13:04:56.157895  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.158749  9062 raft_consensus.cc:2393] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 153a206e54f742dfad45af86fdd8ba8d in current term 1: Already voted for candidate f4806c167f014f00aec4fa5de21fbedc in this term.
I20260709 13:04:56.158877  9025 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.159899  9257 raft_consensus.cc:2804] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.160490  9257 raft_consensus.cc:697] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Becoming Leader. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Running, Role: LEADER
I20260709 13:04:56.160591  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:04:56.161408  9257 consensus_queue.cc:237] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:56.163844  9210 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.169862  9251 ts_tablet_manager.cc:1434] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:04:56.159997  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.172133  9061 raft_consensus.cc:2393] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 153a206e54f742dfad45af86fdd8ba8d in current term 1: Already voted for candidate f4806c167f014f00aec4fa5de21fbedc in this term.
I20260709 13:04:56.173559  9252 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:56.173766  9102 leader_election.cc:304] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d; no voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:56.174132  9251 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:56.174299  9252 ts_tablet_manager.cc:1403] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 13:04:56.177699  9252 raft_consensus.cc:359] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.178488  9252 raft_consensus.cc:385] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.178820  9252 raft_consensus.cc:740] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.179586  9252 consensus_queue.cc:260] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.180894  8958 catalog_manager.cc:5697] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc reported cstate change: term changed from 0 to 1, leader changed from <none> to f4806c167f014f00aec4fa5de21fbedc (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4806c167f014f00aec4fa5de21fbedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.182282  9252 ts_tablet_manager.cc:1434] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:56.182803  9251 tablet_bootstrap.cc:654] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.183495  9252 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:56.187307  9210 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 1.
I20260709 13:04:56.188573  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:56.189839  9209 raft_consensus.cc:2393] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 153a206e54f742dfad45af86fdd8ba8d in current term 1: Already voted for candidate f4806c167f014f00aec4fa5de21fbedc in this term.
I20260709 13:04:56.191159  9100 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d; no voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:56.192090  9252 tablet_bootstrap.cc:654] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.192468  9256 raft_consensus.cc:2749] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.194077  9253 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.180964  9137 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 1.
I20260709 13:04:56.195958  9264 raft_consensus.cc:2749] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.196342  9025 leader_election.cc:304] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.197543  9257 raft_consensus.cc:2804] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.198078  9257 raft_consensus.cc:697] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Becoming Leader. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Running, Role: LEADER
I20260709 13:04:56.199065  9257 consensus_queue.cc:237] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.210425  9251 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:56.211220  9251 ts_tablet_manager.cc:1403] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.007s
I20260709 13:04:56.215586  9251 raft_consensus.cc:359] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.216755  9251 raft_consensus.cc:385] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.217947  9251 raft_consensus.cc:740] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.220284  9253 tablet_bootstrap.cc:654] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.219933  9251 consensus_queue.cc:260] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.222920  9252 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:56.222956  9251 ts_tablet_manager.cc:1434] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 13:04:56.223810  9252 ts_tablet_manager.cc:1403] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.013s
I20260709 13:04:56.224480  9251 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:56.227082  9252 raft_consensus.cc:359] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.227955  9252 raft_consensus.cc:385] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.228377  9252 raft_consensus.cc:740] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.229208  9252 consensus_queue.cc:260] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.231829  9251 tablet_bootstrap.cc:654] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.231866  9252 ts_tablet_manager.cc:1434] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:04:56.233228  9252 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:56.233135  9253 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.234740  9253 ts_tablet_manager.cc:1403] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.002s
I20260709 13:04:56.238561  9253 raft_consensus.cc:359] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.239485  9253 raft_consensus.cc:385] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.239815  9253 raft_consensus.cc:740] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.240959  9253 consensus_queue.cc:260] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.245959  9252 tablet_bootstrap.cc:654] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.249214  9253 ts_tablet_manager.cc:1434] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:04:56.252012  9253 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.253495  9251 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:56.254652  9251 ts_tablet_manager.cc:1403] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.005s
I20260709 13:04:56.259122  9251 raft_consensus.cc:359] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.260279  9253 tablet_bootstrap.cc:654] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.261559  8959 catalog_manager.cc:5697] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc reported cstate change: term changed from 0 to 1, leader changed from <none> to f4806c167f014f00aec4fa5de21fbedc (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4806c167f014f00aec4fa5de21fbedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.260336  9251 raft_consensus.cc:385] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.262984  9251 raft_consensus.cc:740] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.264029  9251 consensus_queue.cc:260] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.270927  9252 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:56.271504  9251 ts_tablet_manager.cc:1434] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:04:56.271654  9252 ts_tablet_manager.cc:1403] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.039s	user 0.028s	sys 0.003s
I20260709 13:04:56.272842  9251 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:56.275107  9252 raft_consensus.cc:359] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.275928  9252 raft_consensus.cc:385] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.276253  9252 raft_consensus.cc:740] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.277279  9252 consensus_queue.cc:260] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.280004  9252 ts_tablet_manager.cc:1434] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:04:56.281088  9252 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:56.282610  9251 tablet_bootstrap.cc:654] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.287838  9252 tablet_bootstrap.cc:654] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.288143  9253 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.288661  9253 ts_tablet_manager.cc:1403] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.004s
I20260709 13:04:56.294034  9253 raft_consensus.cc:359] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.295161  9253 raft_consensus.cc:385] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.295620  9253 raft_consensus.cc:740] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.297019  9253 consensus_queue.cc:260] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.299777  9252 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:56.300401  9252 ts_tablet_manager.cc:1403] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 13:04:56.303550  9252 raft_consensus.cc:359] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.304585  9252 raft_consensus.cc:385] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.304955  9252 raft_consensus.cc:740] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.305754  9251 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:56.306226  9253 ts_tablet_manager.cc:1434] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:56.305716  9252 consensus_queue.cc:260] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.306473  9251 ts_tablet_manager.cc:1403] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.023s
I20260709 13:04:56.307704  9253 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.308960  9252 ts_tablet_manager.cc:1434] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:04:56.310257  9252 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:56.310298  9251 raft_consensus.cc:359] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.311296  9251 raft_consensus.cc:385] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.311621  9251 raft_consensus.cc:740] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.312538  9251 consensus_queue.cc:260] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.318369  9251 ts_tablet_manager.cc:1434] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:04:56.319653  9252 tablet_bootstrap.cc:654] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.319660  9251 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:56.320590  9253 tablet_bootstrap.cc:654] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.328820  9251 tablet_bootstrap.cc:654] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.331455  9252 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:56.332182  9252 ts_tablet_manager.cc:1403] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.010s
I20260709 13:04:56.332722  9257 raft_consensus.cc:493] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.333281  9257 raft_consensus.cc:515] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.335078  9252 raft_consensus.cc:359] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.335829  9252 raft_consensus.cc:385] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.336253  9252 raft_consensus.cc:740] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.337102  9252 consensus_queue.cc:260] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.339612  9252 ts_tablet_manager.cc:1434] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:56.340185  9261 raft_consensus.cc:493] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.341069  9261 raft_consensus.cc:515] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.341987  9257 leader_election.cc:290] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.342438  9252 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:56.344281  9264 raft_consensus.cc:493] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.344843  9264 raft_consensus.cc:515] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.345732  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:56.346799  9137 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 0.
I20260709 13:04:56.347218  9264 leader_election.cc:290] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.349011  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.349285  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.349834  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.350703  9061 raft_consensus.cc:2468] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:56.350858  9025 leader_election.cc:304] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
W20260709 13:04:56.351985  9025 leader_election.cc:343] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.352365  9102 leader_election.cc:304] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.353802  9264 raft_consensus.cc:2804] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.358714  9264 raft_consensus.cc:493] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.359256  9264 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.354710  9261 leader_election.cc:290] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:56.349922  9209 raft_consensus.cc:2468] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:56.355166  9251 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:56.368109  9264 raft_consensus.cc:515] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.355643  9257 raft_consensus.cc:2804] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.368891  9251 ts_tablet_manager.cc:1403] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.009s
I20260709 13:04:56.369226  9257 raft_consensus.cc:493] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.369755  9257 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.371447  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:04:56.372154  9061 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.371871  9251 raft_consensus.cc:359] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.372573  9251 raft_consensus.cc:385] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.372853  9251 raft_consensus.cc:740] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.373584  9251 consensus_queue.cc:260] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.375619  9251 ts_tablet_manager.cc:1434] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:56.376700  9251 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:56.378630  9257 raft_consensus.cc:515] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.380808  9061 raft_consensus.cc:2468] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:56.340214  9253 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.384191  9253 ts_tablet_manager.cc:1403] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.014s
I20260709 13:04:56.384435  9102 leader_election.cc:304] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.384976  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:04:56.385468  9256 raft_consensus.cc:2804] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.385749  9137 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.356869  9252 tablet_bootstrap.cc:654] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.382844  9251 tablet_bootstrap.cc:654] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.387657  9253 raft_consensus.cc:359] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.390405  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:56.390566  9253 raft_consensus.cc:385] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.391300  9253 raft_consensus.cc:740] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.383147  9264 leader_election.cc:290] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.383188  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:56.392431  9209 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.392433  9253 consensus_queue.cc:260] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.394169  9264 raft_consensus.cc:493] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.394860  9264 raft_consensus.cc:515] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.395623  9257 leader_election.cc:290] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Requested vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.397352  9253 ts_tablet_manager.cc:1434] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:04:56.399955  9253 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.400276  9137 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 1.
I20260709 13:04:56.400954  9252 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:56.401616  9252 ts_tablet_manager.cc:1403] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 13:04:56.401842  9025 leader_election.cc:304] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.403051  9257 raft_consensus.cc:2804] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.397900  9264 leader_election.cc:290] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.398594  9251 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:56.404239  9251 ts_tablet_manager.cc:1403] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.005s
I20260709 13:04:56.407413  9253 tablet_bootstrap.cc:654] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.407562  9251 raft_consensus.cc:359] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.408478  9251 raft_consensus.cc:385] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.408783  9251 raft_consensus.cc:740] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.408593  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbae942ab248fa91a99e872b3418b9" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.409250  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:56.409614  9061 raft_consensus.cc:2468] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:56.410930  9102 leader_election.cc:304] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
W20260709 13:04:56.410912  9025 leader_election.cc:343] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.412468  9257 raft_consensus.cc:697] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Becoming Leader. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Running, Role: LEADER
I20260709 13:04:56.413677  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbae942ab248fa91a99e872b3418b9" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.414664  9264 raft_consensus.cc:2804] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.415093  9264 raft_consensus.cc:493] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:56.415838  9100 leader_election.cc:343] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.415258  9251 consensus_queue.cc:260] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.415482  9264 raft_consensus.cc:3060] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.414117  9252 raft_consensus.cc:359] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.413985  9257 consensus_queue.cc:237] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.418386  9252 raft_consensus.cc:385] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.419938  9252 raft_consensus.cc:740] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.420504  9251 ts_tablet_manager.cc:1434] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:04:56.420842  9252 consensus_queue.cc:260] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.420465  9256 raft_consensus.cc:697] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:04:56.422248  9209 raft_consensus.cc:2468] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:56.422729  9267 raft_consensus.cc:493] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.424402  9252 ts_tablet_manager.cc:1434] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:04:56.426797  9252 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:04:56.427280  9256 consensus_queue.cc:237] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.428179  9267 raft_consensus.cc:515] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.433790  9252 tablet_bootstrap.cc:654] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.434321  9267 leader_election.cc:290] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.430109  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.431393  9251 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d: Bootstrap starting.
I20260709 13:04:56.438009  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:56.438629  9061 raft_consensus.cc:2393] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 583be3faf9fc43b0a0eb708425901bdd in current term 1: Already voted for candidate 153a206e54f742dfad45af86fdd8ba8d in this term.
I20260709 13:04:56.438838  9137 raft_consensus.cc:2468] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 0.
I20260709 13:04:56.440371  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.441917  9025 leader_election.cc:304] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.442982  9267 raft_consensus.cc:2804] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:56.443149  9025 leader_election.cc:343] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.443634  9267 raft_consensus.cc:493] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.447966  9267 raft_consensus.cc:3060] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.457527  9253 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.457688  9293 raft_consensus.cc:493] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.458859  9293 raft_consensus.cc:515] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.458189  9253 ts_tablet_manager.cc:1403] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.011s
I20260709 13:04:56.463976  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8228ea34704826a221a2ef72d2fe4e" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.464933  9061 raft_consensus.cc:2468] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:56.466686  9102 leader_election.cc:304] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.457581  9264 raft_consensus.cc:515] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.473886  9300 raft_consensus.cc:2804] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.474642  9300 raft_consensus.cc:493] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.475044  9300 raft_consensus.cc:3060] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.483469  9251 tablet_bootstrap.cc:654] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.487663  9293 leader_election.cc:290] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.488833  9293 raft_consensus.cc:493] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.489481  9293 raft_consensus.cc:515] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.492250  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8228ea34704826a221a2ef72d2fe4e" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.491865  9267 raft_consensus.cc:515] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.493126  9210 raft_consensus.cc:2468] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:56.495332  9293 leader_election.cc:290] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.495422  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c69cf48cb0e4e6db10a6be2da5fdd9a" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.462818  8956 catalog_manager.cc:5697] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc reported cstate change: term changed from 0 to 1, leader changed from <none> to f4806c167f014f00aec4fa5de21fbedc (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4806c167f014f00aec4fa5de21fbedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.496662  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c69cf48cb0e4e6db10a6be2da5fdd9a" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.500190  9061 raft_consensus.cc:2468] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:56.500229  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbae942ab248fa91a99e872b3418b9" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:04:56.503211  9060 raft_consensus.cc:3060] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.504595  9252 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: No bootstrap required, opened a new log
I20260709 13:04:56.505573  9252 ts_tablet_manager.cc:1403] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.079s	user 0.031s	sys 0.016s
I20260709 13:04:56.508615  9174 leader_election.cc:304] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd; no voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:56.467634  9253 raft_consensus.cc:359] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.509981  9253 raft_consensus.cc:385] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.511375  9253 raft_consensus.cc:740] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.510811  8957 catalog_manager.cc:5697] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.510480  9252 raft_consensus.cc:359] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.512247  9252 raft_consensus.cc:385] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.512427  9261 raft_consensus.cc:2749] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.513463  9102 leader_election.cc:304] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.513823  9252 raft_consensus.cc:740] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.512902  9253 consensus_queue.cc:260] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.514928  9252 consensus_queue.cc:260] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.518860  9210 raft_consensus.cc:2468] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:56.515620  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:04:56.519733  9136 raft_consensus.cc:3060] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.517714  9300 raft_consensus.cc:515] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.523516  9061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8228ea34704826a221a2ef72d2fe4e" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:04:56.524611  9061 raft_consensus.cc:3060] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.527446  9252 ts_tablet_manager.cc:1434] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:04:56.518576  9301 raft_consensus.cc:2804] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.528697  9301 raft_consensus.cc:493] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.529137  9301 raft_consensus.cc:3060] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.530419  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
W20260709 13:04:56.532300  9025 leader_election.cc:343] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.536403  9061 raft_consensus.cc:2468] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:56.538304  9102 leader_election.cc:304] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.538558  9301 raft_consensus.cc:515] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.539434  9256 raft_consensus.cc:2804] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.540314  9256 raft_consensus.cc:697] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:04:56.541522  9256 consensus_queue.cc:237] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.542938  9210 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c69cf48cb0e4e6db10a6be2da5fdd9a" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:56.543748  9210 raft_consensus.cc:3060] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.519930  9267 leader_election.cc:290] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Requested vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.546083  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8228ea34704826a221a2ef72d2fe4e" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:56.546442  9062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c69cf48cb0e4e6db10a6be2da5fdd9a" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:04:56.546938  9209 raft_consensus.cc:3060] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.547098  9062 raft_consensus.cc:3060] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.545743  9300 leader_election.cc:290] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.548559  9264 leader_election.cc:290] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.548074  9301 leader_election.cc:290] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.550163  9211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbae942ab248fa91a99e872b3418b9" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
W20260709 13:04:56.559134  9100 leader_election.cc:343] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:56.555763  9210 raft_consensus.cc:2468] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:56.560887  9100 leader_election.cc:304] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: 
I20260709 13:04:56.561834  9301 raft_consensus.cc:2804] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.562343  9301 raft_consensus.cc:697] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:04:56.562052  9209 raft_consensus.cc:2468] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:56.563357  9301 consensus_queue.cc:237] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.564735  9253 ts_tablet_manager.cc:1434] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.101s	user 0.005s	sys 0.007s
I20260709 13:04:56.562666  9251 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d: No bootstrap required, opened a new log
I20260709 13:04:56.566144  9251 ts_tablet_manager.cc:1403] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.027s
I20260709 13:04:56.566421  9062 raft_consensus.cc:2468] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:56.562834  9136 raft_consensus.cc:2468] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 1.
I20260709 13:04:56.562909  9060 raft_consensus.cc:2468] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:56.567003  9253 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.570618  9251 raft_consensus.cc:359] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.571355  9251 raft_consensus.cc:385] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.571638  9251 raft_consensus.cc:740] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.571552  9102 leader_election.cc:304] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:04:56.573199  9300 raft_consensus.cc:2804] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.573719  9300 raft_consensus.cc:697] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:04:56.574556  9300 consensus_queue.cc:237] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.575165  9253 tablet_bootstrap.cc:654] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.576781  9251 consensus_queue.cc:260] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.579128  9251 ts_tablet_manager.cc:1434] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:04:56.576069  9025 leader_election.cc:304] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:04:56.584170  9267 raft_consensus.cc:2804] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.585012  9267 raft_consensus.cc:697] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Becoming Leader. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Running, Role: LEADER
I20260709 13:04:56.586648  9267 consensus_queue.cc:237] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.595934  9253 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.601068  8957 catalog_manager.cc:5697] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc reported cstate change: term changed from 0 to 1, leader changed from <none> to f4806c167f014f00aec4fa5de21fbedc (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4806c167f014f00aec4fa5de21fbedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.602885  9253 ts_tablet_manager.cc:1403] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 13:04:56.605402  8958 catalog_manager.cc:5697] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.605885  9253 raft_consensus.cc:359] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.607013  9253 raft_consensus.cc:385] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.607383  9253 raft_consensus.cc:740] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.607445  8958 catalog_manager.cc:5697] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.608481  9253 consensus_queue.cc:260] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.609367  8958 catalog_manager.cc:5697] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 0 to 1, leader changed from <none> to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.610841  9253 ts_tablet_manager.cc:1434] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:56.611976  9253 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.618731  9253 tablet_bootstrap.cc:654] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.629045  9267 consensus_queue.cc:1048] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.630260  9257 consensus_queue.cc:1048] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.631068  9253 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.631608  9253 ts_tablet_manager.cc:1403] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 13:04:56.635089  9253 raft_consensus.cc:359] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.635820  9253 raft_consensus.cc:385] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.636111  9253 raft_consensus.cc:740] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.636857  9253 consensus_queue.cc:260] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.638860  9253 ts_tablet_manager.cc:1434] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:04:56.640072  9253 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.646095  9261 raft_consensus.cc:493] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.646720  9261 raft_consensus.cc:515] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.647749  9253 tablet_bootstrap.cc:654] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.648975  9261 leader_election.cc:290] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:56.650740  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9df3206f0c488eabf9af3c3e859cd5" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.651463  9060 raft_consensus.cc:2468] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 0.
I20260709 13:04:56.651566  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9df3206f0c488eabf9af3c3e859cd5" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:56.652222  9137 raft_consensus.cc:2468] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 0.
I20260709 13:04:56.652949  9176 leader_election.cc:304] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.655537  9261 raft_consensus.cc:2804] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.655934  9261 raft_consensus.cc:493] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.656358  9261 raft_consensus.cc:3060] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.673034  9314 raft_consensus.cc:493] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.673730  9314 raft_consensus.cc:515] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.675819  9314 leader_election.cc:290] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.677505  9253 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.678227  9253 ts_tablet_manager.cc:1403] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.015s
I20260709 13:04:56.678188  9261 raft_consensus.cc:515] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.682698  9253 raft_consensus.cc:359] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.683734  9253 raft_consensus.cc:385] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.684113  9253 raft_consensus.cc:740] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.685053  9253 consensus_queue.cc:260] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.689564  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:56.690624  9137 raft_consensus.cc:2468] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 0.
I20260709 13:04:56.700340  9211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:56.701243  9211 raft_consensus.cc:2468] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 0.
I20260709 13:04:56.707834  9025 leader_election.cc:304] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.709043  9314 raft_consensus.cc:2804] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:56.709403  9314 raft_consensus.cc:493] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.709796  9314 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.709582  9316 consensus_queue.cc:1048] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.730792  9314 raft_consensus.cc:515] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.733593  9314 leader_election.cc:290] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Requested vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:56.736498  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:04:56.737416  9137 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.733153  9319 raft_consensus.cc:493] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.748898  9319 raft_consensus.cc:515] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.760466  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9df3206f0c488eabf9af3c3e859cd5" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:04:56.761524  9060 raft_consensus.cc:3060] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.771768  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9df3206f0c488eabf9af3c3e859cd5" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:04:56.773085  9135 raft_consensus.cc:3060] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.790035  9211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436" candidate_uuid: "f4806c167f014f00aec4fa5de21fbedc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:56.791159  9211 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.798226  9314 consensus_queue.cc:1048] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.804179  9261 leader_election.cc:290] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
W20260709 13:04:56.811035  9025 consensus_peers.cc:597] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc -> Peer 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003): Couldn't send request to peer 583be3faf9fc43b0a0eb708425901bdd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:56.814297  9137 raft_consensus.cc:2468] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 1.
I20260709 13:04:56.816602  9025 leader_election.cc:304] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.818008  9314 raft_consensus.cc:2804] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.818863  9314 raft_consensus.cc:697] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Becoming Leader. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Running, Role: LEADER
I20260709 13:04:56.820466  9314 consensus_queue.cc:237] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.845649  9060 raft_consensus.cc:2468] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 1.
I20260709 13:04:56.845968  9253 ts_tablet_manager.cc:1434] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.167s	user 0.065s	sys 0.078s
I20260709 13:04:56.848187  9176 leader_election.cc:304] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:04:56.848860  9253 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd: Bootstrap starting.
I20260709 13:04:56.850354  9261 raft_consensus.cc:2804] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:56.851958  9135 raft_consensus.cc:2468] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 1.
I20260709 13:04:56.852167  9261 raft_consensus.cc:697] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 1 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:04:56.854370  9261 consensus_queue.cc:237] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.864816  9253 tablet_bootstrap.cc:654] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:56.866379  8958 catalog_manager.cc:5697] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc reported cstate change: term changed from 0 to 1, leader changed from <none> to f4806c167f014f00aec4fa5de21fbedc (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f4806c167f014f00aec4fa5de21fbedc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.875006  9253 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd: No bootstrap required, opened a new log
I20260709 13:04:56.875726  9253 ts_tablet_manager.cc:1403] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:04:56.877872  9300 consensus_queue.cc:1048] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.878809  9253 raft_consensus.cc:359] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.879534  9253 raft_consensus.cc:385] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:56.879803  9253 raft_consensus.cc:740] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Initialized, Role: FOLLOWER
I20260709 13:04:56.880676  9253 consensus_queue.cc:260] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:56.881313  9211 raft_consensus.cc:2468] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4806c167f014f00aec4fa5de21fbedc in term 1.
I20260709 13:04:56.883692  9253 ts_tablet_manager.cc:1434] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:04:56.885706  9137 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:56.886695  9137 raft_consensus.cc:2393] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 583be3faf9fc43b0a0eb708425901bdd in current term 1: Already voted for candidate f4806c167f014f00aec4fa5de21fbedc in this term.
I20260709 13:04:56.889034  9319 leader_election.cc:290] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:56.891274  9060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4806c167f014f00aec4fa5de21fbedc" is_pre_election: true
I20260709 13:04:56.892997  9176 leader_election.cc:304] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd; no voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:56.897190  9261 raft_consensus.cc:3060] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.903271  9300 consensus_queue.cc:1048] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:56.911242  9261 raft_consensus.cc:2749] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:56.921481  8956 catalog_manager.cc:5697] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 0 to 1, leader changed from <none> to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.949303  9300 consensus_queue.cc:1048] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.963387  9300 consensus_queue.cc:1048] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.976073  9300 consensus_queue.cc:1048] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:56.987901  9209 raft_consensus.cc:3060] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:56.999143  9301 consensus_queue.cc:1048] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.012739  9267 consensus_queue.cc:1048] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.016065  9267 consensus_queue.cc:1048] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.037719  9314 consensus_queue.cc:1048] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.059734  9301 consensus_queue.cc:1048] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:57.073294  9264 consensus_queue.cc:1048] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:57.112980   431 ts_manager.cc:295] Set tserver state for f4806c167f014f00aec4fa5de21fbedc to MAINTENANCE_MODE
I20260709 13:04:57.113852   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:04:57.126453  9319 raft_consensus.cc:493] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.127725  9319 raft_consensus.cc:515] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:57.130228  9319 leader_election.cc:290] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:57.133493  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
W20260709 13:04:57.133773  9176 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 383 similar messages]
W20260709 13:04:57.138652  9176 leader_election.cc:336] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:04:57.139200  9176 leader_election.cc:304] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd; no voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:57.143047  9319 raft_consensus.cc:2749] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:57.148088   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:57.149000   431 tablet_replica.cc:333] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.149789   431 raft_consensus.cc:2243] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.150193   431 raft_consensus.cc:2272] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.152323   431 tablet_replica.cc:333] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.152889   431 raft_consensus.cc:2243] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.153294   431 raft_consensus.cc:2272] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.155930   431 tablet_replica.cc:333] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.156626   431 raft_consensus.cc:2243] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.157087   431 raft_consensus.cc:2272] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.159767   431 tablet_replica.cc:333] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.160441   431 raft_consensus.cc:2243] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.161357   431 raft_consensus.cc:2272] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.163784   431 tablet_replica.cc:333] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.164412   431 raft_consensus.cc:2243] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.165040   431 pending_rounds.cc:70] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Trying to abort 1 pending ops.
I20260709 13:04:57.165221   431 pending_rounds.cc:77] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635007794208768 op_type: NO_OP noop_request { }
I20260709 13:04:57.165607   431 raft_consensus.cc:2889] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:04:57.165926   431 raft_consensus.cc:2272] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.168393   431 tablet_replica.cc:333] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.168970   431 raft_consensus.cc:2243] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.169411   431 raft_consensus.cc:2272] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.172096   431 tablet_replica.cc:333] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.172683   431 raft_consensus.cc:2243] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.173071   431 raft_consensus.cc:2272] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.175578   431 tablet_replica.cc:333] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.176143   431 raft_consensus.cc:2243] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.177248   431 raft_consensus.cc:2272] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.179595   431 tablet_replica.cc:333] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.180156   431 raft_consensus.cc:2243] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.180964   431 raft_consensus.cc:2272] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.183300   431 tablet_replica.cc:333] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: stopping tablet replica
I20260709 13:04:57.183763   431 raft_consensus.cc:2243] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.184631   431 raft_consensus.cc:2272] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.208649   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:04:57.347079  9102 consensus_peers.cc:597] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:57.380987  9176 consensus_peers.cc:597] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.388741  9319 consensus_queue.cc:1048] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:57.406349  9102 consensus_peers.cc:597] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:57.532451  9102 consensus_peers.cc:597] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:57.601920  9102 consensus_peers.cc:597] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:58.067902  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:58.155656  9300 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.156327  9300 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:58.158156  9300 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003), f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:04:58.159281  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
W20260709 13:04:58.162765  9102 leader_election.cc:336] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.163281  9102 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d; no voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:58.164113  9300 raft_consensus.cc:2749] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.188377  9261 raft_consensus.cc:493] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.189198  9261 raft_consensus.cc:515] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.191596  9261 leader_election.cc:290] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:58.192843  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
W20260709 13:04:58.195434  9176 leader_election.cc:336] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.195861  9176 leader_election.cc:304] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd; no voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:58.196658  9261 raft_consensus.cc:2749] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.224490  9300 raft_consensus.cc:493] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.225061  9300 raft_consensus.cc:515] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.226783  9300 leader_election.cc:290] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:58.228293  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:58.229220  9209 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:58.230432  9100 leader_election.cc:304] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: 
I20260709 13:04:58.231225  9300 raft_consensus.cc:2804] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:58.231298  9102 leader_election.cc:336] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.231611  9300 raft_consensus.cc:493] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.232079  9300 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.238649  9300 raft_consensus.cc:515] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.240623  9300 leader_election.cc:290] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:58.242015  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:58.242839  9209 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:58.247939  9102 leader_election.cc:336] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.251785  9209 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 2.
I20260709 13:04:58.253229  9100 leader_election.cc:304] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:58.253985  9300 raft_consensus.cc:2804] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.254488  9300 raft_consensus.cc:697] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:04:58.255280  9300 consensus_queue.cc:237] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.262492  8956 catalog_manager.cc:5697] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 1 to 2, leader changed from f4806c167f014f00aec4fa5de21fbedc (127.0.107.193) to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.303427  9261 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.304226  9261 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:58.306192  9261 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:04:58.307025  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:58.307791  9135 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 1.
I20260709 13:04:58.308972  9174 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: 
I20260709 13:04:58.309834  9350 raft_consensus.cc:2804] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:58.310278  9350 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.310676  9350 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:58.310930  9176 leader_election.cc:336] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.316502  9350 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:58.318459  9350 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: Requested vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:04:58.319442  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:04:58.319984  9135 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:58.322780  9176 leader_election.cc:336] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.326033  9135 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 2.
I20260709 13:04:58.327260  9174 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:58.328166  9350 raft_consensus.cc:2804] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.328612  9350 raft_consensus.cc:697] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:04:58.329324  9350 consensus_queue.cc:237] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:04:58.338244  8956 catalog_manager.cc:5697] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 1 to 2, leader changed from f4806c167f014f00aec4fa5de21fbedc (127.0.107.193) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 2 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.342341  9300 raft_consensus.cc:493] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.342927  9300 raft_consensus.cc:515] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.344936  9300 leader_election.cc:290] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:58.346498  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:58.347390  9209 raft_consensus.cc:2468] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 1.
I20260709 13:04:58.348551  9100 leader_election.cc:304] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: 
I20260709 13:04:58.349380  9300 raft_consensus.cc:2804] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:58.349718  9300 raft_consensus.cc:493] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:58.349783  9102 leader_election.cc:336] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.350059  9300 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.355870  9300 raft_consensus.cc:515] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.357903  9300 leader_election.cc:290] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:58.359169  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:58.359829  9209 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:58.361752  9102 leader_election.cc:336] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.365729  9209 raft_consensus.cc:2468] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 2.
I20260709 13:04:58.367123  9100 leader_election.cc:304] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:58.368147  9264 raft_consensus.cc:2804] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.368671  9264 raft_consensus.cc:697] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:04:58.369442  9264 consensus_queue.cc:237] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.378451  8956 catalog_manager.cc:5697] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 1 to 2, leader changed from f4806c167f014f00aec4fa5de21fbedc (127.0.107.193) to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.529856  9264 raft_consensus.cc:493] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.530377  9264 raft_consensus.cc:515] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.532716  9264 leader_election.cc:290] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:58.532954  9300 raft_consensus.cc:493] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.533640  9300 raft_consensus.cc:515] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.534142  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
I20260709 13:04:58.534978  9209 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 0.
I20260709 13:04:58.536237  9100 leader_election.cc:304] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: 
I20260709 13:04:58.536744  9300 leader_election.cc:290] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:58.537173  9264 raft_consensus.cc:2804] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:04:58.537569  9102 leader_election.cc:336] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.537742  9264 raft_consensus.cc:493] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.538269  9264 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.538475  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd" is_pre_election: true
W20260709 13:04:58.540527  9102 leader_election.cc:336] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.541018  9102 leader_election.cc:304] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d; no voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:58.541831  9300 raft_consensus.cc:2749] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:58.542232  9350 raft_consensus.cc:493] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.542837  9350 raft_consensus.cc:515] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.544801  9350 leader_election.cc:290] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:58.545962  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d" is_pre_election: true
I20260709 13:04:58.546577  9135 raft_consensus.cc:2468] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 1.
I20260709 13:04:58.547734  9174 leader_election.cc:304] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: 
I20260709 13:04:58.548641  9350 raft_consensus.cc:2804] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:58.549053  9350 raft_consensus.cc:493] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting leader election (detected failure of leader f4806c167f014f00aec4fa5de21fbedc)
I20260709 13:04:58.549055  9264 raft_consensus.cc:515] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
W20260709 13:04:58.549657  9176 leader_election.cc:336] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.549932  9350 raft_consensus.cc:3060] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.551774  9264 leader_election.cc:290] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:04:58.553169  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:04:58.553957  9209 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 0 FOLLOWER]: Advancing to term 2
W20260709 13:04:58.555428  9102 leader_election.cc:336] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.559283  9350 raft_consensus.cc:515] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.562462  9209 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 2.
I20260709 13:04:58.562588  9350 leader_election.cc:290] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:04:58.563349  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc15f780faa94e578d3a3babc11ff5cf" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:04:58.564016  9135 raft_consensus.cc:3060] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.564416  9100 leader_election.cc:304] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:58.565219  9264 raft_consensus.cc:2804] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.565737  9264 raft_consensus.cc:697] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
W20260709 13:04:58.567065  9176 leader_election.cc:336] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111)
I20260709 13:04:58.567313  9264 consensus_queue.cc:237] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.572732  9135 raft_consensus.cc:2468] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 2.
I20260709 13:04:58.574136  9174 leader_election.cc:304] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, 583be3faf9fc43b0a0eb708425901bdd; no voters: f4806c167f014f00aec4fa5de21fbedc
I20260709 13:04:58.575026  9350 raft_consensus.cc:2804] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.574554  8956 catalog_manager.cc:5697] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 1 to 2, leader changed from f4806c167f014f00aec4fa5de21fbedc (127.0.107.193) to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.575558  9350 raft_consensus.cc:697] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:04:58.576494  9350 consensus_queue.cc:237] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:04:58.585908  8958 catalog_manager.cc:5697] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 1 to 2, leader changed from f4806c167f014f00aec4fa5de21fbedc (127.0.107.193) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 2 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:58.669926  9102 consensus_peers.cc:597] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.772117  9209 raft_consensus.cc:1275] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:58.773602  9300 consensus_queue.cc:1048] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:58.787638  9210 raft_consensus.cc:1275] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.789935  9300 consensus_queue.cc:1048] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:58.793648  9102 consensus_peers.cc:597] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:58.806504  9135 raft_consensus.cc:1275] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.807986  9350 consensus_queue.cc:1048] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:58.822194  9176 consensus_peers.cc:597] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:58.957839  9102 consensus_peers.cc:597] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.053442  9209 raft_consensus.cc:1275] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.055590  9300 consensus_queue.cc:1048] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:59.069048  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:04:59.160002  9135 raft_consensus.cc:1275] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.162031  9360 consensus_queue.cc:1048] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:59.175446  9176 consensus_peers.cc:597] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:59.847296  9102 consensus_peers.cc:597] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:04:59.908555  9102 consensus_peers.cc:597] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:00.034387  9102 consensus_peers.cc:597] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:00.067212  9102 consensus_peers.cc:597] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:00.070144  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:00.133416  9176 consensus_peers.cc:597] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:01.071530  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:01.177635  9102 consensus_peers.cc:597] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:01.210711  9102 consensus_peers.cc:597] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:01.465466  9102 consensus_peers.cc:597] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:01.584668  9176 consensus_peers.cc:597] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:01.648911  9176 consensus_peers.cc:597] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:05:02.072691  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:05:02.135133  9102 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111) [suppressed 97 similar messages]
W20260709 13:05:02.138268  9102 consensus_peers.cc:597] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:05:02.228793   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:02.238283  9369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:02.238857  9368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:02.239336  9371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:02.242635   431 server_base.cc:1061] running on GCE node
I20260709 13:05:02.243965   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:02.244340   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:02.244578   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602302244558 us; error 0 us; skew 500 ppm
I20260709 13:05:02.245267   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:02.248001   431 webserver.cc:533] Webserver started at http://127.0.107.193:40895/ using document root <none> and password file <none>
I20260709 13:05:02.248664   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:02.248875   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:05:02.253142   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:05:02.258170  9376 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:02.259294   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:05:02.259799   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "f4806c167f014f00aec4fa5de21fbedc"
format_stamp: "Formatted at 2026-07-09 13:04:55 on dist-test-slave-smzk"
I20260709 13:05:02.260282   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:02.281298   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:02.282606   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:02.284533   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:02.288630  9383 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:05:02.344211   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:05:02.344493   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.000s	sys 0.003s
I20260709 13:05:02.344717   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:05:02.349241  9383 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.365634  9383 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.366667  9383 tablet_bootstrap.cc:492] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.367328  9383 ts_tablet_manager.cc:1403] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.006s
I20260709 13:05:02.369570  9383 raft_consensus.cc:359] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.370134  9383 raft_consensus.cc:740] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.370822  9383 consensus_queue.cc:260] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.373281  9383 ts_tablet_manager.cc:1434] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:05:02.374037  9383 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.385363  9383 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.386144  9383 tablet_bootstrap.cc:492] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.386833  9383 ts_tablet_manager.cc:1403] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:05:02.388947  9383 raft_consensus.cc:359] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.389482  9383 raft_consensus.cc:740] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.390123  9383 consensus_queue.cc:260] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.391731  9383 ts_tablet_manager.cc:1434] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:05:02.392540  9383 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.397109   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:05:02.397466   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.053s	user 0.052s	sys 0.001s
I20260709 13:05:02.407156  9383 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.408569  9383 tablet_bootstrap.cc:492] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.409186  9383 ts_tablet_manager.cc:1403] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.006s
I20260709 13:05:02.411387  9383 raft_consensus.cc:359] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.412377  9383 raft_consensus.cc:740] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.413311  9383 consensus_queue.cc:260] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.415704  9383 ts_tablet_manager.cc:1434] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:05:02.416730  9383 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.433786  9383 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.435201  9383 tablet_bootstrap.cc:492] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.436141  9383 ts_tablet_manager.cc:1403] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 13:05:02.439508  9383 raft_consensus.cc:359] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.440451  9383 raft_consensus.cc:740] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.441394  9383 consensus_queue.cc:260] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.444221  9383 ts_tablet_manager.cc:1434] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:02.445374  9383 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.462021   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40685
I20260709 13:05:02.462185  9445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40685 every 8 connection(s)
I20260709 13:05:02.462311  9383 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:02.463526  9383 tablet_bootstrap.cc:492] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.464184  9383 ts_tablet_manager.cc:1403] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:05:02.466114  9383 raft_consensus.cc:359] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.466830  9383 raft_consensus.cc:740] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.467705  9383 consensus_queue.cc:260] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.469702  9383 ts_tablet_manager.cc:1434] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:02.468055   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:02.470752  9383 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.487778  9383 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.489042  9383 tablet_bootstrap.cc:492] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.489867  9383 ts_tablet_manager.cc:1403] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:05:02.492884  9383 raft_consensus.cc:359] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.493654  9383 raft_consensus.cc:740] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.494377  9383 consensus_queue.cc:260] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.496656  9383 ts_tablet_manager.cc:1434] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:05:02.497784  9383 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.505492  9446 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46219
I20260709 13:05:02.506098  9446 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:02.507099  9446 heartbeater.cc:507] Master 127.0.107.254:46219 requested a full tablet report, sending...
I20260709 13:05:02.510135  9136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
mode: GRACEFUL
new_leader_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:60722
I20260709 13:05:02.511091  9136 raft_consensus.cc:606] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Received request to transfer leadership to TS 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:05:02.515717  9136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dff878d846e4d399d9f253772badf26"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
mode: GRACEFUL
new_leader_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:60722
I20260709 13:05:02.516371  9136 raft_consensus.cc:606] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Received request to transfer leadership to TS 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:05:02.517220  8956 ts_manager.cc:194] Re-registered known tserver with Master: f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:05:02.519248  9136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67dbae942ab248fa91a99e872b3418b9"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
mode: GRACEFUL
new_leader_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:60722
I20260709 13:05:02.519896  9136 raft_consensus.cc:606] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Received request to transfer leadership to TS 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:05:02.521241   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:02.521766   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:02.522385   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:02.523051  9383 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.524399  9383 tablet_bootstrap.cc:492] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.525143  9383 ts_tablet_manager.cc:1403] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.007s
I20260709 13:05:02.528023  9383 raft_consensus.cc:359] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.528842  9383 raft_consensus.cc:740] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.529568  9383 consensus_queue.cc:260] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.529872  8956 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46320
I20260709 13:05:02.531611  9383 ts_tablet_manager.cc:1434] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:02.532661  9383 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.533589  9446 heartbeater.cc:499] Master 127.0.107.254:46219 was elected leader, sending a full tablet report...
I20260709 13:05:02.546914  9383 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.548134  9383 tablet_bootstrap.cc:492] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.548981  9383 ts_tablet_manager.cc:1403] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:05:02.551991  9383 raft_consensus.cc:359] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.552876  9383 raft_consensus.cc:740] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.553706  9383 consensus_queue.cc:260] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.556145  9383 ts_tablet_manager.cc:1434] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:05:02.557231  9383 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.571112  9383 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.571986  9383 tablet_bootstrap.cc:492] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.572670  9383 ts_tablet_manager.cc:1403] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:05:02.574716  9383 raft_consensus.cc:359] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.575402  9383 raft_consensus.cc:740] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.576162  9383 consensus_queue.cc:260] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.578294  9383 ts_tablet_manager.cc:1434] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:02.579196  9383 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap starting.
I20260709 13:05:02.594664  9383 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:02.595503  9383 tablet_bootstrap.cc:492] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Bootstrap complete.
I20260709 13:05:02.596194  9383 ts_tablet_manager.cc:1403] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:05:02.598300  9383 raft_consensus.cc:359] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:05:02.598877  9383 raft_consensus.cc:740] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4806c167f014f00aec4fa5de21fbedc, State: Initialized, Role: FOLLOWER
I20260709 13:05:02.599596  9383 consensus_queue.cc:260] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:05:02.602087  9383 ts_tablet_manager.cc:1434] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:02.603605  9420 raft_consensus.cc:3060] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.604111  9419 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.615669  9418 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.626516  9418 pending_rounds.cc:85] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Aborting all ops after (but not including) 0
I20260709 13:05:02.626834  9418 pending_rounds.cc:107] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:05:02.627097  9418 raft_consensus.cc:2889] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:02.644443  9418 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.657929  9467 raft_consensus.cc:993] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d: : Instructing follower 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:02.658679  9454 raft_consensus.cc:1081] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Signalling peer 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:02.660429  9209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:32938
I20260709 13:05:02.660995  9209 raft_consensus.cc:493] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.661324  9209 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.667484  9209 raft_consensus.cc:515] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.671471  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:02.671845  9209 leader_election.cc:290] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 3 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:05:02.672168  9419 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.672529  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:05:02.673121  9136 raft_consensus.cc:3055] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:02.673471  9136 raft_consensus.cc:740] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:02.674295  9136 consensus_queue.cc:260] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.675860  9136 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.680922  9419 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 3.
I20260709 13:05:02.682927  9176 leader_election.cc:304] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:02.684125  9367 raft_consensus.cc:2804] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:02.684029  9136 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 3.
I20260709 13:05:02.686591  9367 raft_consensus.cc:697] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:02.687486  9367 consensus_queue.cc:237] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.697394  8956 catalog_manager.cc:5697] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 2 to 3, leader changed from 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 3 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:02.739913  9454 raft_consensus.cc:993] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d: : Instructing follower 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:02.740602  9454 raft_consensus.cc:1081] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Signalling peer 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:02.742394  9209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dff878d846e4d399d9f253772badf26"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:32938
I20260709 13:05:02.742985  9209 raft_consensus.cc:493] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.743315  9209 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.749584  9209 raft_consensus.cc:515] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.751435  9209 leader_election.cc:290] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 3 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:05:02.752573  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:02.752712  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:05:02.753419  9419 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.753520  9136 raft_consensus.cc:3055] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:02.754042  9136 raft_consensus.cc:740] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:02.754746  9136 consensus_queue.cc:260] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.755745  9136 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:02.760982  9467 raft_consensus.cc:993] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d: : Instructing follower 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:02.761680  9454 raft_consensus.cc:1081] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Signalling peer 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:02.762403  9419 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 3.
I20260709 13:05:02.762960  9136 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 3.
I20260709 13:05:02.763903  9209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67dbae942ab248fa91a99e872b3418b9"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:32938
I20260709 13:05:02.764071  9176 leader_election.cc:304] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:02.764685  9209 raft_consensus.cc:493] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.765105  9209 raft_consensus.cc:3060] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.764976  9367 raft_consensus.cc:2804] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:02.765844  9367 raft_consensus.cc:697] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:02.766630  9367 consensus_queue.cc:237] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.772562  9209 raft_consensus.cc:515] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.775079  9209 leader_election.cc:290] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:05:02.775503  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbae942ab248fa91a99e872b3418b9" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:02.775770  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dbae942ab248fa91a99e872b3418b9" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:05:02.775513  8956 catalog_manager.cc:5697] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 2 to 3, leader changed from 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 3 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:02.776602  9419 raft_consensus.cc:3060] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.776683  9136 raft_consensus.cc:3055] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:02.777298  9136 raft_consensus.cc:740] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:02.778143  9136 consensus_queue.cc:260] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.779472  9136 raft_consensus.cc:3060] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.783706  9419 raft_consensus.cc:2468] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 2.
I20260709 13:05:02.785200  9176 leader_election.cc:304] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:02.786194  9367 raft_consensus.cc:2804] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:02.786952  9367 raft_consensus.cc:697] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:02.787833  9136 raft_consensus.cc:2468] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 2.
I20260709 13:05:02.787828  9367 consensus_queue.cc:237] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:02.795547  8956 catalog_manager.cc:5697] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 1 to 2, leader changed from 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 2 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:03.093542  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:03.123876  9136 raft_consensus.cc:1275] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.126675  9367 consensus_queue.cc:1048] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:03.143510  9418 raft_consensus.cc:1275] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.147157  9468 consensus_queue.cc:1048] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:03.211211  9418 raft_consensus.cc:1275] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.213840  9476 consensus_queue.cc:1048] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.227440  9136 raft_consensus.cc:1275] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.230449  9367 consensus_queue.cc:1048] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.326799  9136 raft_consensus.cc:1275] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.328859  9476 consensus_queue.cc:1048] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:03.334391  9418 raft_consensus.cc:1275] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.336736  9483 consensus_queue.cc:1048] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.530558   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.554251  9209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dff878d846e4d399d9f253772badf26"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
mode: GRACEFUL
new_leader_uuid: "153a206e54f742dfad45af86fdd8ba8d"
 from {username='slave'} at 127.0.0.1:44796
I20260709 13:05:03.554908  9209 raft_consensus.cc:606] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Received request to transfer leadership to TS 153a206e54f742dfad45af86fdd8ba8d
I20260709 13:05:03.558005  9209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
mode: GRACEFUL
new_leader_uuid: "153a206e54f742dfad45af86fdd8ba8d"
 from {username='slave'} at 127.0.0.1:44796
I20260709 13:05:03.558507  9209 raft_consensus.cc:606] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Received request to transfer leadership to TS 153a206e54f742dfad45af86fdd8ba8d
I20260709 13:05:03.559592   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:03.560348   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:03.561105   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.733112  9483 raft_consensus.cc:993] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd: : Instructing follower 153a206e54f742dfad45af86fdd8ba8d to start an election
I20260709 13:05:03.733666  9476 raft_consensus.cc:1081] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Signalling peer 153a206e54f742dfad45af86fdd8ba8d to start an election
I20260709 13:05:03.735502  9136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
 from {username='slave'} at 127.0.0.1:53622
I20260709 13:05:03.736232  9136 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.736653  9136 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.746863  9136 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:05:03.749967  9136 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 3 election: Requested vote from peers 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003), f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:05:03.750365  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:05:03.750967  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:03.751291  9209 raft_consensus.cc:3055] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.751793  9209 raft_consensus.cc:740] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:03.751821  9418 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.754390  9209 consensus_queue.cc:260] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:05:03.756565  9209 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.764261  9418 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 3.
I20260709 13:05:03.766049  9102 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:03.766970  9301 raft_consensus.cc:2804] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:03.767452  9209 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 3.
I20260709 13:05:03.767463  9301 raft_consensus.cc:697] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 3 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:03.769192  9301 consensus_queue.cc:237] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:05:03.777076  8956 catalog_manager.cc:5697] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 2 to 3, leader changed from 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195) to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.898339  9367 raft_consensus.cc:993] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd: : Instructing follower 153a206e54f742dfad45af86fdd8ba8d to start an election
I20260709 13:05:03.898916  9476 raft_consensus.cc:1081] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Signalling peer 153a206e54f742dfad45af86fdd8ba8d to start an election
I20260709 13:05:03.900600  9136 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dff878d846e4d399d9f253772badf26"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
 from {username='slave'} at 127.0.0.1:53622
I20260709 13:05:03.901072  9136 raft_consensus.cc:493] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.901328  9136 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.907888  9136 raft_consensus.cc:515] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:03.910051  9136 leader_election.cc:290] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 4 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:05:03.911412  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:05:03.911537  9419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:03.912295  9209 raft_consensus.cc:3055] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:03.912458  9419 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.912647  9209 raft_consensus.cc:740] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:03.913856  9209 consensus_queue.cc:260] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:03.915169  9209 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:03.919963  9419 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 4.
I20260709 13:05:03.921819  9102 leader_election.cc:304] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:03.922365  9209 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 4.
I20260709 13:05:03.922719  9301 raft_consensus.cc:2804] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:03.923487  9301 raft_consensus.cc:697] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 4 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:03.924710  9301 consensus_queue.cc:237] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:03.932485  8956 catalog_manager.cc:5697] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 3 to 4, leader changed from 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195) to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 4 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:04.097002  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:04.233552  9209 raft_consensus.cc:1275] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.234992  9301 consensus_queue.cc:1048] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:04.247257  9419 raft_consensus.cc:1275] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:04.249289  9301 consensus_queue.cc:1048] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:04.479221  9209 raft_consensus.cc:1275] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:04.481129  9301 consensus_queue.cc:1048] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:04.494684  9418 raft_consensus.cc:1275] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:04.497337  9488 consensus_queue.cc:1048] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:04.568238   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:04.576826  9136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
mode: GRACEFUL
new_leader_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:60722
I20260709 13:05:04.577541  9136 raft_consensus.cc:606] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Received request to transfer leadership to TS 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:05:04.581025  9136 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
mode: GRACEFUL
new_leader_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:60722
I20260709 13:05:04.581535  9136 raft_consensus.cc:606] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 3 LEADER]: Received request to transfer leadership to TS 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:05:04.582686   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:04.583294   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:04.583952   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:04.716967  9301 raft_consensus.cc:993] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d: : Instructing follower 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:04.717511  9488 raft_consensus.cc:1081] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 3 LEADER]: Signalling peer 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:04.719333  9209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:32938
I20260709 13:05:04.719872  9209 raft_consensus.cc:493] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.720230  9209 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.726495  9209 raft_consensus.cc:515] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:05:04.728668  9209 leader_election.cc:290] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 4 election: Requested vote from peers 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399), f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685)
I20260709 13:05:04.729672  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:05:04.730001  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7434e8754c334ff58af799b5f0fe4d30" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:04.730502  9136 raft_consensus.cc:3055] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:04.730718  9418 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.731067  9136 raft_consensus.cc:740] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:04.732168  9136 consensus_queue.cc:260] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:05:04.733460  9136 raft_consensus.cc:3060] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.738682  9418 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 4.
I20260709 13:05:04.740651  9176 leader_election.cc:304] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:04.740895  9136 raft_consensus.cc:2468] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 4.
I20260709 13:05:04.741641  9476 raft_consensus.cc:2804] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:04.742446  9476 raft_consensus.cc:697] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 4 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:04.743549  9476 consensus_queue.cc:237] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } }
I20260709 13:05:04.750957  8956 catalog_manager.cc:5697] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 3 to 4, leader changed from 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 4 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.054193  9301 raft_consensus.cc:993] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d: : Instructing follower 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:05.054702  9488 raft_consensus.cc:1081] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Signalling peer 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:05.056411  9209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:32938
I20260709 13:05:05.056890  9209 raft_consensus.cc:493] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:05.057161  9209 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.064584  9209 raft_consensus.cc:515] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.066443  9209 leader_election.cc:290] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:05:05.067498  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:05.067683  9136 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:05:05.068292  9418 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.068480  9136 raft_consensus.cc:3055] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:05.069013  9136 raft_consensus.cc:740] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:05.070008  9136 consensus_queue.cc:260] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.071122  9136 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.075063  9418 raft_consensus.cc:2468] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 2.
I20260709 13:05:05.076648  9176 leader_election.cc:304] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:05.076719  9136 raft_consensus.cc:2468] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 2.
I20260709 13:05:05.077559  9476 raft_consensus.cc:2804] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.078111  9476 raft_consensus.cc:697] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:05.079452  9476 consensus_queue.cc:237] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.088090  8956 catalog_manager.cc:5697] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 1 to 2, leader changed from 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 2 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:05.097993  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:05.138243  9136 raft_consensus.cc:1275] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:05.140355  9476 consensus_queue.cc:1048] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:05.155203  9418 raft_consensus.cc:1275] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:05.156735  9509 consensus_queue.cc:1048] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:05.591786   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:05.599647  9209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
mode: GRACEFUL
new_leader_uuid: "153a206e54f742dfad45af86fdd8ba8d"
 from {username='slave'} at 127.0.0.1:44796
I20260709 13:05:05.600382  9209 raft_consensus.cc:606] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Received request to transfer leadership to TS 153a206e54f742dfad45af86fdd8ba8d
I20260709 13:05:05.603495  9209 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
mode: GRACEFUL
new_leader_uuid: "153a206e54f742dfad45af86fdd8ba8d"
 from {username='slave'} at 127.0.0.1:44796
I20260709 13:05:05.604102  9209 raft_consensus.cc:606] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Received request to transfer leadership to TS 153a206e54f742dfad45af86fdd8ba8d
I20260709 13:05:05.605790   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:05.605997  9135 raft_consensus.cc:1275] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:05.606652   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:05.607409   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:05.607698  9509 consensus_queue.cc:1048] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:05.617862  9503 raft_consensus.cc:993] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd: : Instructing follower 153a206e54f742dfad45af86fdd8ba8d to start an election
I20260709 13:05:05.618731  9509 raft_consensus.cc:1081] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Signalling peer 153a206e54f742dfad45af86fdd8ba8d to start an election
I20260709 13:05:05.623226  9135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
 from {username='slave'} at 127.0.0.1:53622
I20260709 13:05:05.623992  9135 raft_consensus.cc:493] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:05.624393  9418 raft_consensus.cc:1275] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:05.624522  9135 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:05.626456  9503 consensus_queue.cc:1048] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.635160  9135 raft_consensus.cc:515] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.638002  9135 leader_election.cc:290] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 3 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:05:05.639925  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:05.640758  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ef79c24d2624c928e7ef410388387f0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:05:05.640923  9418 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:05.641415  9209 raft_consensus.cc:3055] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:05.641840  9209 raft_consensus.cc:740] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:05.642635  9209 consensus_queue.cc:260] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.643993  9209 raft_consensus.cc:3060] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:05.650121  9418 raft_consensus.cc:2468] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 3.
I20260709 13:05:05.651289  9209 raft_consensus.cc:2468] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 3.
I20260709 13:05:05.652323  9102 leader_election.cc:304] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:05.653443  9301 raft_consensus.cc:2804] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:05.653898  9301 raft_consensus.cc:697] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:05.654640  9301 consensus_queue.cc:237] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.661943  8956 catalog_manager.cc:5697] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 2 to 3, leader changed from 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195) to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.889179  9514 raft_consensus.cc:993] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd: : Instructing follower 153a206e54f742dfad45af86fdd8ba8d to start an election
I20260709 13:05:05.889753  9514 raft_consensus.cc:1081] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Signalling peer 153a206e54f742dfad45af86fdd8ba8d to start an election
I20260709 13:05:05.891875  9135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
 from {username='slave'} at 127.0.0.1:53622
I20260709 13:05:05.892422  9135 raft_consensus.cc:493] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:05.892725  9135 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.899086  9135 raft_consensus.cc:515] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.901221  9135 leader_election.cc:290] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 4 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195:37003)
I20260709 13:05:05.902467  9209 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
I20260709 13:05:05.903074  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a5db7b1f17f4270866f0a813e2dfbd0" candidate_uuid: "153a206e54f742dfad45af86fdd8ba8d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:05.903102  9209 raft_consensus.cc:3055] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:05.903779  9418 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.903859  9209 raft_consensus.cc:740] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:05.904984  9209 consensus_queue.cc:260] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.905972  9209 raft_consensus.cc:3060] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.910579  9418 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 4.
I20260709 13:05:05.911608  9209 raft_consensus.cc:2468] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 153a206e54f742dfad45af86fdd8ba8d in term 4.
I20260709 13:05:05.912089  9102 leader_election.cc:304] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 153a206e54f742dfad45af86fdd8ba8d, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:05.913026  9301 raft_consensus.cc:2804] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:05.913470  9301 raft_consensus.cc:697] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 4 LEADER]: Becoming Leader. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:05.914335  9301 consensus_queue.cc:237] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:05.922863  8956 catalog_manager.cc:5697] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d reported cstate change: term changed from 3 to 4, leader changed from 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195) to 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194). New cstate: current_term: 4 leader_uuid: "153a206e54f742dfad45af86fdd8ba8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.055568  9209 raft_consensus.cc:1275] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:06.057392  9301 consensus_queue.cc:1048] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.066324  9418 raft_consensus.cc:1275] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:06.068389  9301 consensus_queue.cc:1048] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:06.099300  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:06.335810  9209 raft_consensus.cc:1275] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:06.337368  9301 consensus_queue.cc:1048] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.349309  9418 raft_consensus.cc:1275] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Refusing update from remote peer 153a206e54f742dfad45af86fdd8ba8d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:06.351979  9488 consensus_queue.cc:1048] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:06.618603   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:06.627576  9135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dff878d846e4d399d9f253772badf26"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
mode: GRACEFUL
new_leader_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:60722
I20260709 13:05:06.628340  9135 raft_consensus.cc:606] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 4 LEADER]: Received request to transfer leadership to TS 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:05:06.631333  9135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436"
dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
mode: GRACEFUL
new_leader_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:60722
I20260709 13:05:06.632006  9135 raft_consensus.cc:606] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Received request to transfer leadership to TS 583be3faf9fc43b0a0eb708425901bdd
I20260709 13:05:06.633369   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:06.633986   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:06.634634   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:06.745743  9301 raft_consensus.cc:993] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d: : Instructing follower 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:06.746346  9301 raft_consensus.cc:1081] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Signalling peer 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:06.748310  9209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:32938
I20260709 13:05:06.748976  9209 raft_consensus.cc:493] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.749264  9209 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:06.754383  9209 raft_consensus.cc:515] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:06.755892  9209 leader_election.cc:290] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 3 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:05:06.757167  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:06.757207  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d08805b2d06e4b0b85425c54f1b83436" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:05:06.757876  9418 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:06.758121  9135 raft_consensus.cc:3055] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:06.758646  9135 raft_consensus.cc:740] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:06.759724  9135 consensus_queue.cc:260] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:06.761004  9135 raft_consensus.cc:3060] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:06.764573  9418 raft_consensus.cc:2468] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 3.
I20260709 13:05:06.766297  9176 leader_election.cc:304] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:06.767241  9514 raft_consensus.cc:2804] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:06.769292  9135 raft_consensus.cc:2468] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 3.
I20260709 13:05:06.769944  9514 raft_consensus.cc:697] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:06.771459  9514 consensus_queue.cc:237] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:06.784288  8956 catalog_manager.cc:5697] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 2 to 3, leader changed from 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 3 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:07.100483  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:07.110245  9488 raft_consensus.cc:993] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d: : Instructing follower 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:07.110904  9301 raft_consensus.cc:1081] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 4 LEADER]: Signalling peer 583be3faf9fc43b0a0eb708425901bdd to start an election
I20260709 13:05:07.112624  9209 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dff878d846e4d399d9f253772badf26"
dest_uuid: "583be3faf9fc43b0a0eb708425901bdd"
 from {username='slave'} at 127.0.0.1:32938
I20260709 13:05:07.113070  9209 raft_consensus.cc:493] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.113319  9209 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.118860  9209 raft_consensus.cc:515] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:07.120448  9209 leader_election.cc:290] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 5 election: Requested vote from peers f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685), 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399)
I20260709 13:05:07.121502  9418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f4806c167f014f00aec4fa5de21fbedc"
I20260709 13:05:07.121680  9135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dff878d846e4d399d9f253772badf26" candidate_uuid: "583be3faf9fc43b0a0eb708425901bdd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "153a206e54f742dfad45af86fdd8ba8d"
I20260709 13:05:07.122131  9418 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.122231  9135 raft_consensus.cc:3055] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:07.122594  9135 raft_consensus.cc:740] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 153a206e54f742dfad45af86fdd8ba8d, State: Running, Role: LEADER
I20260709 13:05:07.123436  9135 consensus_queue.cc:260] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:07.124763  9135 raft_consensus.cc:3060] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.129122  9418 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 5.
I20260709 13:05:07.130487  9176 leader_election.cc:304] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 583be3faf9fc43b0a0eb708425901bdd, f4806c167f014f00aec4fa5de21fbedc; no voters: 
I20260709 13:05:07.131299  9514 raft_consensus.cc:2804] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:07.131421  9135 raft_consensus.cc:2468] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 583be3faf9fc43b0a0eb708425901bdd in term 5.
I20260709 13:05:07.131819  9514 raft_consensus.cc:697] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 5 LEADER]: Becoming Leader. State: Replica: 583be3faf9fc43b0a0eb708425901bdd, State: Running, Role: LEADER
I20260709 13:05:07.132948  9514 consensus_queue.cc:237] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } }
I20260709 13:05:07.140288  8956 catalog_manager.cc:5697] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd reported cstate change: term changed from 4 to 5, leader changed from 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194) to 583be3faf9fc43b0a0eb708425901bdd (127.0.107.195). New cstate: current_term: 5 leader_uuid: "583be3faf9fc43b0a0eb708425901bdd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "583be3faf9fc43b0a0eb708425901bdd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 37003 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.171604  9135 raft_consensus.cc:1275] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:07.173372  9514 consensus_queue.cc:1048] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:07.186534  9419 raft_consensus.cc:1275] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:07.189086  9525 consensus_queue.cc:1048] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:07.539141  9135 raft_consensus.cc:1275] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 5 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:07.540604  9525 consensus_queue.cc:1048] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "153a206e54f742dfad45af86fdd8ba8d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:07.550191  9418 raft_consensus.cc:1275] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 5 FOLLOWER]: Refusing update from remote peer 583be3faf9fc43b0a0eb708425901bdd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:07.551534  9525 consensus_queue.cc:1048] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4806c167f014f00aec4fa5de21fbedc" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:07.641301   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:07.677155   431 tablet_server.cc:179] TabletServer@127.0.107.193:40685 shutting down...
I20260709 13:05:07.716753   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:07.718093   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.719473   431 raft_consensus.cc:2243] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.720304   431 raft_consensus.cc:2272] T fe8228ea34704826a221a2ef72d2fe4e P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.723589   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.724463   431 raft_consensus.cc:2243] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.725099   431 raft_consensus.cc:2272] T 7434e8754c334ff58af799b5f0fe4d30 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.728343   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.729136   431 raft_consensus.cc:2243] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.729765   431 raft_consensus.cc:2272] T 5dff878d846e4d399d9f253772badf26 P f4806c167f014f00aec4fa5de21fbedc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.733958   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.734655   431 raft_consensus.cc:2243] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.735216   431 raft_consensus.cc:2272] T fc15f780faa94e578d3a3babc11ff5cf P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.738340   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.739034   431 raft_consensus.cc:2243] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.739565   431 raft_consensus.cc:2272] T d08805b2d06e4b0b85425c54f1b83436 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.743423   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.744805   431 raft_consensus.cc:2243] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.745570   431 raft_consensus.cc:2272] T 67dbae942ab248fa91a99e872b3418b9 P f4806c167f014f00aec4fa5de21fbedc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:07.746006  9176 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 13:05:07.750011   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.751380   431 raft_consensus.cc:2243] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.753361   431 raft_consensus.cc:2272] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.758354   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.759625   431 raft_consensus.cc:2243] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:07.760419  9176 consensus_peers.cc:597] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.760517   431 raft_consensus.cc:2272] T fe9df3206f0c488eabf9af3c3e859cd5 P f4806c167f014f00aec4fa5de21fbedc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:07.763525  9176 consensus_peers.cc:597] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.764394   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.765192   431 raft_consensus.cc:2243] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.765770   431 raft_consensus.cc:2272] T 5a5db7b1f17f4270866f0a813e2dfbd0 P f4806c167f014f00aec4fa5de21fbedc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.768460   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:05:07.769097   431 raft_consensus.cc:2243] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.769671   431 raft_consensus.cc:2272] T 3ef79c24d2624c928e7ef410388387f0 P f4806c167f014f00aec4fa5de21fbedc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.806864   431 tablet_server.cc:196] TabletServer@127.0.107.193:40685 shutdown complete.
I20260709 13:05:07.840481   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:05:07.880123   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:07.881065   431 tablet_replica.cc:333] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.882076   431 raft_consensus.cc:2243] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.882730   431 raft_consensus.cc:2272] T fe9df3206f0c488eabf9af3c3e859cd5 P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.885308   431 tablet_replica.cc:333] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.886034   431 raft_consensus.cc:2243] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.886570   431 raft_consensus.cc:2272] T fc15f780faa94e578d3a3babc11ff5cf P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.888823   431 tablet_replica.cc:333] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.889403   431 raft_consensus.cc:2243] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.889830   431 raft_consensus.cc:2272] T d08805b2d06e4b0b85425c54f1b83436 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.893290   431 tablet_replica.cc:333] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.893940   431 raft_consensus.cc:2243] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.894439   431 raft_consensus.cc:2272] T 67dbae942ab248fa91a99e872b3418b9 P 153a206e54f742dfad45af86fdd8ba8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.896708   431 tablet_replica.cc:333] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.897254   431 raft_consensus.cc:2243] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:07.898141   431 raft_consensus.cc:2272] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.900707   431 tablet_replica.cc:333] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.901252   431 raft_consensus.cc:2243] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.901752   431 raft_consensus.cc:2272] T 7434e8754c334ff58af799b5f0fe4d30 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.904381   431 tablet_replica.cc:333] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.904943   431 raft_consensus.cc:2243] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:07.905385   431 raft_consensus.cc:2272] T 5dff878d846e4d399d9f253772badf26 P 153a206e54f742dfad45af86fdd8ba8d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.908856   431 tablet_replica.cc:333] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.909440   431 raft_consensus.cc:2243] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:07.910420   431 raft_consensus.cc:2272] T fe8228ea34704826a221a2ef72d2fe4e P 153a206e54f742dfad45af86fdd8ba8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.913131   431 tablet_replica.cc:333] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.913695   431 raft_consensus.cc:2243] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:05:07.914479  9176 consensus_peers.cc:597] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:07.914546   431 raft_consensus.cc:2272] T 3ef79c24d2624c928e7ef410388387f0 P 153a206e54f742dfad45af86fdd8ba8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.917312   431 tablet_replica.cc:333] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d: stopping tablet replica
I20260709 13:05:07.917845   431 raft_consensus.cc:2243] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:07.918648   431 raft_consensus.cc:2272] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 153a206e54f742dfad45af86fdd8ba8d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.951740   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:05:07.980492   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:05:07.993883  9176 consensus_peers.cc:597] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd -> Peer f4806c167f014f00aec4fa5de21fbedc (127.0.107.193:40685): Couldn't send request to peer f4806c167f014f00aec4fa5de21fbedc. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.025977   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:08.027055   431 tablet_replica.cc:333] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.027904   431 raft_consensus.cc:2243] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.028836   431 raft_consensus.cc:2272] T d08805b2d06e4b0b85425c54f1b83436 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.032374   431 tablet_replica.cc:333] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.033416   431 raft_consensus.cc:2243] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.034725   431 raft_consensus.cc:2272] T fc15f780faa94e578d3a3babc11ff5cf P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:08.037339  9174 consensus_peers.cc:597] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd -> Peer 153a206e54f742dfad45af86fdd8ba8d (127.0.107.194:35399): Couldn't send request to peer 153a206e54f742dfad45af86fdd8ba8d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:35399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.038132   431 tablet_replica.cc:333] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.039129   431 raft_consensus.cc:2243] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.040108   431 raft_consensus.cc:2272] T 67dbae942ab248fa91a99e872b3418b9 P 583be3faf9fc43b0a0eb708425901bdd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.042322   431 tablet_replica.cc:333] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.042914   431 raft_consensus.cc:2243] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.043439   431 raft_consensus.cc:2272] T 6c69cf48cb0e4e6db10a6be2da5fdd9a P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.045671   431 tablet_replica.cc:333] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.046221   431 raft_consensus.cc:2243] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.047024   431 raft_consensus.cc:2272] T fe9df3206f0c488eabf9af3c3e859cd5 P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.049403   431 tablet_replica.cc:333] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.049966   431 raft_consensus.cc:2243] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.050432   431 raft_consensus.cc:2272] T fe8228ea34704826a221a2ef72d2fe4e P 583be3faf9fc43b0a0eb708425901bdd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.052731   431 tablet_replica.cc:333] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.053339   431 raft_consensus.cc:2243] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.053872   431 raft_consensus.cc:2272] T 3ef79c24d2624c928e7ef410388387f0 P 583be3faf9fc43b0a0eb708425901bdd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.055984   431 tablet_replica.cc:333] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.056620   431 raft_consensus.cc:2243] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.057061   431 raft_consensus.cc:2272] T 5a5db7b1f17f4270866f0a813e2dfbd0 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.059140   431 tablet_replica.cc:333] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.059674   431 raft_consensus.cc:2243] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.060556   431 raft_consensus.cc:2272] T 5dff878d846e4d399d9f253772badf26 P 583be3faf9fc43b0a0eb708425901bdd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.063366   431 tablet_replica.cc:333] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd: stopping tablet replica
I20260709 13:05:08.063956   431 raft_consensus.cc:2243] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.064801   431 raft_consensus.cc:2272] T 7434e8754c334ff58af799b5f0fe4d30 P 583be3faf9fc43b0a0eb708425901bdd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.098029   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:05:08.101568  9008 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:05:08.125536   431 master.cc:562] Master@127.0.107.254:46219 shutting down...
I20260709 13:05:08.157251   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.157881   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.158224   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P bae0c7a9681644628d666237dec7fc00: stopping tablet replica
I20260709 13:05:08.180594   431 master.cc:584] Master@127.0.107.254:46219 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13344 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:05:08.232540   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:38469
I20260709 13:05:08.233752   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:08.240559  9545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.240655  9546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.244824   431 server_base.cc:1061] running on GCE node
W20260709 13:05:08.245060  9548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.246341   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:08.246555   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:08.246668   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602308246658 us; error 0 us; skew 500 ppm
I20260709 13:05:08.247210   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:08.250262   431 webserver.cc:533] Webserver started at http://127.0.107.254:43951/ using document root <none> and password file <none>
I20260709 13:05:08.250731   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:08.250912   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:08.251142   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:08.252377   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/master-0-root/instance:
uuid: "793edb42a8894170afd6e68f65622d95"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-smzk"
I20260709 13:05:08.257153   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:05:08.261332  9553 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.262387   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:08.262786   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/master-0-root
uuid: "793edb42a8894170afd6e68f65622d95"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-smzk"
I20260709 13:05:08.263132   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:08.282536   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:08.283878   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:08.330606   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:38469
I20260709 13:05:08.330778  9604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:38469 every 8 connection(s)
I20260709 13:05:08.335186  9605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.350584  9605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95: Bootstrap starting.
I20260709 13:05:08.357718  9605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.363135  9605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95: No bootstrap required, opened a new log
I20260709 13:05:08.366289  9605 raft_consensus.cc:359] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793edb42a8894170afd6e68f65622d95" member_type: VOTER }
I20260709 13:05:08.366761  9605 raft_consensus.cc:385] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:08.366947  9605 raft_consensus.cc:740] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 793edb42a8894170afd6e68f65622d95, State: Initialized, Role: FOLLOWER
I20260709 13:05:08.367535  9605 consensus_queue.cc:260] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793edb42a8894170afd6e68f65622d95" member_type: VOTER }
I20260709 13:05:08.368271  9605 raft_consensus.cc:399] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:08.368595  9605 raft_consensus.cc:493] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:08.368882  9605 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:08.375515  9605 raft_consensus.cc:515] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793edb42a8894170afd6e68f65622d95" member_type: VOTER }
I20260709 13:05:08.376287  9605 leader_election.cc:304] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 793edb42a8894170afd6e68f65622d95; no voters: 
I20260709 13:05:08.377637  9605 leader_election.cc:290] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:08.378255  9608 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:08.380227  9608 raft_consensus.cc:697] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 1 LEADER]: Becoming Leader. State: Replica: 793edb42a8894170afd6e68f65622d95, State: Running, Role: LEADER
I20260709 13:05:08.381134  9605 sys_catalog.cc:565] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:08.381130  9608 consensus_queue.cc:237] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793edb42a8894170afd6e68f65622d95" member_type: VOTER }
I20260709 13:05:08.388533  9610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 793edb42a8894170afd6e68f65622d95. Latest consensus state: current_term: 1 leader_uuid: "793edb42a8894170afd6e68f65622d95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793edb42a8894170afd6e68f65622d95" member_type: VOTER } }
I20260709 13:05:08.389374  9610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:08.388549  9609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "793edb42a8894170afd6e68f65622d95" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "793edb42a8894170afd6e68f65622d95" member_type: VOTER } }
I20260709 13:05:08.390281  9609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:08.394538  9616 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:08.404441  9616 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:08.405901   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:08.416572  9616 catalog_manager.cc:1383] Generated new cluster ID: 856c24b5af0847d0be2821269a058474
I20260709 13:05:08.416976  9616 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:08.444214  9616 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:08.445842  9616 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:08.458114  9616 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95: Generated new TSK 0
I20260709 13:05:08.458912  9616 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:08.473632   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:08.481148  9626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.482772  9627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.485670  9629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.487938   431 server_base.cc:1061] running on GCE node
I20260709 13:05:08.489209   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:08.489439   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:08.489675   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602308489633 us; error 0 us; skew 500 ppm
I20260709 13:05:08.490324   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:08.493394   431 webserver.cc:533] Webserver started at http://127.0.107.193:44603/ using document root <none> and password file <none>
I20260709 13:05:08.494040   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:08.494252   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:08.494565   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:08.495821   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-0-root/instance:
uuid: "f359ef0ecbc0455080e6fc9044b5705c"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-smzk"
I20260709 13:05:08.501305   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:05:08.506362  9634 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.507467   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:08.507861   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "f359ef0ecbc0455080e6fc9044b5705c"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-smzk"
I20260709 13:05:08.508371   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:08.522034   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:08.523470   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:08.525316   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:08.528365   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:08.528613   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.528904   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:08.529104   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.582273   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34161
I20260709 13:05:08.582412  9696 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34161 every 8 connection(s)
I20260709 13:05:08.588162   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:08.597198  9701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.598905  9702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.602813  9704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.603360   431 server_base.cc:1061] running on GCE node
I20260709 13:05:08.603626  9697 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38469
I20260709 13:05:08.604249  9697 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:08.604955   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:08.605316   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:08.605201  9697 heartbeater.cc:507] Master 127.0.107.254:38469 requested a full tablet report, sending...
I20260709 13:05:08.605765   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602308605742 us; error 0 us; skew 500 ppm
I20260709 13:05:08.606421   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:08.608554  9570 ts_manager.cc:194] Registered new tserver with Master: f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161)
I20260709 13:05:08.609316   431 webserver.cc:533] Webserver started at http://127.0.107.194:38881/ using document root <none> and password file <none>
I20260709 13:05:08.609941   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:08.610189   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:08.610571   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:08.611116  9570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40092
I20260709 13:05:08.612006   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-1-root/instance:
uuid: "49db878da3c847c699498bcb681e2e48"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-smzk"
I20260709 13:05:08.617250   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:05:08.621232  9709 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.622332   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:05:08.622737   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-1-root
uuid: "49db878da3c847c699498bcb681e2e48"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-smzk"
I20260709 13:05:08.623128   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:08.645434   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:08.646679   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:08.648366   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:08.650877   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:08.651124   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.651382   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:08.651557   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.699776   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:38105
I20260709 13:05:08.699926  9771 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:38105 every 8 connection(s)
I20260709 13:05:08.704910   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:08.713382  9775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:08.714527  9776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.718876   431 server_base.cc:1061] running on GCE node
W20260709 13:05:08.719676  9778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:08.720871  9772 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38469
I20260709 13:05:08.721130   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:08.721364  9772 heartbeater.cc:461] Registering TS with master...
W20260709 13:05:08.721549   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:08.721889   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602308721863 us; error 0 us; skew 500 ppm
I20260709 13:05:08.722652   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:08.722667  9772 heartbeater.cc:507] Master 127.0.107.254:38469 requested a full tablet report, sending...
I20260709 13:05:08.725778  9570 ts_manager.cc:194] Registered new tserver with Master: 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105)
I20260709 13:05:08.726416   431 webserver.cc:533] Webserver started at http://127.0.107.195:43299/ using document root <none> and password file <none>
I20260709 13:05:08.727185   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:08.727456   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:08.727803   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:08.727922  9570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40098
I20260709 13:05:08.729715   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-2-root/instance:
uuid: "f414700645bb4bf6a37f0f5dade7008e"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-smzk"
I20260709 13:05:08.735719   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:08.740501  9783 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.741580   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:05:08.742102   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-2-root
uuid: "f414700645bb4bf6a37f0f5dade7008e"
format_stamp: "Formatted at 2026-07-09 13:05:08 on dist-test-slave-smzk"
I20260709 13:05:08.742508   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602014598663-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:08.760192   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:08.761756   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:08.763288   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:08.767014   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:08.767297   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.767683   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:08.767930   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:08.820847   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43901
I20260709 13:05:08.820979  9845 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43901 every 8 connection(s)
I20260709 13:05:08.837791  9846 heartbeater.cc:344] Connected to a master server at 127.0.107.254:38469
I20260709 13:05:08.838339  9846 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:08.839165  9846 heartbeater.cc:507] Master 127.0.107.254:38469 requested a full tablet report, sending...
I20260709 13:05:08.841423  9570 ts_manager.cc:194] Registered new tserver with Master: f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:08.842429   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017722185s
I20260709 13:05:08.842893  9570 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40102
I20260709 13:05:08.873615  9570 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40108:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:08.876317  9570 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:08.937973  9737 tablet_service.cc:1511] Processing CreateTablet for tablet 2204be3b5f724517a659d35df2c29041 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f7d4700b8174c849e9f6588b80416cc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:08.938026  9662 tablet_service.cc:1511] Processing CreateTablet for tablet 2204be3b5f724517a659d35df2c29041 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f7d4700b8174c849e9f6588b80416cc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:08.938920  9661 tablet_service.cc:1511] Processing CreateTablet for tablet c9ed202c6cd54e668f3b3ea1fa0e60ea (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f7d4700b8174c849e9f6588b80416cc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:08.939783  9737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2204be3b5f724517a659d35df2c29041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.939957  9662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2204be3b5f724517a659d35df2c29041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.940733  9661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ed202c6cd54e668f3b3ea1fa0e60ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.938277  9736 tablet_service.cc:1511] Processing CreateTablet for tablet c9ed202c6cd54e668f3b3ea1fa0e60ea (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f7d4700b8174c849e9f6588b80416cc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:08.943619  9736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ed202c6cd54e668f3b3ea1fa0e60ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.965013  9862 tablet_bootstrap.cc:492] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48: Bootstrap starting.
I20260709 13:05:08.966706  9861 tablet_bootstrap.cc:492] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c: Bootstrap starting.
I20260709 13:05:08.970160  9811 tablet_service.cc:1511] Processing CreateTablet for tablet 2204be3b5f724517a659d35df2c29041 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f7d4700b8174c849e9f6588b80416cc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:08.971963  9811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2204be3b5f724517a659d35df2c29041. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.972352  9810 tablet_service.cc:1511] Processing CreateTablet for tablet c9ed202c6cd54e668f3b3ea1fa0e60ea (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=2f7d4700b8174c849e9f6588b80416cc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:08.973963  9862 tablet_bootstrap.cc:654] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.974040  9810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ed202c6cd54e668f3b3ea1fa0e60ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.989436  9861 tablet_bootstrap.cc:654] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:08.999241  9862 tablet_bootstrap.cc:492] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48: No bootstrap required, opened a new log
I20260709 13:05:09.000121  9862 ts_tablet_manager.cc:1403] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.010s
I20260709 13:05:09.002151  9864 tablet_bootstrap.cc:492] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e: Bootstrap starting.
I20260709 13:05:09.003244  9861 tablet_bootstrap.cc:492] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c: No bootstrap required, opened a new log
I20260709 13:05:09.003841  9861 ts_tablet_manager.cc:1403] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.000s
I20260709 13:05:09.004403  9862 raft_consensus.cc:359] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.005301  9862 raft_consensus.cc:385] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.005728  9862 raft_consensus.cc:740] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.006649  9862 consensus_queue.cc:260] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.007385  9861 raft_consensus.cc:359] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.008354  9861 raft_consensus.cc:385] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.008669  9861 raft_consensus.cc:740] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.009886  9772 heartbeater.cc:499] Master 127.0.107.254:38469 was elected leader, sending a full tablet report...
I20260709 13:05:09.010535  9864 tablet_bootstrap.cc:654] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.011264  9862 ts_tablet_manager.cc:1434] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:05:09.012774  9862 tablet_bootstrap.cc:492] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48: Bootstrap starting.
I20260709 13:05:09.016487  9861 consensus_queue.cc:260] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.020174  9862 tablet_bootstrap.cc:654] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.030511  9697 heartbeater.cc:499] Master 127.0.107.254:38469 was elected leader, sending a full tablet report...
I20260709 13:05:09.031847  9864 tablet_bootstrap.cc:492] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e: No bootstrap required, opened a new log
I20260709 13:05:09.032137  9861 ts_tablet_manager.cc:1434] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.012s
I20260709 13:05:09.032508  9864 ts_tablet_manager.cc:1403] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.007s
I20260709 13:05:09.033375  9861 tablet_bootstrap.cc:492] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c: Bootstrap starting.
I20260709 13:05:09.035727  9864 raft_consensus.cc:359] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.036583  9864 raft_consensus.cc:385] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.036892  9864 raft_consensus.cc:740] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f414700645bb4bf6a37f0f5dade7008e, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.037859  9864 consensus_queue.cc:260] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.038537  9862 tablet_bootstrap.cc:492] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48: No bootstrap required, opened a new log
I20260709 13:05:09.039399  9862 ts_tablet_manager.cc:1403] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.007s
I20260709 13:05:09.043244  9862 raft_consensus.cc:359] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.044114  9861 tablet_bootstrap.cc:654] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.044116  9862 raft_consensus.cc:385] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.045353  9862 raft_consensus.cc:740] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.046718  9862 consensus_queue.cc:260] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.047425  9864 ts_tablet_manager.cc:1434] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:05:09.048409  9846 heartbeater.cc:499] Master 127.0.107.254:38469 was elected leader, sending a full tablet report...
I20260709 13:05:09.049291  9862 ts_tablet_manager.cc:1434] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:05:09.053548  9864 tablet_bootstrap.cc:492] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e: Bootstrap starting.
I20260709 13:05:09.060263  9861 tablet_bootstrap.cc:492] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c: No bootstrap required, opened a new log
I20260709 13:05:09.062495  9861 ts_tablet_manager.cc:1403] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.005s
I20260709 13:05:09.064792  9864 tablet_bootstrap.cc:654] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.066123  9861 raft_consensus.cc:359] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.066887  9861 raft_consensus.cc:385] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.067155  9861 raft_consensus.cc:740] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.067971  9861 consensus_queue.cc:260] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.070053  9861 ts_tablet_manager.cc:1434] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:09.074846  9864 tablet_bootstrap.cc:492] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e: No bootstrap required, opened a new log
I20260709 13:05:09.075520  9864 ts_tablet_manager.cc:1403] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:05:09.078204  9864 raft_consensus.cc:359] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.078869  9864 raft_consensus.cc:385] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.079205  9864 raft_consensus.cc:740] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f414700645bb4bf6a37f0f5dade7008e, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.080017  9864 consensus_queue.cc:260] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.082309  9864 ts_tablet_manager.cc:1434] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:05:09.214083  9868 raft_consensus.cc:493] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.214977  9868 raft_consensus.cc:515] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.216327  9866 raft_consensus.cc:493] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.216952  9866 raft_consensus.cc:515] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.217399  9868 leader_election.cc:290] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.225574  9866 leader_election.cc:290] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.240690  9747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49db878da3c847c699498bcb681e2e48" is_pre_election: true
I20260709 13:05:09.241916  9747 raft_consensus.cc:2468] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 0.
I20260709 13:05:09.244061  9635 leader_election.cc:304] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f359ef0ecbc0455080e6fc9044b5705c; no voters: 
I20260709 13:05:09.245844  9868 raft_consensus.cc:2804] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.246387  9868 raft_consensus.cc:493] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.246819  9868 raft_consensus.cc:3060] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.256641  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c" is_pre_election: true
I20260709 13:05:09.257879  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e" is_pre_election: true
I20260709 13:05:09.258301  9868 raft_consensus.cc:515] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.258622  9821 raft_consensus.cc:2468] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 0.
I20260709 13:05:09.259913  9672 raft_consensus.cc:2393] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 49db878da3c847c699498bcb681e2e48 in current term 1: Already voted for candidate f359ef0ecbc0455080e6fc9044b5705c in this term.
I20260709 13:05:09.261868  9868 leader_election.cc:290] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 1 election: Requested vote from peers 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.262306  9747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49db878da3c847c699498bcb681e2e48"
I20260709 13:05:09.263051  9747 raft_consensus.cc:3060] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.264148  9866 raft_consensus.cc:493] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.264233  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
I20260709 13:05:09.264815  9866 raft_consensus.cc:515] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.265781  9821 raft_consensus.cc:3060] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.267220  9866 leader_election.cc:290] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.269096  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2204be3b5f724517a659d35df2c29041" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c" is_pre_election: true
I20260709 13:05:09.269266  9820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e" is_pre_election: true
I20260709 13:05:09.269888  9672 raft_consensus.cc:2468] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 0.
I20260709 13:05:09.271584  9747 raft_consensus.cc:2468] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 1.
I20260709 13:05:09.271862  9712 leader_election.cc:304] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 49db878da3c847c699498bcb681e2e48; no voters: f359ef0ecbc0455080e6fc9044b5705c, f414700645bb4bf6a37f0f5dade7008e
I20260709 13:05:09.271727  9711 leader_election.cc:304] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f359ef0ecbc0455080e6fc9044b5705c; no voters: 
I20260709 13:05:09.273042  9866 raft_consensus.cc:2749] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.273105  9635 leader_election.cc:304] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f359ef0ecbc0455080e6fc9044b5705c; no voters: 
I20260709 13:05:09.273906  9820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2204be3b5f724517a659d35df2c29041" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e" is_pre_election: true
I20260709 13:05:09.274369  9868 raft_consensus.cc:2804] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.274590  9820 raft_consensus.cc:2468] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 0.
I20260709 13:05:09.274513  9866 raft_consensus.cc:2804] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.275707  9868 raft_consensus.cc:697] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 LEADER]: Becoming Leader. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Running, Role: LEADER
I20260709 13:05:09.275991  9866 raft_consensus.cc:493] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.276484  9866 raft_consensus.cc:3060] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.277001  9868 consensus_queue.cc:237] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.277663  9821 raft_consensus.cc:2468] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 1.
I20260709 13:05:09.286103  9866 raft_consensus.cc:515] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.288309  9866 leader_election.cc:290] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 election: Requested vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.289294  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2204be3b5f724517a659d35df2c29041" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
I20260709 13:05:09.288627  9568 catalog_manager.cc:5697] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c reported cstate change: term changed from 0 to 1, leader changed from <none> to f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193). New cstate: current_term: 1 leader_uuid: "f359ef0ecbc0455080e6fc9044b5705c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.289669  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2204be3b5f724517a659d35df2c29041" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
I20260709 13:05:09.289996  9672 raft_consensus.cc:3060] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.290369  9821 raft_consensus.cc:3060] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.297879  9672 raft_consensus.cc:2468] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 1.
I20260709 13:05:09.297878  9821 raft_consensus.cc:2468] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 1.
I20260709 13:05:09.299491  9711 leader_election.cc:304] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f359ef0ecbc0455080e6fc9044b5705c; no voters: 
I20260709 13:05:09.300928  9866 raft_consensus.cc:2804] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.302132  9866 raft_consensus.cc:697] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Becoming Leader. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Running, Role: LEADER
I20260709 13:05:09.302953  9866 consensus_queue.cc:237] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.311539  9568 catalog_manager.cc:5697] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49db878da3c847c699498bcb681e2e48 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "49db878da3c847c699498bcb681e2e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.358120  9568 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40118:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:09.360248  9568 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:09.386914  9662 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1d1aabb08040ed89202614bdd85c42 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0f5c0c6996fb407991de1c37c2325841]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:09.387892  9736 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1d1aabb08040ed89202614bdd85c42 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0f5c0c6996fb407991de1c37c2325841]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:09.389546  9736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1d1aabb08040ed89202614bdd85c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.388487  9662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1d1aabb08040ed89202614bdd85c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.389947  9810 tablet_service.cc:1511] Processing CreateTablet for tablet 6e1d1aabb08040ed89202614bdd85c42 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0f5c0c6996fb407991de1c37c2325841]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:05:09.390604  9661 tablet_service.cc:1511] Processing CreateTablet for tablet 83ba8040f3214234a005f24e5a1d4372 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0f5c0c6996fb407991de1c37c2325841]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:09.391371  9810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e1d1aabb08040ed89202614bdd85c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.391991  9661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ba8040f3214234a005f24e5a1d4372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.407783  9862 tablet_bootstrap.cc:492] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48: Bootstrap starting.
W20260709 13:05:09.408818  9618 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:09.411762  9864 tablet_bootstrap.cc:492] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e: Bootstrap starting.
I20260709 13:05:09.412303  9737 tablet_service.cc:1511] Processing CreateTablet for tablet 83ba8040f3214234a005f24e5a1d4372 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0f5c0c6996fb407991de1c37c2325841]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:09.413828  9737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ba8040f3214234a005f24e5a1d4372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.420153  9810 tablet_service.cc:1511] Processing CreateTablet for tablet 83ba8040f3214234a005f24e5a1d4372 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0f5c0c6996fb407991de1c37c2325841]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:05:09.423094  9861 tablet_bootstrap.cc:492] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c: Bootstrap starting.
I20260709 13:05:09.424697  9862 tablet_bootstrap.cc:654] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.428063  9810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83ba8040f3214234a005f24e5a1d4372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.427918  9864 tablet_bootstrap.cc:654] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.431840  9861 tablet_bootstrap.cc:654] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.439188  9862 tablet_bootstrap.cc:492] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48: No bootstrap required, opened a new log
I20260709 13:05:09.439738  9862 ts_tablet_manager.cc:1403] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.005s
I20260709 13:05:09.441359  9864 tablet_bootstrap.cc:492] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e: No bootstrap required, opened a new log
I20260709 13:05:09.441954  9864 ts_tablet_manager.cc:1403] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.006s
I20260709 13:05:09.442960  9862 raft_consensus.cc:359] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.443742  9862 raft_consensus.cc:385] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.444224  9862 raft_consensus.cc:740] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.445112  9864 raft_consensus.cc:359] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.445189  9862 consensus_queue.cc:260] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.446024  9864 raft_consensus.cc:385] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.446362  9864 raft_consensus.cc:740] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f414700645bb4bf6a37f0f5dade7008e, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.447249  9864 consensus_queue.cc:260] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.450048  9864 ts_tablet_manager.cc:1434] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 13:05:09.453213  9862 ts_tablet_manager.cc:1434] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:09.453863  9861 tablet_bootstrap.cc:492] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c: No bootstrap required, opened a new log
I20260709 13:05:09.454561  9861 ts_tablet_manager.cc:1403] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.001s
I20260709 13:05:09.459589  9862 tablet_bootstrap.cc:492] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48: Bootstrap starting.
I20260709 13:05:09.459113  9861 raft_consensus.cc:359] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.460402  9861 raft_consensus.cc:385] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.461191  9861 raft_consensus.cc:740] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.462283  9861 consensus_queue.cc:260] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.465766  9861 ts_tablet_manager.cc:1434] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 13:05:09.467103  9861 tablet_bootstrap.cc:492] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c: Bootstrap starting.
I20260709 13:05:09.467630  9862 tablet_bootstrap.cc:654] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.469594  9864 tablet_bootstrap.cc:492] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e: Bootstrap starting.
I20260709 13:05:09.474973  9861 tablet_bootstrap.cc:654] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.480839  9866 raft_consensus.cc:493] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.481807  9866 raft_consensus.cc:515] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.489130  9861 tablet_bootstrap.cc:492] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c: No bootstrap required, opened a new log
I20260709 13:05:09.489463  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c" is_pre_election: true
I20260709 13:05:09.490998  9861 ts_tablet_manager.cc:1403] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
W20260709 13:05:09.493525  9711 leader_election.cc:343] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.497094  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e" is_pre_election: true
I20260709 13:05:09.497993  9861 raft_consensus.cc:359] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.498986  9861 raft_consensus.cc:385] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.498665  9821 raft_consensus.cc:2468] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 0.
I20260709 13:05:09.499650  9861 raft_consensus.cc:740] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.497509  9868 raft_consensus.cc:493] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.500756  9861 consensus_queue.cc:260] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.500520  9868 raft_consensus.cc:515] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.504153  9861 ts_tablet_manager.cc:1434] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.007s
I20260709 13:05:09.508312  9820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e" is_pre_election: true
I20260709 13:05:09.508944  9747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49db878da3c847c699498bcb681e2e48" is_pre_election: true
I20260709 13:05:09.510174  9868 leader_election.cc:290] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.510823  9866 leader_election.cc:290] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
W20260709 13:05:09.511510  9635 leader_election.cc:343] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.512401  9862 tablet_bootstrap.cc:492] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48: No bootstrap required, opened a new log
I20260709 13:05:09.512543  9864 tablet_bootstrap.cc:654] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.513160  9712 leader_election.cc:304] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f414700645bb4bf6a37f0f5dade7008e; no voters: f359ef0ecbc0455080e6fc9044b5705c
W20260709 13:05:09.514559  9637 leader_election.cc:343] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:09.515271  9866 raft_consensus.cc:2804] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.513357  9862 ts_tablet_manager.cc:1403] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.026s
I20260709 13:05:09.515434  9637 leader_election.cc:304] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f359ef0ecbc0455080e6fc9044b5705c; no voters: 49db878da3c847c699498bcb681e2e48, f414700645bb4bf6a37f0f5dade7008e
I20260709 13:05:09.518606  9868 raft_consensus.cc:2749] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:09.520105  9862 raft_consensus.cc:359] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.516003  9866 raft_consensus.cc:493] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.521380  9862 raft_consensus.cc:385] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.521615  9866 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.521759  9862 raft_consensus.cc:740] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.522710  9862 consensus_queue.cc:260] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.524024  9864 tablet_bootstrap.cc:492] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e: No bootstrap required, opened a new log
I20260709 13:05:09.524796  9864 ts_tablet_manager.cc:1403] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.006s
I20260709 13:05:09.525452  9862 ts_tablet_manager.cc:1434] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:05:09.528574  9864 raft_consensus.cc:359] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.529156  9866 raft_consensus.cc:515] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.529606  9864 raft_consensus.cc:385] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.530107  9864 raft_consensus.cc:740] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f414700645bb4bf6a37f0f5dade7008e, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.531121  9864 consensus_queue.cc:260] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.531672  9866 leader_election.cc:290] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 election: Requested vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.532773  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
I20260709 13:05:09.533720  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
I20260709 13:05:09.533845  9672 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.535419  9864 ts_tablet_manager.cc:1434] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:05:09.537468  9821 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.544701  9672 raft_consensus.cc:2468] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 1.
I20260709 13:05:09.546440  9711 leader_election.cc:304] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f359ef0ecbc0455080e6fc9044b5705c; no voters: 
I20260709 13:05:09.546629  9821 raft_consensus.cc:2468] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 1.
I20260709 13:05:09.547323  9866 raft_consensus.cc:2804] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.547881  9866 raft_consensus.cc:697] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Becoming Leader. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Running, Role: LEADER
I20260709 13:05:09.548866  9866 consensus_queue.cc:237] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.559561  9569 catalog_manager.cc:5697] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49db878da3c847c699498bcb681e2e48 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "49db878da3c847c699498bcb681e2e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.591806  9866 raft_consensus.cc:493] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.592511  9866 raft_consensus.cc:515] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.594451  9866 leader_election.cc:290] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.595585  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c" is_pre_election: true
I20260709 13:05:09.596169  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e" is_pre_election: true
I20260709 13:05:09.596371  9672 raft_consensus.cc:2468] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 0.
I20260709 13:05:09.597043  9821 raft_consensus.cc:2468] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 0.
I20260709 13:05:09.598044  9711 leader_election.cc:304] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f359ef0ecbc0455080e6fc9044b5705c; no voters: 
I20260709 13:05:09.599102  9866 raft_consensus.cc:2804] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:09.599452  9866 raft_consensus.cc:493] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.599792  9866 raft_consensus.cc:3060] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.605552  9866 raft_consensus.cc:515] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.607388  9866 leader_election.cc:290] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 election: Requested vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.608810  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
I20260709 13:05:09.608870  9672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
I20260709 13:05:09.609488  9821 raft_consensus.cc:3060] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.609983  9672 raft_consensus.cc:3060] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.616752  9821 raft_consensus.cc:2468] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 1.
I20260709 13:05:09.617663  9672 raft_consensus.cc:2468] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 1.
I20260709 13:05:09.618171  9712 leader_election.cc:304] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f414700645bb4bf6a37f0f5dade7008e; no voters: 
I20260709 13:05:09.619210  9866 raft_consensus.cc:2804] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.619738  9866 raft_consensus.cc:697] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Becoming Leader. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Running, Role: LEADER
I20260709 13:05:09.620597  9866 consensus_queue.cc:237] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.629118  9569 catalog_manager.cc:5697] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49db878da3c847c699498bcb681e2e48 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "49db878da3c847c699498bcb681e2e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.678959  9747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2204be3b5f724517a659d35df2c29041"
dest_uuid: "49db878da3c847c699498bcb681e2e48"
mode: GRACEFUL
new_leader_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
 from {username='slave'} at 127.0.0.1:32884
I20260709 13:05:09.679703  9747 raft_consensus.cc:606] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Received request to transfer leadership to TS f359ef0ecbc0455080e6fc9044b5705c
I20260709 13:05:09.680441  9868 consensus_queue.cc:1048] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:09.705396  9868 consensus_queue.cc:1048] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Connected to new peer: Peer: permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:09.705618  9672 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea"
dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
mode: GRACEFUL
new_leader_uuid: "49db878da3c847c699498bcb681e2e48"
 from {username='slave'} at 127.0.0.1:47066
I20260709 13:05:09.706981  9672 raft_consensus.cc:606] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 LEADER]: Received request to transfer leadership to TS 49db878da3c847c699498bcb681e2e48
I20260709 13:05:09.719305  9866 consensus_queue.cc:1048] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:09.721966  9878 raft_consensus.cc:993] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c: : Instructing follower 49db878da3c847c699498bcb681e2e48 to start an election
I20260709 13:05:09.722617  9878 raft_consensus.cc:1081] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 LEADER]: Signalling peer 49db878da3c847c699498bcb681e2e48 to start an election
I20260709 13:05:09.723224  9747 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42"
dest_uuid: "49db878da3c847c699498bcb681e2e48"
mode: GRACEFUL
new_leader_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
 from {username='slave'} at 127.0.0.1:32884
I20260709 13:05:09.724069  9747 raft_consensus.cc:606] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Received request to transfer leadership to TS f359ef0ecbc0455080e6fc9044b5705c
I20260709 13:05:09.724808  9746 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea"
dest_uuid: "49db878da3c847c699498bcb681e2e48"
 from {username='slave'} at 127.0.0.1:34782
I20260709 13:05:09.725801  9746 raft_consensus.cc:493] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.726209  9746 raft_consensus.cc:3060] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.737512  9866 consensus_queue.cc:1048] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:09.743281  9746 raft_consensus.cc:515] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.747164  9671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
I20260709 13:05:09.747277  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ed202c6cd54e668f3b3ea1fa0e60ea" candidate_uuid: "49db878da3c847c699498bcb681e2e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
I20260709 13:05:09.747977  9671 raft_consensus.cc:3055] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.748066  9821 raft_consensus.cc:3060] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.748498  9671 raft_consensus.cc:740] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Running, Role: LEADER
I20260709 13:05:09.749579  9671 consensus_queue.cc:260] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.750944  9671 raft_consensus.cc:3060] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.751545  9746 leader_election.cc:290] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 2 election: Requested vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.756246  9821 raft_consensus.cc:2468] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 2.
I20260709 13:05:09.757970  9712 leader_election.cc:304] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49db878da3c847c699498bcb681e2e48, f414700645bb4bf6a37f0f5dade7008e; no voters: 
I20260709 13:05:09.759339  9866 raft_consensus.cc:2804] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.759454  9880 raft_consensus.cc:993] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48: : Instructing follower f359ef0ecbc0455080e6fc9044b5705c to start an election
I20260709 13:05:09.759927  9866 raft_consensus.cc:697] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 2 LEADER]: Becoming Leader. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Running, Role: LEADER
I20260709 13:05:09.760854  9866 consensus_queue.cc:237] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.764288  9671 raft_consensus.cc:2468] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49db878da3c847c699498bcb681e2e48 in term 2.
I20260709 13:05:09.764950  9903 raft_consensus.cc:1081] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Signalling peer f359ef0ecbc0455080e6fc9044b5705c to start an election
I20260709 13:05:09.767944  9671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2204be3b5f724517a659d35df2c29041"
dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
 from {username='slave'} at 127.0.0.1:43244
I20260709 13:05:09.768613  9671 raft_consensus.cc:493] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.769021  9671 raft_consensus.cc:3060] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.775800  9566 catalog_manager.cc:5697] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 reported cstate change: term changed from 1 to 2, leader changed from f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193) to 49db878da3c847c699498bcb681e2e48 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "49db878da3c847c699498bcb681e2e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.780771  9671 raft_consensus.cc:515] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.783632  9671 leader_election.cc:290] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 2 election: Requested vote from peers 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:09.784600  9747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2204be3b5f724517a659d35df2c29041" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49db878da3c847c699498bcb681e2e48"
I20260709 13:05:09.785321  9747 raft_consensus.cc:3055] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.775807  9746 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372"
dest_uuid: "49db878da3c847c699498bcb681e2e48"
mode: GRACEFUL
new_leader_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
 from {username='slave'} at 127.0.0.1:32884
I20260709 13:05:09.785880  9747 raft_consensus.cc:740] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Running, Role: LEADER
I20260709 13:05:09.785993  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2204be3b5f724517a659d35df2c29041" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
I20260709 13:05:09.786187  9746 raft_consensus.cc:606] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Received request to transfer leadership to TS f359ef0ecbc0455080e6fc9044b5705c
I20260709 13:05:09.786763  9821 raft_consensus.cc:3060] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.786939  9747 consensus_queue.cc:260] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.788682  9747 raft_consensus.cc:3060] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.796705  9821 raft_consensus.cc:2468] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 2.
I20260709 13:05:09.796732  9747 raft_consensus.cc:2468] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 2.
I20260709 13:05:09.798336  9637 leader_election.cc:304] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f359ef0ecbc0455080e6fc9044b5705c, f414700645bb4bf6a37f0f5dade7008e; no voters: 
I20260709 13:05:09.799381  9898 raft_consensus.cc:2804] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.799916  9898 raft_consensus.cc:697] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Becoming Leader. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Running, Role: LEADER
I20260709 13:05:09.800735  9898 consensus_queue.cc:237] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:09.807792  9569 catalog_manager.cc:5697] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c reported cstate change: term changed from 1 to 2, leader changed from 49db878da3c847c699498bcb681e2e48 (127.0.107.194) to f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f359ef0ecbc0455080e6fc9044b5705c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:09.988020  9880 consensus_queue.cc:1048] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.001120  9866 consensus_queue.cc:1048] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.010905  9880 raft_consensus.cc:993] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48: : Instructing follower f359ef0ecbc0455080e6fc9044b5705c to start an election
I20260709 13:05:10.011541  9866 raft_consensus.cc:1081] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Signalling peer f359ef0ecbc0455080e6fc9044b5705c to start an election
I20260709 13:05:10.013612  9671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42"
dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
 from {username='slave'} at 127.0.0.1:43244
I20260709 13:05:10.014207  9671 raft_consensus.cc:493] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.014611  9671 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.023662  9671 raft_consensus.cc:515] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.027827  9747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49db878da3c847c699498bcb681e2e48"
I20260709 13:05:10.028551  9747 raft_consensus.cc:3055] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:10.028613  9821 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
I20260709 13:05:10.029489  9671 leader_election.cc:290] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 2 election: Requested vote from peers 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:10.029599  9821 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.029033  9747 raft_consensus.cc:740] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Running, Role: LEADER
I20260709 13:05:10.033674  9747 consensus_queue.cc:260] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.035063  9747 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.036679  9866 consensus_queue.cc:1048] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:10.039712  9821 raft_consensus.cc:2468] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 2.
I20260709 13:05:10.041486  9637 leader_election.cc:304] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f359ef0ecbc0455080e6fc9044b5705c, f414700645bb4bf6a37f0f5dade7008e; no voters: 
I20260709 13:05:10.042409  9898 raft_consensus.cc:2804] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:10.043098  9898 raft_consensus.cc:697] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Becoming Leader. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Running, Role: LEADER
I20260709 13:05:10.043236  9747 raft_consensus.cc:2468] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 2.
I20260709 13:05:10.044221  9898 consensus_queue.cc:237] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.054292  9866 consensus_queue.cc:1048] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:10.061517  9568 catalog_manager.cc:5697] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c reported cstate change: term changed from 1 to 2, leader changed from 49db878da3c847c699498bcb681e2e48 (127.0.107.194) to f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f359ef0ecbc0455080e6fc9044b5705c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.063319  9880 raft_consensus.cc:993] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48: : Instructing follower f359ef0ecbc0455080e6fc9044b5705c to start an election
I20260709 13:05:10.063951  9866 raft_consensus.cc:1081] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Signalling peer f359ef0ecbc0455080e6fc9044b5705c to start an election
I20260709 13:05:10.066258  9671 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372"
dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
 from {username='slave'} at 127.0.0.1:43244
I20260709 13:05:10.066919  9671 raft_consensus.cc:493] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.067308  9671 raft_consensus.cc:3060] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.073860  9671 raft_consensus.cc:515] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.075569  9671 leader_election.cc:290] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 2 election: Requested vote from peers 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105), f414700645bb4bf6a37f0f5dade7008e (127.0.107.195:43901)
I20260709 13:05:10.076670  9747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "49db878da3c847c699498bcb681e2e48"
I20260709 13:05:10.077735  9747 raft_consensus.cc:3055] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:10.077844  9820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83ba8040f3214234a005f24e5a1d4372" candidate_uuid: "f359ef0ecbc0455080e6fc9044b5705c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
I20260709 13:05:10.078351  9747 raft_consensus.cc:740] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 49db878da3c847c699498bcb681e2e48, State: Running, Role: LEADER
I20260709 13:05:10.078951  9820 raft_consensus.cc:3060] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.079499  9747 consensus_queue.cc:260] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.080830  9747 raft_consensus.cc:3060] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.086416  9820 raft_consensus.cc:2468] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 2.
I20260709 13:05:10.087387  9747 raft_consensus.cc:2468] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f359ef0ecbc0455080e6fc9044b5705c in term 2.
I20260709 13:05:10.087754  9637 leader_election.cc:304] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f359ef0ecbc0455080e6fc9044b5705c, f414700645bb4bf6a37f0f5dade7008e; no voters: 
I20260709 13:05:10.088739  9898 raft_consensus.cc:2804] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:10.089206  9898 raft_consensus.cc:697] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Becoming Leader. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Running, Role: LEADER
I20260709 13:05:10.089972  9898 consensus_queue.cc:237] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.096675  9568 catalog_manager.cc:5697] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c reported cstate change: term changed from 1 to 2, leader changed from 49db878da3c847c699498bcb681e2e48 (127.0.107.194) to f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193). New cstate: current_term: 2 leader_uuid: "f359ef0ecbc0455080e6fc9044b5705c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.127863   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:05:10.129756   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:05:10.130221   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:05:10.143571  9671 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42"
dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
mode: GRACEFUL
new_leader_uuid: "f414700645bb4bf6a37f0f5dade7008e"
 from {username='slave'} at 127.0.0.1:47074
I20260709 13:05:10.144315  9671 raft_consensus.cc:606] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Received request to transfer leadership to TS f414700645bb4bf6a37f0f5dade7008e
I20260709 13:05:10.146018   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:05:10.338815  9747 raft_consensus.cc:1275] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Refusing update from remote peer f359ef0ecbc0455080e6fc9044b5705c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.340327  9898 consensus_queue.cc:1048] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Connected to new peer: Peer: permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:10.346549  9820 raft_consensus.cc:1275] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Refusing update from remote peer 49db878da3c847c699498bcb681e2e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.348414  9880 consensus_queue.cc:1048] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:10.350726  9820 raft_consensus.cc:1275] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Refusing update from remote peer f359ef0ecbc0455080e6fc9044b5705c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.357375  9912 consensus_queue.cc:1048] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:10.362411  9671 raft_consensus.cc:1275] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Refusing update from remote peer 49db878da3c847c699498bcb681e2e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.365399  9903 consensus_queue.cc:1048] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:10.510834  9747 raft_consensus.cc:1275] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Refusing update from remote peer f359ef0ecbc0455080e6fc9044b5705c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.512841  9878 consensus_queue.cc:1048] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Connected to new peer: Peer: permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:10.523062  9820 raft_consensus.cc:1275] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Refusing update from remote peer f359ef0ecbc0455080e6fc9044b5705c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.526098  9898 consensus_queue.cc:1048] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:10.528621  9820 raft_consensus.cc:1275] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Refusing update from remote peer f359ef0ecbc0455080e6fc9044b5705c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.534440  9898 consensus_queue.cc:1048] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:10.542865  9911 raft_consensus.cc:993] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c: : Instructing follower f414700645bb4bf6a37f0f5dade7008e to start an election
I20260709 13:05:10.543567  9911 raft_consensus.cc:1081] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Signalling peer f414700645bb4bf6a37f0f5dade7008e to start an election
I20260709 13:05:10.545845  9821 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42"
dest_uuid: "f414700645bb4bf6a37f0f5dade7008e"
 from {username='slave'} at 127.0.0.1:59306
I20260709 13:05:10.549221  9747 raft_consensus.cc:1275] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Refusing update from remote peer f359ef0ecbc0455080e6fc9044b5705c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.550791  9821 raft_consensus.cc:493] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.551378  9821 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.551174  9898 consensus_queue.cc:1048] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [LEADER]: Connected to new peer: Peer: permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:10.560743  9821 raft_consensus.cc:515] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.576292  9821 leader_election.cc:290] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [CANDIDATE]: Term 3 election: Requested vote from peers f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161), 49db878da3c847c699498bcb681e2e48 (127.0.107.194:38105)
I20260709 13:05:10.580786  9671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42" candidate_uuid: "f414700645bb4bf6a37f0f5dade7008e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f359ef0ecbc0455080e6fc9044b5705c"
I20260709 13:05:10.581475  9671 raft_consensus.cc:3055] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.581830  9671 raft_consensus.cc:740] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f359ef0ecbc0455080e6fc9044b5705c, State: Running, Role: LEADER
I20260709 13:05:10.582675  9671 consensus_queue.cc:260] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.583706  9671 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.587622  9747 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e1d1aabb08040ed89202614bdd85c42" candidate_uuid: "f414700645bb4bf6a37f0f5dade7008e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "49db878da3c847c699498bcb681e2e48"
I20260709 13:05:10.588369  9747 raft_consensus.cc:3060] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.592561  9671 raft_consensus.cc:2468] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f414700645bb4bf6a37f0f5dade7008e in term 3.
I20260709 13:05:10.594233  9785 leader_election.cc:304] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f359ef0ecbc0455080e6fc9044b5705c, f414700645bb4bf6a37f0f5dade7008e; no voters: 
I20260709 13:05:10.595234  9870 raft_consensus.cc:2804] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.595889  9747 raft_consensus.cc:2468] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f414700645bb4bf6a37f0f5dade7008e in term 3.
I20260709 13:05:10.596985  9870 raft_consensus.cc:697] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 3 LEADER]: Becoming Leader. State: Replica: f414700645bb4bf6a37f0f5dade7008e, State: Running, Role: LEADER
I20260709 13:05:10.598141  9870 consensus_queue.cc:237] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } }
I20260709 13:05:10.605968  9569 catalog_manager.cc:5697] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e reported cstate change: term changed from 2 to 3, leader changed from f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193) to f414700645bb4bf6a37f0f5dade7008e (127.0.107.195). New cstate: current_term: 3 leader_uuid: "f414700645bb4bf6a37f0f5dade7008e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f359ef0ecbc0455080e6fc9044b5705c" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49db878da3c847c699498bcb681e2e48" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 38105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f414700645bb4bf6a37f0f5dade7008e" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43901 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.807948   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:05:10.832265   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:10.833050   431 tablet_replica.cc:333] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c: stopping tablet replica
I20260709 13:05:10.833702   431 raft_consensus.cc:2243] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:10.834713   431 raft_consensus.cc:2272] T 83ba8040f3214234a005f24e5a1d4372 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.837445   431 tablet_replica.cc:333] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c: stopping tablet replica
I20260709 13:05:10.838052   431 raft_consensus.cc:2243] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.838528   431 raft_consensus.cc:2272] T 6e1d1aabb08040ed89202614bdd85c42 P f359ef0ecbc0455080e6fc9044b5705c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.841281   431 tablet_replica.cc:333] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c: stopping tablet replica
I20260709 13:05:10.841858   431 raft_consensus.cc:2243] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.842374   431 raft_consensus.cc:2272] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.844921   431 tablet_replica.cc:333] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c: stopping tablet replica
I20260709 13:05:10.845474   431 raft_consensus.cc:2243] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:10.846325   431 raft_consensus.cc:2272] T 2204be3b5f724517a659d35df2c29041 P f359ef0ecbc0455080e6fc9044b5705c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.865136   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:10.865495  9711 consensus_peers.cc:597] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 -> Peer f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161): Couldn't send request to peer f359ef0ecbc0455080e6fc9044b5705c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:10.879596   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:05:10.903162   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:10.903942   431 tablet_replica.cc:333] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48: stopping tablet replica
I20260709 13:05:10.904723   431 raft_consensus.cc:2243] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.905355   431 raft_consensus.cc:2272] T 83ba8040f3214234a005f24e5a1d4372 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.908281   431 tablet_replica.cc:333] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48: stopping tablet replica
I20260709 13:05:10.908840   431 raft_consensus.cc:2243] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.909268   431 raft_consensus.cc:2272] T 6e1d1aabb08040ed89202614bdd85c42 P 49db878da3c847c699498bcb681e2e48 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.911569   431 tablet_replica.cc:333] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48: stopping tablet replica
I20260709 13:05:10.912165   431 raft_consensus.cc:2243] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:10.913127   431 raft_consensus.cc:2272] T c9ed202c6cd54e668f3b3ea1fa0e60ea P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.915642   431 tablet_replica.cc:333] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48: stopping tablet replica
I20260709 13:05:10.916230   431 raft_consensus.cc:2243] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.916654   431 raft_consensus.cc:2272] T 2204be3b5f724517a659d35df2c29041 P 49db878da3c847c699498bcb681e2e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.943284   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:05:10.958461   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:05:10.989562   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:05:10.990166  9785 consensus_peers.cc:597] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e -> Peer f359ef0ecbc0455080e6fc9044b5705c (127.0.107.193:34161): Couldn't send request to peer f359ef0ecbc0455080e6fc9044b5705c. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34161: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:10.990509   431 tablet_replica.cc:333] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e: stopping tablet replica
I20260709 13:05:10.991413   431 raft_consensus.cc:2243] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.991991   431 raft_consensus.cc:2272] T 83ba8040f3214234a005f24e5a1d4372 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.994836   431 tablet_replica.cc:333] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e: stopping tablet replica
I20260709 13:05:10.995481   431 raft_consensus.cc:2243] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:10.996413   431 pending_rounds.cc:70] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e: Trying to abort 1 pending ops.
I20260709 13:05:10.996590   431 pending_rounds.cc:77] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305635064220008448 op_type: NO_OP noop_request { }
I20260709 13:05:10.997004   431 raft_consensus.cc:2889] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:05:10.997313   431 raft_consensus.cc:2272] T 6e1d1aabb08040ed89202614bdd85c42 P f414700645bb4bf6a37f0f5dade7008e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:11.000136   431 tablet_replica.cc:333] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e: stopping tablet replica
I20260709 13:05:11.000727   431 raft_consensus.cc:2243] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:11.001214   431 raft_consensus.cc:2272] T 2204be3b5f724517a659d35df2c29041 P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:11.004179   431 tablet_replica.cc:333] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e: stopping tablet replica
I20260709 13:05:11.004807   431 raft_consensus.cc:2243] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:11.005371   431 raft_consensus.cc:2272] T c9ed202c6cd54e668f3b3ea1fa0e60ea P f414700645bb4bf6a37f0f5dade7008e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:11.022300   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:11.037554   431 master.cc:562] Master@127.0.107.254:38469 shutting down...
I20260709 13:05:11.057379   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:11.058025   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:11.058332   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 793edb42a8894170afd6e68f65622d95: stopping tablet replica
I20260709 13:05:11.073835   431 master.cc:584] Master@127.0.107.254:38469 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2872 ms)
[----------] 6 tests from LeaderRebalancerTest (296318 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:05:11.105109   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:39905
I20260709 13:05:11.106349   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:11.112394  9924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:11.112449  9923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:11.113687  9926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:11.115478   431 server_base.cc:1061] running on GCE node
I20260709 13:05:11.116443   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:11.116632   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:11.116757   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602311116746 us; error 0 us; skew 500 ppm
I20260709 13:05:11.117244   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:11.119983   431 webserver.cc:533] Webserver started at http://127.0.107.254:45707/ using document root <none> and password file <none>
I20260709 13:05:11.120663   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:11.120823   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:11.121033   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:11.122056   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/master-0-root/instance:
uuid: "5524595632af40d8938833eb0e22d35c"
format_stamp: "Formatted at 2026-07-09 13:05:11 on dist-test-slave-smzk"
I20260709 13:05:11.126926   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:11.131114  9931 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.132320   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:05:11.132858   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/master-0-root
uuid: "5524595632af40d8938833eb0e22d35c"
format_stamp: "Formatted at 2026-07-09 13:05:11 on dist-test-slave-smzk"
I20260709 13:05:11.133280   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:11.148895   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:11.149950   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:11.191704   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:39905
I20260709 13:05:11.191900  9982 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:39905 every 8 connection(s)
I20260709 13:05:11.196553  9983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.210479  9983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c: Bootstrap starting.
I20260709 13:05:11.217056  9983 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.222342  9983 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c: No bootstrap required, opened a new log
I20260709 13:05:11.225098  9983 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5524595632af40d8938833eb0e22d35c" member_type: VOTER }
I20260709 13:05:11.225618  9983 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.225828  9983 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5524595632af40d8938833eb0e22d35c, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.226763  9983 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5524595632af40d8938833eb0e22d35c" member_type: VOTER }
I20260709 13:05:11.227300  9983 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:11.227531  9983 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:11.227787  9983 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:11.234426  9983 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5524595632af40d8938833eb0e22d35c" member_type: VOTER }
I20260709 13:05:11.235351  9983 leader_election.cc:304] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5524595632af40d8938833eb0e22d35c; no voters: 
I20260709 13:05:11.236812  9983 leader_election.cc:290] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:11.237255  9986 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:11.238785  9986 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 1 LEADER]: Becoming Leader. State: Replica: 5524595632af40d8938833eb0e22d35c, State: Running, Role: LEADER
I20260709 13:05:11.239500  9986 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5524595632af40d8938833eb0e22d35c" member_type: VOTER }
I20260709 13:05:11.240545  9983 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:11.243510  9988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5524595632af40d8938833eb0e22d35c. Latest consensus state: current_term: 1 leader_uuid: "5524595632af40d8938833eb0e22d35c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5524595632af40d8938833eb0e22d35c" member_type: VOTER } }
I20260709 13:05:11.243566  9987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5524595632af40d8938833eb0e22d35c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5524595632af40d8938833eb0e22d35c" member_type: VOTER } }
I20260709 13:05:11.244304  9988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:11.244838  9987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:11.254334  9992 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:11.264164  9992 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:11.265793   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:11.275758  9992 catalog_manager.cc:1383] Generated new cluster ID: e97264aded4143be9cc8394dfb0daf36
I20260709 13:05:11.276134  9992 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:11.301527  9992 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:11.303086  9992 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:11.321280  9992 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c: Generated new TSK 0
I20260709 13:05:11.322021  9992 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:11.333328   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:11.340930 10004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:11.342921 10005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:11.350502 10007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:11.350705   431 server_base.cc:1061] running on GCE node
I20260709 13:05:11.352205   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:11.352466   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:11.352613   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602311352599 us; error 0 us; skew 500 ppm
I20260709 13:05:11.353195   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:11.356310   431 webserver.cc:533] Webserver started at http://127.0.107.193:42379/ using document root <none> and password file <none>
I20260709 13:05:11.356853   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:11.357029   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:11.357285   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:11.358541   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-0-root/instance:
uuid: "c5b39fd125c84087bf29c0d4b747e04e"
format_stamp: "Formatted at 2026-07-09 13:05:11 on dist-test-slave-smzk"
I20260709 13:05:11.364239   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:05:11.368543 10012 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.369468   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:11.369835   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "c5b39fd125c84087bf29c0d4b747e04e"
format_stamp: "Formatted at 2026-07-09 13:05:11 on dist-test-slave-smzk"
I20260709 13:05:11.370167   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:11.393349   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:11.394824   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:11.396725   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:11.399600   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:11.399891   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.400239   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:11.400449   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.452668   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40915
I20260709 13:05:11.452883 10074 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40915 every 8 connection(s)
I20260709 13:05:11.458536   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:11.466902 10079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:11.468568 10080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:11.471951   431 server_base.cc:1061] running on GCE node
W20260709 13:05:11.472971 10082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:11.474355   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:05:11.474363 10075 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39905
W20260709 13:05:11.474748   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:11.474918 10075 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:11.474984   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602311474955 us; error 0 us; skew 500 ppm
I20260709 13:05:11.475965   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:11.475980 10075 heartbeater.cc:507] Master 127.0.107.254:39905 requested a full tablet report, sending...
I20260709 13:05:11.479256   431 webserver.cc:533] Webserver started at http://127.0.107.194:35817/ using document root <none> and password file <none>
I20260709 13:05:11.479375  9948 ts_manager.cc:194] Registered new tserver with Master: c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915)
I20260709 13:05:11.479925   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:11.480283   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:11.480569   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:11.481685   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-1-root/instance:
uuid: "2c755ea83e7548b48d55039aee37517d"
format_stamp: "Formatted at 2026-07-09 13:05:11 on dist-test-slave-smzk"
I20260709 13:05:11.481921  9948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52178
I20260709 13:05:11.486773   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:05:11.490645 10087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.491652   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:11.492030   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-1-root
uuid: "2c755ea83e7548b48d55039aee37517d"
format_stamp: "Formatted at 2026-07-09 13:05:11 on dist-test-slave-smzk"
I20260709 13:05:11.492347   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:11.513002   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:11.514180   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:11.515828   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:11.518213   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:11.518471   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.518738   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:11.518914   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.566805   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37889
I20260709 13:05:11.566967 10149 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37889 every 8 connection(s)
I20260709 13:05:11.572263   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:11.580003 10153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:11.582006 10154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:11.583503 10156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:11.584689   431 server_base.cc:1061] running on GCE node
I20260709 13:05:11.585920   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:11.586177   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:11.586396   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602311586377 us; error 0 us; skew 500 ppm
I20260709 13:05:11.586796 10150 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39905
I20260709 13:05:11.587188   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:11.587256 10150 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:11.588392 10150 heartbeater.cc:507] Master 127.0.107.254:39905 requested a full tablet report, sending...
I20260709 13:05:11.590392   431 webserver.cc:533] Webserver started at http://127.0.107.195:33487/ using document root <none> and password file <none>
I20260709 13:05:11.591041   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:11.591238   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:11.591254  9948 ts_manager.cc:194] Registered new tserver with Master: 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:11.591547   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:11.592922   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-2-root/instance:
uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
format_stamp: "Formatted at 2026-07-09 13:05:11 on dist-test-slave-smzk"
I20260709 13:05:11.593101  9948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52194
I20260709 13:05:11.598246   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:05:11.602339 10161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.603315   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:05:11.603670   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-2-root
uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
format_stamp: "Formatted at 2026-07-09 13:05:11 on dist-test-slave-smzk"
I20260709 13:05:11.603986   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602014598663-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:11.625905   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:11.627100   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:11.628672   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:11.631407   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:11.631666   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:11.631924   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:11.632149   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:11.678429   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43307
I20260709 13:05:11.678637 10223 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43307 every 8 connection(s)
I20260709 13:05:11.695600 10224 heartbeater.cc:344] Connected to a master server at 127.0.107.254:39905
I20260709 13:05:11.696136 10224 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:11.696877 10224 heartbeater.cc:507] Master 127.0.107.254:39905 requested a full tablet report, sending...
I20260709 13:05:11.699296  9948 ts_manager.cc:194] Registered new tserver with Master: c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:11.699608   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018056718s
I20260709 13:05:11.701484  9948 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52206
I20260709 13:05:11.736459  9948 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52210:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:11.739884  9948 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:11.817607 10189 tablet_service.cc:1511] Processing CreateTablet for tablet 8003ff9dc64c486faae3f3a82bdaa11e (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.818043 10188 tablet_service.cc:1511] Processing CreateTablet for tablet f93dc29fbefa4cbfaab40efabbc77e46 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.819195 10189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8003ff9dc64c486faae3f3a82bdaa11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.821591 10187 tablet_service.cc:1511] Processing CreateTablet for tablet 385ba8f2042241febbda746c9bb96b78 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.823077 10187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385ba8f2042241febbda746c9bb96b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.827497 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93dc29fbefa4cbfaab40efabbc77e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.828258 10186 tablet_service.cc:1511] Processing CreateTablet for tablet c8a4f168e98a42e385a164bda9d39f2a (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.829859 10186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a4f168e98a42e385a164bda9d39f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.830034 10040 tablet_service.cc:1511] Processing CreateTablet for tablet 8003ff9dc64c486faae3f3a82bdaa11e (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.831571 10040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8003ff9dc64c486faae3f3a82bdaa11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.833364 10039 tablet_service.cc:1511] Processing CreateTablet for tablet f93dc29fbefa4cbfaab40efabbc77e46 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.834945 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93dc29fbefa4cbfaab40efabbc77e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.836969 10038 tablet_service.cc:1511] Processing CreateTablet for tablet 385ba8f2042241febbda746c9bb96b78 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.838598 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385ba8f2042241febbda746c9bb96b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.841173 10037 tablet_service.cc:1511] Processing CreateTablet for tablet c8a4f168e98a42e385a164bda9d39f2a (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.842559 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a4f168e98a42e385a164bda9d39f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.845105 10036 tablet_service.cc:1511] Processing CreateTablet for tablet 29c57ecf7faa412ab93e405d8b1e2ef7 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.846469 10036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c57ecf7faa412ab93e405d8b1e2ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.849849 10185 tablet_service.cc:1511] Processing CreateTablet for tablet 29c57ecf7faa412ab93e405d8b1e2ef7 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.851297 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c57ecf7faa412ab93e405d8b1e2ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.871588 10035 tablet_service.cc:1511] Processing CreateTablet for tablet f2b8bb477df64462a43529bc66839022 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.873091 10035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b8bb477df64462a43529bc66839022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.879539 10184 tablet_service.cc:1511] Processing CreateTablet for tablet f2b8bb477df64462a43529bc66839022 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.885700 10034 tablet_service.cc:1511] Processing CreateTablet for tablet 216ec5b1720144aca4d4675cbc6fabf6 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.887948 10034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216ec5b1720144aca4d4675cbc6fabf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.894556 10187 tablet_service.cc:1511] Processing CreateTablet for tablet 216ec5b1720144aca4d4675cbc6fabf6 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.898854 10033 tablet_service.cc:1511] Processing CreateTablet for tablet 1672e25d2e934530932794c0a0482107 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.900308 10033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1672e25d2e934530932794c0a0482107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.903448 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 1672e25d2e934530932794c0a0482107 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.913050 10032 tablet_service.cc:1511] Processing CreateTablet for tablet 23ef029cf89847d5bc90dec72f9848bf (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.914702 10032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ef029cf89847d5bc90dec72f9848bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.916494 10183 tablet_service.cc:1511] Processing CreateTablet for tablet 23ef029cf89847d5bc90dec72f9848bf (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.916494 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 8003ff9dc64c486faae3f3a82bdaa11e (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:11.918846 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8003ff9dc64c486faae3f3a82bdaa11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.918565 10112 tablet_service.cc:1511] Processing CreateTablet for tablet c8a4f168e98a42e385a164bda9d39f2a (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:11.921737 10113 tablet_service.cc:1511] Processing CreateTablet for tablet 385ba8f2042241febbda746c9bb96b78 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:11.920014 10112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a4f168e98a42e385a164bda9d39f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.925241 10111 tablet_service.cc:1511] Processing CreateTablet for tablet 29c57ecf7faa412ab93e405d8b1e2ef7 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:11.927380 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29c57ecf7faa412ab93e405d8b1e2ef7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.929721 10110 tablet_service.cc:1511] Processing CreateTablet for tablet f2b8bb477df64462a43529bc66839022 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:11.931759 10110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b8bb477df64462a43529bc66839022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.938051 10107 tablet_service.cc:1511] Processing CreateTablet for tablet 23ef029cf89847d5bc90dec72f9848bf (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:11.939548 10107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ef029cf89847d5bc90dec72f9848bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.942341 10113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 385ba8f2042241febbda746c9bb96b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.934278 10109 tablet_service.cc:1511] Processing CreateTablet for tablet 216ec5b1720144aca4d4675cbc6fabf6 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:11.944996 10109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216ec5b1720144aca4d4675cbc6fabf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.919296 10114 tablet_service.cc:1511] Processing CreateTablet for tablet f93dc29fbefa4cbfaab40efabbc77e46 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:11.947904 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93dc29fbefa4cbfaab40efabbc77e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.936231 10108 tablet_service.cc:1511] Processing CreateTablet for tablet 1672e25d2e934530932794c0a0482107 (DEFAULT_TABLE table=test-workload [id=85ec5ea7b7484a86aa9c845209ae1d08]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:11.952306 10108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1672e25d2e934530932794c0a0482107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.952415 10187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216ec5b1720144aca4d4675cbc6fabf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.953300 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1672e25d2e934530932794c0a0482107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.956568 10183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ef029cf89847d5bc90dec72f9848bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.960160 10184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b8bb477df64462a43529bc66839022. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.032748 10239 tablet_bootstrap.cc:492] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.033486 10241 tablet_bootstrap.cc:492] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:12.032886 10240 tablet_bootstrap.cc:492] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.039681 10239 tablet_bootstrap.cc:654] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.041190 10240 tablet_bootstrap.cc:654] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.044979 10241 tablet_bootstrap.cc:654] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.076483 10240 tablet_bootstrap.cc:492] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.077019 10240 ts_tablet_manager.cc:1403] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.004s
I20260709 13:05:12.077710 10241 tablet_bootstrap.cc:492] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.078361 10241 ts_tablet_manager.cc:1403] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.002s
I20260709 13:05:12.080005 10240 raft_consensus.cc:359] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.081002 10240 raft_consensus.cc:385] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.081311 10240 raft_consensus.cc:740] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.082047 10240 consensus_queue.cc:260] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.081931 10241 raft_consensus.cc:359] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.082757 10239 tablet_bootstrap.cc:492] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.083004 10241 raft_consensus.cc:385] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.083351 10239 ts_tablet_manager.cc:1403] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.051s	user 0.004s	sys 0.008s
I20260709 13:05:12.083346 10241 raft_consensus.cc:740] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.084867 10150 heartbeater.cc:499] Master 127.0.107.254:39905 was elected leader, sending a full tablet report...
I20260709 13:05:12.084771 10241 consensus_queue.cc:260] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.085403 10240 ts_tablet_manager.cc:1434] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:12.088436 10240 tablet_bootstrap.cc:492] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.088231 10239 raft_consensus.cc:359] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.089592 10239 raft_consensus.cc:385] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.090022 10239 raft_consensus.cc:740] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.090979 10239 consensus_queue.cc:260] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.099735 10224 heartbeater.cc:499] Master 127.0.107.254:39905 was elected leader, sending a full tablet report...
I20260709 13:05:12.100836 10239 ts_tablet_manager.cc:1434] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:05:12.102212 10239 tablet_bootstrap.cc:492] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.108225 10075 heartbeater.cc:499] Master 127.0.107.254:39905 was elected leader, sending a full tablet report...
I20260709 13:05:12.108776 10241 ts_tablet_manager.cc:1434] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.030s	user 0.019s	sys 0.009s
I20260709 13:05:12.108915 10239 tablet_bootstrap.cc:654] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.110421 10241 tablet_bootstrap.cc:492] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:12.117523 10241 tablet_bootstrap.cc:654] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.122025 10240 tablet_bootstrap.cc:654] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.124331 10239 tablet_bootstrap.cc:492] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.125056 10239 ts_tablet_manager.cc:1403] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.011s
I20260709 13:05:12.128023 10239 raft_consensus.cc:359] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.128981 10239 raft_consensus.cc:385] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.129325 10239 raft_consensus.cc:740] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.130074 10239 consensus_queue.cc:260] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.131383 10240 tablet_bootstrap.cc:492] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.131699 10239 ts_tablet_manager.cc:1434] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:12.132138 10240 ts_tablet_manager.cc:1403] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.000s
I20260709 13:05:12.132795 10239 tablet_bootstrap.cc:492] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.134728 10241 tablet_bootstrap.cc:492] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.135321 10241 ts_tablet_manager.cc:1403] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:05:12.136063 10240 raft_consensus.cc:359] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.137084 10240 raft_consensus.cc:385] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.137423 10240 raft_consensus.cc:740] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.138528 10240 consensus_queue.cc:260] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.139446 10241 raft_consensus.cc:359] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.140450 10241 raft_consensus.cc:385] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.140802 10241 raft_consensus.cc:740] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.141418 10240 ts_tablet_manager.cc:1434] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:12.141815 10241 consensus_queue.cc:260] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.142886 10240 tablet_bootstrap.cc:492] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.143203 10239 tablet_bootstrap.cc:654] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.144785 10241 ts_tablet_manager.cc:1434] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 13:05:12.146260 10241 tablet_bootstrap.cc:492] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:12.151479 10240 tablet_bootstrap.cc:654] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.156391 10241 tablet_bootstrap.cc:654] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.160151 10239 tablet_bootstrap.cc:492] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.160785 10239 ts_tablet_manager.cc:1403] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.001s
I20260709 13:05:12.163919 10239 raft_consensus.cc:359] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.164839 10239 raft_consensus.cc:385] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.168402 10239 raft_consensus.cc:740] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.169358 10239 consensus_queue.cc:260] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.172150 10239 ts_tablet_manager.cc:1434] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:05:12.173276 10239 tablet_bootstrap.cc:492] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.179380 10239 tablet_bootstrap.cc:654] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.182637 10241 tablet_bootstrap.cc:492] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.183621 10241 ts_tablet_manager.cc:1403] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.024s
I20260709 13:05:12.186419 10241 raft_consensus.cc:359] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.186816 10240 tablet_bootstrap.cc:492] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.187197 10241 raft_consensus.cc:385] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.187533 10240 ts_tablet_manager.cc:1403] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.045s	user 0.028s	sys 0.012s
I20260709 13:05:12.187747 10241 raft_consensus.cc:740] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.188668 10241 consensus_queue.cc:260] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.190171 10239 tablet_bootstrap.cc:492] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.190832 10241 ts_tablet_manager.cc:1434] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:12.190847 10239 ts_tablet_manager.cc:1403] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 13:05:12.191293 10240 raft_consensus.cc:359] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.192203 10241 tablet_bootstrap.cc:492] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:12.192199 10240 raft_consensus.cc:385] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.192950 10240 raft_consensus.cc:740] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.193825 10240 consensus_queue.cc:260] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.194980 10239 raft_consensus.cc:359] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.195895 10239 raft_consensus.cc:385] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.196283 10239 raft_consensus.cc:740] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.197292 10239 consensus_queue.cc:260] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.199973 10241 tablet_bootstrap.cc:654] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.200287 10240 ts_tablet_manager.cc:1434] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 13:05:12.201519 10240 tablet_bootstrap.cc:492] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.208096 10239 ts_tablet_manager.cc:1434] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:05:12.208649 10240 tablet_bootstrap.cc:654] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.212342 10239 tablet_bootstrap.cc:492] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.220562 10239 tablet_bootstrap.cc:654] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.223868 10241 tablet_bootstrap.cc:492] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.224720 10241 ts_tablet_manager.cc:1403] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.016s
I20260709 13:05:12.228226 10240 tablet_bootstrap.cc:492] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.228217 10241 raft_consensus.cc:359] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.229007 10240 ts_tablet_manager.cc:1403] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 13:05:12.229051 10241 raft_consensus.cc:385] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.229686 10241 raft_consensus.cc:740] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.229723 10239 tablet_bootstrap.cc:492] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.230441 10239 ts_tablet_manager.cc:1403] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:05:12.230643 10241 consensus_queue.cc:260] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.232532 10240 raft_consensus.cc:359] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.233279 10241 ts_tablet_manager.cc:1434] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:05:12.233465 10240 raft_consensus.cc:385] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.234046 10240 raft_consensus.cc:740] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.233646 10239 raft_consensus.cc:359] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.234587 10239 raft_consensus.cc:385] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.234802 10241 tablet_bootstrap.cc:492] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:12.234992 10240 consensus_queue.cc:260] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.235052 10239 raft_consensus.cc:740] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.237308 10239 consensus_queue.cc:260] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.238080 10240 ts_tablet_manager.cc:1434] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:05:12.240399 10239 ts_tablet_manager.cc:1434] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.002s
I20260709 13:05:12.241818 10239 tablet_bootstrap.cc:492] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.244156 10241 tablet_bootstrap.cc:654] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.252641 10239 tablet_bootstrap.cc:654] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:12.254946  9996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:12.259649 10240 tablet_bootstrap.cc:492] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.260444 10241 tablet_bootstrap.cc:492] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.261430 10241 ts_tablet_manager.cc:1403] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.018s
I20260709 13:05:12.266530 10240 tablet_bootstrap.cc:654] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.266162 10241 raft_consensus.cc:359] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.267282 10241 raft_consensus.cc:385] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.267742 10241 raft_consensus.cc:740] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.272753 10241 consensus_queue.cc:260] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.274896 10245 raft_consensus.cc:493] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.274932 10239 tablet_bootstrap.cc:492] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.275640 10241 ts_tablet_manager.cc:1434] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 13:05:12.275841 10239 ts_tablet_manager.cc:1403] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.015s
I20260709 13:05:12.275578 10245 raft_consensus.cc:515] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.277472 10241 tablet_bootstrap.cc:492] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:12.278748 10245 leader_election.cc:290] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.280804 10240 tablet_bootstrap.cc:492] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.281425 10240 ts_tablet_manager.cc:1403] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.002s
I20260709 13:05:12.284672 10240 raft_consensus.cc:359] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.285437 10240 raft_consensus.cc:385] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.285825 10240 raft_consensus.cc:740] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.286537 10240 consensus_queue.cc:260] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.287994 10241 tablet_bootstrap.cc:654] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.291790 10240 ts_tablet_manager.cc:1434] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:05:12.293211 10240 tablet_bootstrap.cc:492] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.301530 10240 tablet_bootstrap.cc:654] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.295130 10239 raft_consensus.cc:359] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.303603 10239 raft_consensus.cc:385] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.304177 10239 raft_consensus.cc:740] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.307435 10240 tablet_bootstrap.cc:492] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.308018 10240 ts_tablet_manager.cc:1403] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:05:12.310657 10240 raft_consensus.cc:359] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.310287 10239 consensus_queue.cc:260] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.311403 10240 raft_consensus.cc:385] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.311884 10240 raft_consensus.cc:740] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.313333 10240 consensus_queue.cc:260] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.318754 10240 ts_tablet_manager.cc:1434] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:05:12.321826 10241 tablet_bootstrap.cc:492] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.322718 10241 ts_tablet_manager.cc:1403] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.027s
I20260709 13:05:12.323213 10239 ts_tablet_manager.cc:1434] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.003s
I20260709 13:05:12.324440 10239 tablet_bootstrap.cc:492] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.327044 10241 raft_consensus.cc:359] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.319911 10240 tablet_bootstrap.cc:492] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.328095 10241 raft_consensus.cc:385] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.328724 10241 raft_consensus.cc:740] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.330117 10241 consensus_queue.cc:260] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.332247 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385ba8f2042241febbda746c9bb96b78" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.333174 10199 raft_consensus.cc:2468] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:12.334860 10090 leader_election.cc:304] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.336400 10240 tablet_bootstrap.cc:654] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.337657 10245 raft_consensus.cc:2804] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.338138 10245 raft_consensus.cc:493] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.338217 10246 raft_consensus.cc:493] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.338547 10245 raft_consensus.cc:3060] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.338958 10246 raft_consensus.cc:515] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.341563 10241 ts_tablet_manager.cc:1434] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:05:12.343137 10241 tablet_bootstrap.cc:492] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:12.343988 10239 tablet_bootstrap.cc:654] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.354393 10246 leader_election.cc:290] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.355228 10246 raft_consensus.cc:493] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.360379 10240 tablet_bootstrap.cc:492] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.361330 10240 ts_tablet_manager.cc:1403] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260709 13:05:12.365898 10240 raft_consensus.cc:359] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.366992 10240 raft_consensus.cc:385] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.367470 10240 raft_consensus.cc:740] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.355842 10246 raft_consensus.cc:515] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.370218 10246 leader_election.cc:290] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.371053 10246 raft_consensus.cc:493] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.371723 10246 raft_consensus.cc:515] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.374619 10246 leader_election.cc:290] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.375244 10245 raft_consensus.cc:515] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.382748 10266 raft_consensus.cc:493] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.384693 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385ba8f2042241febbda746c9bb96b78" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:12.393002 10239 tablet_bootstrap.cc:492] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.393314 10050 raft_consensus.cc:2468] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:12.393411 10241 tablet_bootstrap.cc:654] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.393580 10239 ts_tablet_manager.cc:1403] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.025s
I20260709 13:05:12.394724 10266 raft_consensus.cc:515] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.397068 10266 leader_election.cc:290] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.397118 10239 raft_consensus.cc:359] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.397663 10266 raft_consensus.cc:493] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.397945 10239 raft_consensus.cc:385] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.398304 10239 raft_consensus.cc:740] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.398125 10266 raft_consensus.cc:515] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.399245 10239 consensus_queue.cc:260] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.387952 10240 consensus_queue.cc:260] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.399561 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ef029cf89847d5bc90dec72f9848bf" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.389632 10269 raft_consensus.cc:493] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.401621 10239 ts_tablet_manager.cc:1434] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:12.401582 10269 raft_consensus.cc:515] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.402984 10239 tablet_bootstrap.cc:492] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.403218 10245 leader_election.cc:290] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.401621 10240 ts_tablet_manager.cc:1434] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:05:12.404559 10266 leader_election.cc:290] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.405541 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ef029cf89847d5bc90dec72f9848bf" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
W20260709 13:05:12.408912 10088 leader_election.cc:343] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.410498 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:12.414353 10050 raft_consensus.cc:2468] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:12.415333 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.416152 10088 leader_election.cc:304] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:12.416416 10269 leader_election.cc:290] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.410830 10239 tablet_bootstrap.cc:654] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.411572 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385ba8f2042241febbda746c9bb96b78" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:12.417104 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.417646 10049 raft_consensus.cc:3060] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:12.419102 10015 leader_election.cc:343] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.419248 10269 raft_consensus.cc:2804] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.419739 10269 raft_consensus.cc:493] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.420107 10269 raft_consensus.cc:3060] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.421345 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.422088 10198 raft_consensus.cc:2468] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 0.
I20260709 13:05:12.423296 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385ba8f2042241febbda746c9bb96b78" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.413125 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:12.424579 10048 raft_consensus.cc:2468] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
W20260709 13:05:12.417289 10090 leader_election.cc:343] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.424023 10197 raft_consensus.cc:3060] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.425138 10015 leader_election.cc:304] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.425319 10090 leader_election.cc:304] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d; no voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:12.416219 10199 raft_consensus.cc:2468] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 0.
I20260709 13:05:12.427326 10245 raft_consensus.cc:2749] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.427428 10015 leader_election.cc:304] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.428805 10268 raft_consensus.cc:2804] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.411620 10240 tablet_bootstrap.cc:492] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.429459 10268 raft_consensus.cc:493] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.430359 10268 raft_consensus.cc:3060] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.431416 10246 raft_consensus.cc:2804] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.431885 10246 raft_consensus.cc:493] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.432255 10246 raft_consensus.cc:3060] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.425065 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.433441 10198 raft_consensus.cc:2468] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:12.428711 10088 leader_election.cc:304] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:12.437512 10245 raft_consensus.cc:2804] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.437991 10245 raft_consensus.cc:493] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.438364 10245 raft_consensus.cc:3060] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.438455 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:12.429427 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.439953 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:12.440598 10199 raft_consensus.cc:2468] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:12.441583 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:12.440654 10124 raft_consensus.cc:2468] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 0.
I20260709 13:05:12.442929 10049 raft_consensus.cc:2468] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 1.
I20260709 13:05:12.444855 10197 raft_consensus.cc:2468] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 1.
I20260709 13:05:12.446218 10240 tablet_bootstrap.cc:654] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.446031 10090 leader_election.cc:304] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.447181 10272 raft_consensus.cc:2804] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.447939 10272 raft_consensus.cc:697] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:12.449107 10272 consensus_queue.cc:237] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.451012 10239 tablet_bootstrap.cc:492] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.452005 10239 ts_tablet_manager.cc:1403] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.001s
I20260709 13:05:12.454303 10241 tablet_bootstrap.cc:492] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.455103 10241 ts_tablet_manager.cc:1403] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.008s
I20260709 13:05:12.455190 10268 raft_consensus.cc:515] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.459372 10241 raft_consensus.cc:359] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.459928 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.464483 10197 raft_consensus.cc:3060] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.464803 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:12.465348 10268 leader_election.cc:290] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.465137 10239 raft_consensus.cc:359] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.466991 10239 raft_consensus.cc:385] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.466768 10269 raft_consensus.cc:515] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.467401 10239 raft_consensus.cc:740] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.468169 10123 raft_consensus.cc:2393] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5b39fd125c84087bf29c0d4b747e04e in current term 1: Already voted for candidate 2c755ea83e7548b48d55039aee37517d in this term.
I20260709 13:05:12.468451 10239 consensus_queue.cc:260] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.470971 10239 ts_tablet_manager.cc:1434] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 13:05:12.472309 10239 tablet_bootstrap.cc:492] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:12.474921 10241 raft_consensus.cc:385] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.475353 10241 raft_consensus.cc:740] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.475533 10245 raft_consensus.cc:515] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.476245 10197 raft_consensus.cc:2468] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 1.
I20260709 13:05:12.477672 10015 leader_election.cc:304] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.462255 10275 raft_consensus.cc:493] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.462255 10246 raft_consensus.cc:515] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.478175 10125 raft_consensus.cc:2393] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5b39fd125c84087bf29c0d4b747e04e in current term 1: Already voted for candidate 2c755ea83e7548b48d55039aee37517d in this term.
I20260709 13:05:12.479662 10239 tablet_bootstrap.cc:654] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.478581 10268 raft_consensus.cc:2804] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.480276 10246 leader_election.cc:290] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.479175 10241 consensus_queue.cc:260] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.485474 10240 tablet_bootstrap.cc:492] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.481976 10275 raft_consensus.cc:515] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.486409 10240 ts_tablet_manager.cc:1403] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.005s
I20260709 13:05:12.488961 10247 raft_consensus.cc:493] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.489601 10247 raft_consensus.cc:515] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.485553 10241 ts_tablet_manager.cc:1434] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.003s
I20260709 13:05:12.491748 10241 tablet_bootstrap.cc:492] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:12.493692 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8003ff9dc64c486faae3f3a82bdaa11e" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.494851 10198 raft_consensus.cc:2468] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 0.
I20260709 13:05:12.499409 10247 leader_election.cc:290] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:12.501298 10015 leader_election.cc:304] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.502667 10246 raft_consensus.cc:2804] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.503232 10246 raft_consensus.cc:493] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.503667 10246 raft_consensus.cc:3060] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.504407 10280 raft_consensus.cc:493] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.465117 10016 leader_election.cc:304] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:12.507196 10280 raft_consensus.cc:515] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.483311 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
W20260709 13:05:12.509819 10016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37889, user_credentials={real_user=slave}} blocked reactor thread for 45055.1us
I20260709 13:05:12.511054 10280 leader_election.cc:290] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:12.490166 10240 raft_consensus.cc:359] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.512151 10240 raft_consensus.cc:385] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.512637 10240 raft_consensus.cc:740] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.513103 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:12.514189 10125 raft_consensus.cc:2393] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c5b39fd125c84087bf29c0d4b747e04e in current term 1: Already voted for candidate 2c755ea83e7548b48d55039aee37517d in this term.
I20260709 13:05:12.514207 10240 consensus_queue.cc:260] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.512305 10266 raft_consensus.cc:493] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.516341 10197 raft_consensus.cc:3060] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.516090 10266 raft_consensus.cc:515] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.519600 10266 leader_election.cc:290] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307), c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915)
I20260709 13:05:12.521901 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8003ff9dc64c486faae3f3a82bdaa11e" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.522910 10198 raft_consensus.cc:2468] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:12.524874 10090 leader_election.cc:304] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.526177 10266 raft_consensus.cc:2804] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.526655 10266 raft_consensus.cc:493] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.527112 10266 raft_consensus.cc:3060] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.528709 10246 raft_consensus.cc:515] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.530073 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:12.532737 10049 raft_consensus.cc:2393] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c755ea83e7548b48d55039aee37517d in current term 1: Already voted for candidate c5b39fd125c84087bf29c0d4b747e04e in this term.
I20260709 13:05:12.533869 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8003ff9dc64c486faae3f3a82bdaa11e" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:12.534724 10049 raft_consensus.cc:2393] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c755ea83e7548b48d55039aee37517d in current term 1: Already voted for candidate c5b39fd125c84087bf29c0d4b747e04e in this term.
I20260709 13:05:12.536478 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8003ff9dc64c486faae3f3a82bdaa11e" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.537497 10198 raft_consensus.cc:3060] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.538235 10275 leader_election.cc:290] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:12.538931 10275 raft_consensus.cc:2804] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.539345 10275 raft_consensus.cc:493] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.539708 10275 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.541529 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.542479 10199 raft_consensus.cc:2393] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c755ea83e7548b48d55039aee37517d in current term 1: Already voted for candidate c5b39fd125c84087bf29c0d4b747e04e in this term.
I20260709 13:05:12.542524 10239 tablet_bootstrap.cc:492] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:12.543390 10239 ts_tablet_manager.cc:1403] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.006s
I20260709 13:05:12.546001 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8003ff9dc64c486faae3f3a82bdaa11e" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:12.547957 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8003ff9dc64c486faae3f3a82bdaa11e" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:12.539222 10246 leader_election.cc:290] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Requested vote from peers c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:12.550360 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:12.550967 10198 raft_consensus.cc:2468] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 1.
I20260709 13:05:12.552738 10245 leader_election.cc:290] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.554157 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.553982 10239 raft_consensus.cc:359] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.555593 10239 raft_consensus.cc:385] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.555886 10239 raft_consensus.cc:740] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.556674 10239 consensus_queue.cc:260] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.558785 10239 ts_tablet_manager.cc:1434] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:05:12.558974 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:12.559640 10124 raft_consensus.cc:2468] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:12.560205 10241 tablet_bootstrap.cc:654] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.560890 10240 ts_tablet_manager.cc:1434] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 13:05:12.560659 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:12.561870 10240 tablet_bootstrap.cc:492] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:12.562628 10165 leader_election.cc:304] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.561754 10123 raft_consensus.cc:2468] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:12.564640 10247 raft_consensus.cc:2804] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.565126 10247 raft_consensus.cc:493] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.565495 10247 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.537374 10269 leader_election.cc:290] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.572992 10268 raft_consensus.cc:697] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:12.575939 10165 leader_election.cc:304] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.578197 10241 tablet_bootstrap.cc:492] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.578483 10280 raft_consensus.cc:2804] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.578995 10280 raft_consensus.cc:493] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.579185 10241 ts_tablet_manager.cc:1403] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.010s
I20260709 13:05:12.579348 10280 raft_consensus.cc:3060] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.574759 10268 consensus_queue.cc:237] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.584993 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:12.569062 10266 raft_consensus.cc:515] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.586760 10125 raft_consensus.cc:2393] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5b39fd125c84087bf29c0d4b747e04e in current term 1: Already voted for candidate 2c755ea83e7548b48d55039aee37517d in this term.
I20260709 13:05:12.586623 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:12.586380  9948 catalog_manager.cc:5697] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.589090 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8003ff9dc64c486faae3f3a82bdaa11e" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.589983 10199 raft_consensus.cc:2393] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c755ea83e7548b48d55039aee37517d in current term 1: Already voted for candidate c5b39fd125c84087bf29c0d4b747e04e in this term.
I20260709 13:05:12.591171 10015 leader_election.cc:304] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:12.591964 10278 raft_consensus.cc:493] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.592674 10246 raft_consensus.cc:2804] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.592633 10278 raft_consensus.cc:515] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.594687 10241 raft_consensus.cc:359] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.595582 10241 raft_consensus.cc:385] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.595857 10241 raft_consensus.cc:740] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.596402 10090 leader_election.cc:304] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d; no voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:12.596822 10241 consensus_queue.cc:260] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.597239 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:12.600477 10272 raft_consensus.cc:2749] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:05:12.601747 10016 leader_election.cc:343] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.602166 10247 raft_consensus.cc:515] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.604717 10247 leader_election.cc:290] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:12.605283 10247 raft_consensus.cc:493] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.605743 10247 raft_consensus.cc:515] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.605854 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.606930 10199 raft_consensus.cc:2468] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 0.
I20260709 13:05:12.609154 10015 leader_election.cc:304] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:12.612871 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:12.613816 10125 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.614189 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ef029cf89847d5bc90dec72f9848bf" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:12.607887 10247 leader_election.cc:290] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:12.615125 10123 raft_consensus.cc:2468] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:12.616237 10278 leader_election.cc:290] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.616938 10165 leader_election.cc:304] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.617537 10272 raft_consensus.cc:493] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.618036 10272 raft_consensus.cc:515] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.619046 10278 raft_consensus.cc:2804] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.619688 10278 raft_consensus.cc:493] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.620136 10278 raft_consensus.cc:3060] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.609223 10197 raft_consensus.cc:2468] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 1.
I20260709 13:05:12.621088 10247 raft_consensus.cc:2804] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.621565 10247 raft_consensus.cc:493] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.621913 10247 raft_consensus.cc:3060] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.622608 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8003ff9dc64c486faae3f3a82bdaa11e" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:12.624766 10266 leader_election.cc:290] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Requested vote from peers c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307), c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915)
I20260709 13:05:12.634447 10275 raft_consensus.cc:515] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.635643 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:12.636502 10047 raft_consensus.cc:2468] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:12.638296 10272 leader_election.cc:290] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.638794 10240 tablet_bootstrap.cc:654] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.638252 10088 leader_election.cc:304] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:12.641242 10246 raft_consensus.cc:697] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:12.641039 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:12.641983 10272 raft_consensus.cc:2804] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.642445 10272 raft_consensus.cc:493] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.642310 10198 raft_consensus.cc:2468] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:12.642884 10272 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.643082 10050 raft_consensus.cc:2393] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9ace2311e0e4f63ae2edfc9606ac2cd in current term 1: Already voted for candidate c5b39fd125c84087bf29c0d4b747e04e in this term.
I20260709 13:05:12.643036 10246 consensus_queue.cc:237] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } }
I20260709 13:05:12.647352 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
W20260709 13:05:12.648590 10162 leader_election.cc:343] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.653024 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:12.654069 10050 raft_consensus.cc:2393] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c9ace2311e0e4f63ae2edfc9606ac2cd in current term 1: Already voted for candidate c5b39fd125c84087bf29c0d4b747e04e in this term.
I20260709 13:05:12.655587 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ef029cf89847d5bc90dec72f9848bf" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:12.656322 10050 raft_consensus.cc:2468] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:12.657372 10015 leader_election.cc:304] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:12.659011 10288 raft_consensus.cc:2804] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.659669 10288 raft_consensus.cc:697] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:12.659852 10275 leader_election.cc:290] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.659076  9945 catalog_manager.cc:5697] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.660884 10288 consensus_queue.cc:237] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.661443 10280 raft_consensus.cc:515] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.663802 10088 leader_election.cc:304] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d; no voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:12.665284 10266 raft_consensus.cc:2749] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.665352 10123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:12.666218 10123 raft_consensus.cc:3060] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.666723 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.666834 10278 raft_consensus.cc:515] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.667689 10198 raft_consensus.cc:2393] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c5b39fd125c84087bf29c0d4b747e04e in current term 1: Already voted for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in this term.
I20260709 13:05:12.670287 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:12.670605 10015 leader_election.cc:304] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e; no voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:12.672068 10268 raft_consensus.cc:2749] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:05:12.673506 10016 leader_election.cc:343] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.657410 10241 ts_tablet_manager.cc:1434] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.006s
I20260709 13:05:12.677541 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:12.680239 10280 leader_election.cc:290] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:12.681937 10278 leader_election.cc:290] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.681457 10241 tablet_bootstrap.cc:492] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
W20260709 13:05:12.680305 10162 leader_election.cc:343] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.690379 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.692920 10198 raft_consensus.cc:3060] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.694648 10088 leader_election.cc:304] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d; no voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:12.696710 10266 raft_consensus.cc:2749] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.707163 10123 raft_consensus.cc:2468] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:12.708359 10247 raft_consensus.cc:515] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.708699 10272 raft_consensus.cc:515] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.711696 10247 leader_election.cc:290] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:12.714811 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ef029cf89847d5bc90dec72f9848bf" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:12.715451 10272 leader_election.cc:290] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:12.715662 10124 raft_consensus.cc:3060] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.716825 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:12.717486 10050 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.723785 10165 leader_election.cc:304] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:12.714828 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ef029cf89847d5bc90dec72f9848bf" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:12.729821 10240 tablet_bootstrap.cc:492] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:12.730376 10240 ts_tablet_manager.cc:1403] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.169s	user 0.022s	sys 0.034s
I20260709 13:05:12.727612 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:12.730973 10048 raft_consensus.cc:3060] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.732940 10197 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.740864 10048 raft_consensus.cc:2468] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:12.741434 10197 raft_consensus.cc:2468] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 1.
I20260709 13:05:12.742463 10162 leader_election.cc:304] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.743041 10090 leader_election.cc:304] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:12.743541 10280 raft_consensus.cc:2804] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.744055 10272 raft_consensus.cc:2804] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.744506 10280 raft_consensus.cc:697] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:12.745332 10272 raft_consensus.cc:697] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:12.745774 10280 consensus_queue.cc:237] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.746101 10272 consensus_queue.cc:237] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.747390 10198 raft_consensus.cc:2468] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 1.
I20260709 13:05:12.748113 10125 raft_consensus.cc:2468] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:12.748725 10015 leader_election.cc:304] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:12.744650 10124 raft_consensus.cc:2468] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:12.749370 10050 raft_consensus.cc:2468] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 1.
I20260709 13:05:12.750396 10165 leader_election.cc:304] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:12.732201 10247 raft_consensus.cc:2804] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.751811 10285 raft_consensus.cc:2804] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.756161 10288 raft_consensus.cc:2804] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.758026 10240 raft_consensus.cc:359] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.758512 10288 raft_consensus.cc:697] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:12.758960 10240 raft_consensus.cc:385] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.762633 10240 raft_consensus.cc:740] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.761852 10247 raft_consensus.cc:697] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:12.763618 10240 consensus_queue.cc:260] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.763718 10247 consensus_queue.cc:237] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.766023 10240 ts_tablet_manager.cc:1434] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:05:12.765848  9945 catalog_manager.cc:5697] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.759727 10288 consensus_queue.cc:237] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.762262 10241 tablet_bootstrap.cc:654] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.774464 10285 raft_consensus.cc:697] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:12.776539 10285 consensus_queue.cc:237] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.779281 10241 tablet_bootstrap.cc:492] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:12.779963 10241 ts_tablet_manager.cc:1403] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.005s
I20260709 13:05:12.783161 10241 raft_consensus.cc:359] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.783919 10241 raft_consensus.cc:385] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.784216 10241 raft_consensus.cc:740] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.784142  9948 catalog_manager.cc:5697] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.787914 10241 consensus_queue.cc:260] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:12.790346 10241 ts_tablet_manager.cc:1434] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:12.799005  9946 catalog_manager.cc:5697] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.798919  9945 catalog_manager.cc:5697] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.801304  9945 catalog_manager.cc:5697] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.801532  9946 catalog_manager.cc:5697] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.803360  9946 catalog_manager.cc:5697] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.901038 10272 consensus_queue.cc:1048] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.914920 10266 consensus_queue.cc:1048] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.024669 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
mode: GRACEFUL
new_leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:54514
I20260709 13:05:13.025234 10198 raft_consensus.cc:606] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Received request to transfer leadership to TS c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:13.040375 10124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "385ba8f2042241febbda746c9bb96b78"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
mode: GRACEFUL
new_leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:39490
I20260709 13:05:13.040982 10124 raft_consensus.cc:606] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Received request to transfer leadership to TS c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:13.047498 10124 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
mode: GRACEFUL
new_leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:39490
I20260709 13:05:13.048157 10124 raft_consensus.cc:606] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Received request to transfer leadership to TS c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:13.064546 10050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
mode: GRACEFUL
new_leader_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:44848
I20260709 13:05:13.065083 10050 raft_consensus.cc:606] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Received request to transfer leadership to TS 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:13.071321 10198 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2b8bb477df64462a43529bc66839022"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
mode: GRACEFUL
new_leader_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:54514
I20260709 13:05:13.072098 10198 raft_consensus.cc:606] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Received request to transfer leadership to TS 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:13.078691 10050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
mode: GRACEFUL
new_leader_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:44848
I20260709 13:05:13.078972 10288 consensus_queue.cc:1048] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.079476 10050 raft_consensus.cc:606] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Received request to transfer leadership to TS 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:13.090745 10050 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1672e25d2e934530932794c0a0482107"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
mode: GRACEFUL
new_leader_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:44848
I20260709 13:05:13.091428 10050 raft_consensus.cc:606] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Received request to transfer leadership to TS 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:13.099282 10278 consensus_queue.cc:1048] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.183421 10285 consensus_queue.cc:1048] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:13.186422 10124 raft_consensus.cc:3060] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.188055 10268 consensus_queue.cc:1048] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.191972 10246 consensus_queue.cc:1048] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.194200 10246 consensus_queue.cc:1048] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.196067 10246 consensus_queue.cc:1048] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.209911 10278 raft_consensus.cc:993] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e: : Instructing follower 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:13.210745 10278 raft_consensus.cc:1081] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Signalling peer 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:13.213429 10125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1672e25d2e934530932794c0a0482107"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:39468
I20260709 13:05:13.214500 10125 raft_consensus.cc:493] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.215000 10125 raft_consensus.cc:3060] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.230723 10048 raft_consensus.cc:3060] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.254736 10246 consensus_queue.cc:1048] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.257404 10266 raft_consensus.cc:493] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.258876 10266 raft_consensus.cc:515] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.261759 10272 consensus_queue.cc:1048] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.261169 10285 consensus_queue.cc:1048] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 13:05:13.289108 10316 log.cc:927] Time spent T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:05:13.296531 10272 consensus_queue.cc:1048] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.299624 10275 raft_consensus.cc:993] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e: : Instructing follower 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:13.302515 10266 leader_election.cc:290] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.313059 10285 consensus_queue.cc:1048] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:13.325133 10289 raft_consensus.cc:1081] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Signalling peer 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:13.337905 10196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:13.339258 10196 raft_consensus.cc:2468] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 1.
I20260709 13:05:13.348853 10297 consensus_queue.cc:1048] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.328896 10285 consensus_queue.cc:1048] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 13:05:13.365087 10315 log.cc:927] Time spent T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd: Append to log took a long time: real 0.086s	user 0.005s	sys 0.000s
I20260709 13:05:13.368328 10090 leader_election.cc:304] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:13.376436 10275 consensus_queue.cc:1048] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.400468 10272 raft_consensus.cc:2804] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.392442 10125 raft_consensus.cc:515] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.404685 10122 raft_consensus.cc:1240] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Rejecting Update request from peer c5b39fd125c84087bf29c0d4b747e04e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.406059 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:13.406929 10197 raft_consensus.cc:3060] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.409724 10246 raft_consensus.cc:493] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.410490 10246 raft_consensus.cc:515] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.411147 10272 raft_consensus.cc:493] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5b39fd125c84087bf29c0d4b747e04e)
I20260709 13:05:13.411939 10272 raft_consensus.cc:3060] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.414572 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:13.415058 10289 consensus_queue.cc:1059] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.416929 10289 raft_consensus.cc:3055] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.420219 10289 raft_consensus.cc:740] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:13.418315 10247 consensus_queue.cc:1048] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.421566 10125 leader_election.cc:290] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.419070 10297 raft_consensus.cc:993] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd: : Instructing follower 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:13.424750 10297 raft_consensus.cc:1081] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Signalling peer 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:13.431229 10122 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:39468
I20260709 13:05:13.440155 10122 raft_consensus.cc:493] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.441109 10122 raft_consensus.cc:3060] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.430639 10197 raft_consensus.cc:2468] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:13.455031 10125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2b8bb477df64462a43529bc66839022"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:39478
I20260709 13:05:13.456095 10246 leader_election.cc:290] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.459559 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:13.421583 10289 consensus_queue.cc:260] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.465039 10289 raft_consensus.cc:3060] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.480877 10049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1672e25d2e934530932794c0a0482107" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:13.506209 10090 leader_election.cc:304] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:13.511077 10297 raft_consensus.cc:993] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd: : Instructing follower c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:13.512189 10319 raft_consensus.cc:1081] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Signalling peer c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:13.515451 10050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:44838
I20260709 13:05:13.516608 10050 raft_consensus.cc:493] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.517206 10050 raft_consensus.cc:3060] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.530968 10049 raft_consensus.cc:2468] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:13.545418 10124 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:13.546728 10246 raft_consensus.cc:993] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e: : Instructing follower 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:13.547622 10288 raft_consensus.cc:1081] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Signalling peer 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:13.557930 10272 raft_consensus.cc:515] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.561685 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:13.562666 10272 leader_election.cc:290] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.563318 10272 raft_consensus.cc:993] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d: : Instructing follower c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:13.562350 10331 raft_consensus.cc:993] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d: : Instructing follower c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:13.566428 10272 raft_consensus.cc:1081] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Signalling peer c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:13.567099 10331 raft_consensus.cc:1081] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Signalling peer c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:13.572423 10327 raft_consensus.cc:2804] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.611092 10327 raft_consensus.cc:697] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:13.613345 10327 consensus_queue.cc:237] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
W20260709 13:05:13.617238 10088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40915, user_credentials={real_user=slave}} blocked reactor thread for 91813.5us
I20260709 13:05:13.620010 10016 leader_election.cc:304] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e; no voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:13.623539 10046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "385ba8f2042241febbda746c9bb96b78"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:05:13.624341 10046 raft_consensus.cc:493] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.624511 10124 raft_consensus.cc:1240] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Rejecting Update request from peer c5b39fd125c84087bf29c0d4b747e04e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.624727 10046 raft_consensus.cc:3060] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.625849 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:13.626427 10120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:39468
I20260709 13:05:13.626976 10120 raft_consensus.cc:493] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.627242 10120 raft_consensus.cc:3060] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.627674 10125 raft_consensus.cc:493] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.628237 10125 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.630086 10045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:05:13.630941 10045 raft_consensus.cc:493] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:13.631376 10045 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.636165 10122 raft_consensus.cc:515] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.637918 10125 raft_consensus.cc:515] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.640090 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:13.640772 10198 raft_consensus.cc:3060] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.643134 10046 raft_consensus.cc:515] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.643147 10120 raft_consensus.cc:515] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.646013 10120 leader_election.cc:290] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 3 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.649034 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:13.649791 10197 raft_consensus.cc:3060] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.650044 10050 raft_consensus.cc:515] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.651090 10288 raft_consensus.cc:2749] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:13.651980 10047 raft_consensus.cc:1240] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Rejecting Update request from peer c9ace2311e0e4f63ae2edfc9606ac2cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.653852 10045 raft_consensus.cc:515] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.655869 10297 consensus_queue.cc:1059] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.657271 10297 raft_consensus.cc:3055] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.657634 10297 raft_consensus.cc:740] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:13.658720 10297 consensus_queue.cc:260] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.660084 10297 raft_consensus.cc:3060] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.662985 10199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:13.663568 10197 raft_consensus.cc:2468] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 3.
I20260709 13:05:13.663748 10199 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.666915 10088 leader_election.cc:304] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d; no voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:13.668187 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385ba8f2042241febbda746c9bb96b78" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:13.668764 10046 leader_election.cc:290] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.669524 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:13.670101 10198 raft_consensus.cc:2468] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:13.670297 10121 raft_consensus.cc:3055] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.670825 10121 raft_consensus.cc:740] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:13.670965 10122 leader_election.cc:290] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.671000 10050 leader_election.cc:290] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.672137 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216ec5b1720144aca4d4675cbc6fabf6" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:13.672626 10327 raft_consensus.cc:2749] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:13.672973 10125 leader_election.cc:290] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.673861 10246 consensus_queue.cc:1059] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.673969 10121 consensus_queue.cc:260] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.675463 10121 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:13.677120 10327 consensus_queue.cc:1175] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c5b39fd125c84087bf29c0d4b747e04e" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:05:13.678637 10090 leader_election.cc:304] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:13.679795 10090 leader_election.cc:304] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:13.680857 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:13.681159 10330 raft_consensus.cc:2804] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:13.681854 10330 raft_consensus.cc:697] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 3 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:13.672822 10047 raft_consensus.cc:3055] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.682544 10047 raft_consensus.cc:740] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:13.682888 10334 raft_consensus.cc:2804] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.682822 10330 consensus_queue.cc:237] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.683799 10334 raft_consensus.cc:697] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:13.683749 10047 consensus_queue.cc:260] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.668808 10120 raft_consensus.cc:3055] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.685489 10047 raft_consensus.cc:3060] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.685420 10334 consensus_queue.cc:237] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.684900 10120 raft_consensus.cc:740] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:13.693400 10120 consensus_queue.cc:260] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.694187 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:13.695048 10050 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.691713 10121 raft_consensus.cc:2468] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:13.695355 10120 raft_consensus.cc:3060] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.699014 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29c57ecf7faa412ab93e405d8b1e2ef7" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:13.699772 10046 raft_consensus.cc:3055] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.692849 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:13.700011 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93dc29fbefa4cbfaab40efabbc77e46" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:13.701979 10125 raft_consensus.cc:3060] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.695407 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "385ba8f2042241febbda746c9bb96b78" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:13.703125 10197 raft_consensus.cc:3060] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.705904 10199 raft_consensus.cc:2468] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:13.715014 10125 raft_consensus.cc:2468] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:13.712369 10195 raft_consensus.cc:2468] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:13.700182 10045 leader_election.cc:290] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:13.712318 10198 raft_consensus.cc:3055] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:13.716822 10198 raft_consensus.cc:740] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:13.717108 10120 raft_consensus.cc:2468] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:13.713675 10016 leader_election.cc:304] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:13.712440 10046 raft_consensus.cc:740] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:13.717271 10197 raft_consensus.cc:2468] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:13.718886 10016 leader_election.cc:304] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:13.719600 10046 consensus_queue.cc:260] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.721153 10046 raft_consensus.cc:3060] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.722668 10047 raft_consensus.cc:2468] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 3.
I20260709 13:05:13.722738 10015 leader_election.cc:304] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
W20260709 13:05:13.723354 10289 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 3 is higher.
I20260709 13:05:13.723853 10288 raft_consensus.cc:2804] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.726575 10288 raft_consensus.cc:697] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:13.726383 10198 consensus_queue.cc:260] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.727787 10288 consensus_queue.cc:237] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.712316 10050 raft_consensus.cc:2468] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:13.729161 10046 raft_consensus.cc:2468] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:13.724188 10246 raft_consensus.cc:2804] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.730342 10246 raft_consensus.cc:697] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:13.729882  9947 catalog_manager.cc:5697] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 1 to 2, leader changed from c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193) to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.731389 10246 consensus_queue.cc:237] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.732484 10289 raft_consensus.cc:2804] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.733026 10289 raft_consensus.cc:697] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:13.734097 10289 consensus_queue.cc:237] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.735577 10088 leader_election.cc:304] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:13.728029 10198 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.742727 10334 raft_consensus.cc:2804] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:13.743397 10334 raft_consensus.cc:697] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:13.744513 10334 consensus_queue.cc:237] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:13.745378 10198 raft_consensus.cc:2468] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:13.750895  9945 catalog_manager.cc:5697] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 1 to 2, leader changed from 2c755ea83e7548b48d55039aee37517d (127.0.107.194) to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.761955  9947 catalog_manager.cc:5697] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 1 to 2, leader changed from c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195) to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.763554  9947 catalog_manager.cc:5697] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 1 to 3, leader changed from c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193) to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.765136  9947 catalog_manager.cc:5697] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 1 to 2, leader changed from c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193) to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.767851  9945 catalog_manager.cc:5697] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 1 to 2, leader changed from c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195) to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.769881  9945 catalog_manager.cc:5697] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 1 to 2, leader changed from 2c755ea83e7548b48d55039aee37517d (127.0.107.194) to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.112763 10046 raft_consensus.cc:1275] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.114490 10334 consensus_queue.cc:1048] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.118700 10125 raft_consensus.cc:1275] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.121165 10288 consensus_queue.cc:1048] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:14.122123 10198 raft_consensus.cc:1275] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:14.124531 10330 consensus_queue.cc:1048] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:14.131703 10195 raft_consensus.cc:1275] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.133816 10330 consensus_queue.cc:1048] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.144680 10050 raft_consensus.cc:1275] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:14.148077 10327 consensus_queue.cc:1048] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:14.162634 10195 raft_consensus.cc:1275] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.164695 10289 consensus_queue.cc:1048] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.207823 10046 raft_consensus.cc:1275] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.209628 10327 consensus_queue.cc:1048] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.219061 10195 raft_consensus.cc:1275] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.220918 10327 consensus_queue.cc:1048] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.227594 10198 raft_consensus.cc:1275] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.229859 10289 consensus_queue.cc:1048] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:14.246999 10125 raft_consensus.cc:1275] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.250115 10288 consensus_queue.cc:1048] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:14.254536 10120 raft_consensus.cc:1275] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.259286 10246 consensus_queue.cc:1048] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.268378 10046 raft_consensus.cc:1275] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.270490 10327 consensus_queue.cc:1048] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.272519 10198 raft_consensus.cc:1275] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.275425 10289 consensus_queue.cc:1048] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.295524 10195 raft_consensus.cc:1275] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:14.298149 10334 consensus_queue.cc:1048] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:16.146723  9947 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52222:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:16.150921  9947 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:16.215806 10039 tablet_service.cc:1511] Processing CreateTablet for tablet ad33365d4b2c4861b6c6c32f7821d83a (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:16.216499 10109 tablet_service.cc:1511] Processing CreateTablet for tablet ad33365d4b2c4861b6c6c32f7821d83a (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:16.217772 10183 tablet_service.cc:1511] Processing CreateTablet for tablet ad33365d4b2c4861b6c6c32f7821d83a (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:16.218570 10109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad33365d4b2c4861b6c6c32f7821d83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.219851 10183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad33365d4b2c4861b6c6c32f7821d83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.218276 10039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad33365d4b2c4861b6c6c32f7821d83a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.225517 10184 tablet_service.cc:1511] Processing CreateTablet for tablet f635b52cce78424aac4b15f34ef95f42 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:16.227361 10184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f635b52cce78424aac4b15f34ef95f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.231801 10185 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1e9f4cd898479a9ce3ebf9068985a5 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:16.234710 10114 tablet_service.cc:1511] Processing CreateTablet for tablet f635b52cce78424aac4b15f34ef95f42 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:16.235595 10038 tablet_service.cc:1511] Processing CreateTablet for tablet bc09e89b97344b13a7b9283e35bd39a1 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:16.236657 10114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f635b52cce78424aac4b15f34ef95f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.237134 10038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc09e89b97344b13a7b9283e35bd39a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.237864 10032 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1e9f4cd898479a9ce3ebf9068985a5 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:16.238418 10186 tablet_service.cc:1511] Processing CreateTablet for tablet bc09e89b97344b13a7b9283e35bd39a1 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:16.239506 10032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1e9f4cd898479a9ce3ebf9068985a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.243814 10107 tablet_service.cc:1511] Processing CreateTablet for tablet bc09e89b97344b13a7b9283e35bd39a1 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:16.244714 10187 tablet_service.cc:1511] Processing CreateTablet for tablet ae3e982bee53440996e25dffe76875d1 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:16.244280 10112 tablet_service.cc:1511] Processing CreateTablet for tablet 1a1e9f4cd898479a9ce3ebf9068985a5 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:16.250254 10115 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7c16fe8bbb4d57b242298efe0d7a77 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:16.254011 10189 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7c16fe8bbb4d57b242298efe0d7a77 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:16.234884 10037 tablet_service.cc:1511] Processing CreateTablet for tablet f635b52cce78424aac4b15f34ef95f42 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:16.255817 10037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f635b52cce78424aac4b15f34ef95f42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.247205 10108 tablet_service.cc:1511] Processing CreateTablet for tablet ae3e982bee53440996e25dffe76875d1 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:16.260198 10040 tablet_service.cc:1511] Processing CreateTablet for tablet ae3e982bee53440996e25dffe76875d1 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:16.262133 10040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3e982bee53440996e25dffe76875d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.247263 10185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1e9f4cd898479a9ce3ebf9068985a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.262866 10036 tablet_service.cc:1511] Processing CreateTablet for tablet c0685c9ec507448db626053896fe5602 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:16.267405 10034 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7c16fe8bbb4d57b242298efe0d7a77 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:16.269327 10035 tablet_service.cc:1511] Processing CreateTablet for tablet 128a8114799a498193bab8a2012537ff (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:16.270476 10033 tablet_service.cc:1511] Processing CreateTablet for tablet 49597fd27b47492e8d6d108a9c2733bb (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:16.274240 10181 tablet_service.cc:1511] Processing CreateTablet for tablet 128a8114799a498193bab8a2012537ff (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:16.276381 10181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128a8114799a498193bab8a2012537ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.279621 10186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc09e89b97344b13a7b9283e35bd39a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.265496 10188 tablet_service.cc:1511] Processing CreateTablet for tablet 49597fd27b47492e8d6d108a9c2733bb (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:16.286082 10188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49597fd27b47492e8d6d108a9c2733bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.273418 10182 tablet_service.cc:1511] Processing CreateTablet for tablet c0685c9ec507448db626053896fe5602 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:16.288486 10115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7c16fe8bbb4d57b242298efe0d7a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.289563 10182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0685c9ec507448db626053896fe5602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.292538 10108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3e982bee53440996e25dffe76875d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.292832 10189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7c16fe8bbb4d57b242298efe0d7a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.296628 10187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3e982bee53440996e25dffe76875d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.304453 10110 tablet_service.cc:1511] Processing CreateTablet for tablet 49597fd27b47492e8d6d108a9c2733bb (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:16.309228 10111 tablet_service.cc:1511] Processing CreateTablet for tablet c0685c9ec507448db626053896fe5602 (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:16.311522 10112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a1e9f4cd898479a9ce3ebf9068985a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.312906 10036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0685c9ec507448db626053896fe5602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.332728 10035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128a8114799a498193bab8a2012537ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.333462 10034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7c16fe8bbb4d57b242298efe0d7a77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.316020 10113 tablet_service.cc:1511] Processing CreateTablet for tablet 128a8114799a498193bab8a2012537ff (DEFAULT_TABLE table=soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:16.337204 10033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49597fd27b47492e8d6d108a9c2733bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.352329 10110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49597fd27b47492e8d6d108a9c2733bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.356591 10113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 128a8114799a498193bab8a2012537ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.359227 10111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0685c9ec507448db626053896fe5602. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.362932 10107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc09e89b97344b13a7b9283e35bd39a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:16.467286 10361 tablet_bootstrap.cc:492] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:16.468796 10359 tablet_bootstrap.cc:492] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.480301 10360 tablet_bootstrap.cc:492] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:16.480803 10359 tablet_bootstrap.cc:654] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.492259 10361 tablet_bootstrap.cc:654] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.504349 10360 tablet_bootstrap.cc:654] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.506038 10359 tablet_bootstrap.cc:492] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.506744 10359 ts_tablet_manager.cc:1403] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.005s
I20260709 13:05:16.525961 10359 raft_consensus.cc:359] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.526867 10359 raft_consensus.cc:385] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.527216 10359 raft_consensus.cc:740] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.531395 10359 consensus_queue.cc:260] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.537319 10359 ts_tablet_manager.cc:1434] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:05:16.539034 10359 tablet_bootstrap.cc:492] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.539296 10361 tablet_bootstrap.cc:492] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:16.539927 10361 ts_tablet_manager.cc:1403] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.025s
I20260709 13:05:16.543761 10361 raft_consensus.cc:359] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.544716 10361 raft_consensus.cc:385] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.545053 10361 raft_consensus.cc:740] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.545884 10361 consensus_queue.cc:260] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.547132 10359 tablet_bootstrap.cc:654] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.548661 10361 ts_tablet_manager.cc:1434] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:05:16.550220 10361 tablet_bootstrap.cc:492] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:16.552276 10360 tablet_bootstrap.cc:492] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:16.553082 10360 ts_tablet_manager.cc:1403] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.011s
I20260709 13:05:16.556906 10360 raft_consensus.cc:359] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.557857 10360 raft_consensus.cc:385] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.558184 10360 raft_consensus.cc:740] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
W20260709 13:05:16.558669  9996 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:16.559231 10360 consensus_queue.cc:260] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.560415 10361 tablet_bootstrap.cc:654] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.562716 10360 ts_tablet_manager.cc:1434] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:05:16.564117 10360 tablet_bootstrap.cc:492] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:16.573704 10360 tablet_bootstrap.cc:654] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.577124 10361 tablet_bootstrap.cc:492] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:16.577960 10361 ts_tablet_manager.cc:1403] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.007s
I20260709 13:05:16.582278 10361 raft_consensus.cc:359] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.583315 10361 raft_consensus.cc:385] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.583699 10361 raft_consensus.cc:740] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.584923 10361 consensus_queue.cc:260] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.589241 10361 ts_tablet_manager.cc:1434] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.003s
I20260709 13:05:16.588195 10360 tablet_bootstrap.cc:492] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:16.590692 10360 ts_tablet_manager.cc:1403] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.006s
I20260709 13:05:16.594868 10360 raft_consensus.cc:359] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.595736 10360 raft_consensus.cc:385] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.596088 10360 raft_consensus.cc:740] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.596351 10361 tablet_bootstrap.cc:492] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:16.597314 10360 consensus_queue.cc:260] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.603982 10360 ts_tablet_manager.cc:1434] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:05:16.605051 10360 tablet_bootstrap.cc:492] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:16.606788 10361 tablet_bootstrap.cc:654] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.609951 10359 tablet_bootstrap.cc:492] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.610533 10359 ts_tablet_manager.cc:1403] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.072s	user 0.027s	sys 0.027s
I20260709 13:05:16.610904 10360 tablet_bootstrap.cc:654] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.613873 10359 raft_consensus.cc:359] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.614892 10359 raft_consensus.cc:385] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.615545 10359 raft_consensus.cc:740] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.617064 10359 consensus_queue.cc:260] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.624207 10358 raft_consensus.cc:493] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.625226 10358 raft_consensus.cc:515] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.636900 10359 ts_tablet_manager.cc:1434] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 13:05:16.638185 10359 tablet_bootstrap.cc:492] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.646019 10359 tablet_bootstrap.cc:654] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.648555 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
W20260709 13:05:16.650439 10016 leader_election.cc:343] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.650563 10358 leader_election.cc:290] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:16.651732 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
W20260709 13:05:16.653510 10015 leader_election.cc:343] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.653977 10015 leader_election.cc:304] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e; no voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:16.655200 10358 raft_consensus.cc:2749] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.662804 10359 tablet_bootstrap.cc:492] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.663578 10359 ts_tablet_manager.cc:1403] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 13:05:16.665066 10360 tablet_bootstrap.cc:492] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:16.665710 10360 ts_tablet_manager.cc:1403] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.014s
I20260709 13:05:16.667155 10359 raft_consensus.cc:359] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.667943 10359 raft_consensus.cc:385] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.668215 10361 tablet_bootstrap.cc:492] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:16.668289 10359 raft_consensus.cc:740] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.669113 10361 ts_tablet_manager.cc:1403] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.023s
I20260709 13:05:16.669193 10360 raft_consensus.cc:359] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.670190 10360 raft_consensus.cc:385] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.669871 10359 consensus_queue.cc:260] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.670583 10360 raft_consensus.cc:740] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.671525 10360 consensus_queue.cc:260] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.672837 10359 ts_tablet_manager.cc:1434] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.005s
I20260709 13:05:16.674271 10360 ts_tablet_manager.cc:1434] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:05:16.674657 10359 tablet_bootstrap.cc:492] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.675487 10360 tablet_bootstrap.cc:492] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:16.683158 10359 tablet_bootstrap.cc:654] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.683983 10360 tablet_bootstrap.cc:654] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.695775 10361 raft_consensus.cc:359] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.696663 10361 raft_consensus.cc:385] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.696974 10361 raft_consensus.cc:740] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.697340 10359 tablet_bootstrap.cc:492] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.697561 10360 tablet_bootstrap.cc:492] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:16.697892 10359 ts_tablet_manager.cc:1403] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 13:05:16.698323 10360 ts_tablet_manager.cc:1403] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:05:16.697777 10361 consensus_queue.cc:260] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.700716 10361 ts_tablet_manager.cc:1434] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.002s
I20260709 13:05:16.701835 10361 tablet_bootstrap.cc:492] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:16.701390 10359 raft_consensus.cc:359] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.702364 10360 raft_consensus.cc:359] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.702973 10359 raft_consensus.cc:385] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.703243 10360 raft_consensus.cc:385] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.703380 10359 raft_consensus.cc:740] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.703794 10360 raft_consensus.cc:740] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.704893 10360 consensus_queue.cc:260] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.704989 10359 consensus_queue.cc:260] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.707865 10359 ts_tablet_manager.cc:1434] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:16.708992 10359 tablet_bootstrap.cc:492] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.709913 10361 tablet_bootstrap.cc:654] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.711223 10360 ts_tablet_manager.cc:1434] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:05:16.712484 10360 tablet_bootstrap.cc:492] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:16.717036 10359 tablet_bootstrap.cc:654] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.723528 10361 tablet_bootstrap.cc:492] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:16.723875 10358 raft_consensus.cc:493] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.724255 10361 ts_tablet_manager.cc:1403] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:05:16.724534 10358 raft_consensus.cc:515] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.728619 10358 leader_election.cc:290] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:16.728528 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad33365d4b2c4861b6c6c32f7821d83a" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:16.729318 10360 tablet_bootstrap.cc:654] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:16.730863 10016 leader_election.cc:343] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.734357 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad33365d4b2c4861b6c6c32f7821d83a" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:16.735608 10198 raft_consensus.cc:2468] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 0.
I20260709 13:05:16.736745 10361 raft_consensus.cc:359] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.737882 10361 raft_consensus.cc:385] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.738245 10361 raft_consensus.cc:740] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.739431 10361 consensus_queue.cc:260] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.742448 10015 leader_election.cc:304] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:16.743455 10358 raft_consensus.cc:2804] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.743862 10358 raft_consensus.cc:493] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.744204 10358 raft_consensus.cc:3060] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.744742 10359 tablet_bootstrap.cc:492] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.745728 10359 ts_tablet_manager.cc:1403] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.011s
I20260709 13:05:16.746110 10361 ts_tablet_manager.cc:1434] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.008s
I20260709 13:05:16.748903 10359 raft_consensus.cc:359] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.749691 10359 raft_consensus.cc:385] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.749967 10359 raft_consensus.cc:740] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.750751 10359 consensus_queue.cc:260] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.751705 10361 tablet_bootstrap.cc:492] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:16.752542 10359 ts_tablet_manager.cc:1434] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:05:16.753568 10359 tablet_bootstrap.cc:492] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.759392 10361 tablet_bootstrap.cc:654] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.760141 10359 tablet_bootstrap.cc:654] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.765233 10360 tablet_bootstrap.cc:492] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:16.766646 10361 tablet_bootstrap.cc:492] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:16.768612 10297 raft_consensus.cc:493] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.768872 10360 ts_tablet_manager.cc:1403] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.005s
I20260709 13:05:16.768877 10361 ts_tablet_manager.cc:1403] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:05:16.768900 10370 raft_consensus.cc:493] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.769183 10297 raft_consensus.cc:515] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.770067 10370 raft_consensus.cc:515] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.772579 10360 raft_consensus.cc:359] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.772718 10361 raft_consensus.cc:359] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.773551 10361 raft_consensus.cc:385] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.773813 10361 raft_consensus.cc:740] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.774703 10359 tablet_bootstrap.cc:492] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.774616 10361 consensus_queue.cc:260] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.775379 10359 ts_tablet_manager.cc:1403] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.005s
I20260709 13:05:16.775192 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128a8114799a498193bab8a2012537ff" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:16.775714 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128a8114799a498193bab8a2012537ff" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:16.776528 10120 raft_consensus.cc:2468] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:16.777021 10361 ts_tablet_manager.cc:1434] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:05:16.778143 10361 tablet_bootstrap.cc:492] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:16.774389 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:16.778606 10359 raft_consensus.cc:359] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.779258 10046 raft_consensus.cc:2468] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:16.779412 10359 raft_consensus.cc:385] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.779874 10359 raft_consensus.cc:740] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.778460 10297 leader_election.cc:290] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:16.774539 10370 leader_election.cc:290] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:16.780750 10359 consensus_queue.cc:260] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.778062 10165 leader_election.cc:304] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:16.782708 10359 ts_tablet_manager.cc:1434] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:16.767542 10358 raft_consensus.cc:515] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.783653 10297 raft_consensus.cc:2804] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.784601 10297 raft_consensus.cc:493] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.785004 10297 raft_consensus.cc:3060] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.783886 10359 tablet_bootstrap.cc:492] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.786245 10361 tablet_bootstrap.cc:654] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:16.782734 10162 leader_election.cc:343] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.792619 10162 leader_election.cc:304] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:16.790079 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:16.794776 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad33365d4b2c4861b6c6c32f7821d83a" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:16.795258 10360 raft_consensus.cc:385] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.795555 10125 raft_consensus.cc:3060] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:16.796028 10165 leader_election.cc:343] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.795935 10360 raft_consensus.cc:740] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.797904 10370 raft_consensus.cc:2804] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.798110 10360 consensus_queue.cc:260] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.805972 10125 raft_consensus.cc:2468] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 1.
I20260709 13:05:16.806854 10359 tablet_bootstrap.cc:654] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.807569 10370 raft_consensus.cc:493] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.808085 10370 raft_consensus.cc:3060] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.808270 10016 leader_election.cc:304] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:16.809295 10345 raft_consensus.cc:2804] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.809757 10345 raft_consensus.cc:697] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:16.810812 10345 consensus_queue.cc:237] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.811913 10360 ts_tablet_manager.cc:1434] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.003s
I20260709 13:05:16.814108 10360 tablet_bootstrap.cc:492] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:16.816851 10358 leader_election.cc:290] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:16.818436 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad33365d4b2c4861b6c6c32f7821d83a" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:16.819515 10195 raft_consensus.cc:3060] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.823072 10297 raft_consensus.cc:515] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.830942 10370 raft_consensus.cc:515] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.836249 10359 tablet_bootstrap.cc:492] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.837150 10359 ts_tablet_manager.cc:1403] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.002s
I20260709 13:05:16.836303 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128a8114799a498193bab8a2012537ff" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
W20260709 13:05:16.841521 10162 leader_election.cc:343] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.842888 10359 raft_consensus.cc:359] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.844002 10297 leader_election.cc:290] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:16.844719 10360 tablet_bootstrap.cc:654] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.844780 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "128a8114799a498193bab8a2012537ff" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:16.844122 10359 raft_consensus.cc:385] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.846648 10359 raft_consensus.cc:740] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.846129 10125 raft_consensus.cc:3060] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.847803 10359 consensus_queue.cc:260] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.848533 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:16.849396 10046 raft_consensus.cc:3060] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.851238 10359 ts_tablet_manager.cc:1434] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 13:05:16.852917 10359 tablet_bootstrap.cc:492] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.858574 10046 raft_consensus.cc:2468] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:16.860812 10162 leader_election.cc:304] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:16.862483 10382 raft_consensus.cc:2804] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.865185 10382 raft_consensus.cc:697] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:16.866325 10382 consensus_queue.cc:237] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.869927 10370 leader_election.cc:290] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:16.871008 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:16.860832 10195 raft_consensus.cc:2468] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 1.
W20260709 13:05:16.872831 10165 leader_election.cc:343] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.874886 10359 tablet_bootstrap.cc:654] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.877132 10125 raft_consensus.cc:2468] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:16.877386  9947 catalog_manager.cc:5697] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:16.878340 10361 tablet_bootstrap.cc:492] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:16.879747 10165 leader_election.cc:304] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:16.880817 10361 ts_tablet_manager.cc:1403] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.103s	user 0.029s	sys 0.034s
I20260709 13:05:16.882993 10360 tablet_bootstrap.cc:492] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:16.883762 10360 ts_tablet_manager.cc:1403] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.070s	user 0.023s	sys 0.009s
I20260709 13:05:16.884724 10361 raft_consensus.cc:359] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.885602 10361 raft_consensus.cc:385] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.885923 10361 raft_consensus.cc:740] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.886317 10382 raft_consensus.cc:2804] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.887037 10382 raft_consensus.cc:697] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:16.886772 10361 consensus_queue.cc:260] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.887809 10360 raft_consensus.cc:359] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.888103 10382 consensus_queue.cc:237] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.890489  9945 catalog_manager.cc:5697] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.889077 10360 raft_consensus.cc:385] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.892228 10360 raft_consensus.cc:740] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.893136 10360 consensus_queue.cc:260] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.895746 10360 ts_tablet_manager.cc:1434] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.001s
I20260709 13:05:16.896385 10361 ts_tablet_manager.cc:1434] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.003s
I20260709 13:05:16.896943 10360 tablet_bootstrap.cc:492] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:16.898168 10361 tablet_bootstrap.cc:492] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:16.904729 10360 tablet_bootstrap.cc:654] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.907127 10361 tablet_bootstrap.cc:654] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.910833 10359 tablet_bootstrap.cc:492] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.911525 10359 ts_tablet_manager.cc:1403] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.001s
I20260709 13:05:16.912364 10360 tablet_bootstrap.cc:492] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:16.913115 10360 ts_tablet_manager.cc:1403] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:05:16.915165 10359 raft_consensus.cc:359] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.916085 10359 raft_consensus.cc:385] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.916384 10359 raft_consensus.cc:740] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.917245 10359 consensus_queue.cc:260] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.917410 10360 raft_consensus.cc:359] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.918599 10360 raft_consensus.cc:385] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.919162 10360 raft_consensus.cc:740] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.919862 10359 ts_tablet_manager.cc:1434] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:05:16.921147 10359 tablet_bootstrap.cc:492] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Bootstrap starting.
I20260709 13:05:16.920415 10360 consensus_queue.cc:260] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.924885 10360 ts_tablet_manager.cc:1434] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.007s
I20260709 13:05:16.926177 10360 tablet_bootstrap.cc:492] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:16.927197 10361 tablet_bootstrap.cc:492] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:16.927788 10361 ts_tablet_manager.cc:1403] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.006s
I20260709 13:05:16.929049 10359 tablet_bootstrap.cc:654] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.932099 10361 raft_consensus.cc:359] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.932952 10361 raft_consensus.cc:385] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.933303 10360 tablet_bootstrap.cc:654] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.933269 10361 raft_consensus.cc:740] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.934212 10361 consensus_queue.cc:260] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.937258 10361 ts_tablet_manager.cc:1434] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:05:16.938603 10361 tablet_bootstrap.cc:492] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:16.941885 10359 tablet_bootstrap.cc:492] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd: No bootstrap required, opened a new log
I20260709 13:05:16.942584 10359 ts_tablet_manager.cc:1403] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:05:16.946147 10359 raft_consensus.cc:359] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.946902 10359 raft_consensus.cc:385] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.946969 10382 raft_consensus.cc:493] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.947259 10359 raft_consensus.cc:740] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.947592 10382 raft_consensus.cc:515] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.948158 10359 consensus_queue.cc:260] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.951023 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f635b52cce78424aac4b15f34ef95f42" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:16.951807 10046 raft_consensus.cc:2468] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:16.952742 10361 tablet_bootstrap.cc:654] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.952560 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f635b52cce78424aac4b15f34ef95f42" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:16.953392 10162 leader_election.cc:304] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:16.954025 10382 leader_election.cc:290] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:16.953519 10125 raft_consensus.cc:2468] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:16.954424 10370 raft_consensus.cc:2804] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.954788 10382 raft_consensus.cc:493] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.954905 10370 raft_consensus.cc:493] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.956332 10370 raft_consensus.cc:3060] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.956207 10382 raft_consensus.cc:515] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.958436 10382 leader_election.cc:290] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:16.960013 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49597fd27b47492e8d6d108a9c2733bb" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:16.960788 10125 raft_consensus.cc:2468] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:16.961501 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49597fd27b47492e8d6d108a9c2733bb" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:16.962067 10165 leader_election.cc:304] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:16.962193 10046 raft_consensus.cc:2468] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:16.964012 10382 raft_consensus.cc:2804] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.968164 10382 raft_consensus.cc:493] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.968662 10382 raft_consensus.cc:3060] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.971341  9946 catalog_manager.cc:5697] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.953552 10359 ts_tablet_manager.cc:1434] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:05:16.966143 10370 raft_consensus.cc:515] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.976742 10370 leader_election.cc:290] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:16.975961 10382 raft_consensus.cc:515] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.964352 10360 tablet_bootstrap.cc:492] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:16.977789 10360 ts_tablet_manager.cc:1403] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.018s
I20260709 13:05:16.977916 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f635b52cce78424aac4b15f34ef95f42" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:16.978617 10125 raft_consensus.cc:3060] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.980131 10382 leader_election.cc:290] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:16.980382 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49597fd27b47492e8d6d108a9c2733bb" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:16.980648 10345 raft_consensus.cc:493] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.981146 10120 raft_consensus.cc:3060] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.981596 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49597fd27b47492e8d6d108a9c2733bb" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:16.982300 10361 tablet_bootstrap.cc:492] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:16.982892 10361 ts_tablet_manager.cc:1403] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.001s
I20260709 13:05:16.981156 10345 raft_consensus.cc:515] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.985925 10361 raft_consensus.cc:359] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.986343 10345 leader_election.cc:290] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:16.986699 10361 raft_consensus.cc:385] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.978511 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f635b52cce78424aac4b15f34ef95f42" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:16.987036 10361 raft_consensus.cc:740] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.987188 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7c16fe8bbb4d57b242298efe0d7a77" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:16.987985 10046 raft_consensus.cc:3060] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.988261 10121 raft_consensus.cc:2468] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 0.
I20260709 13:05:16.988441 10361 consensus_queue.cc:260] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.990110 10016 leader_election.cc:304] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:16.990592 10361 ts_tablet_manager.cc:1434] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:16.990922 10120 raft_consensus.cc:2468] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:16.991115 10345 raft_consensus.cc:2804] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.991742 10345 raft_consensus.cc:493] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.992170 10345 raft_consensus.cc:3060] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.992677 10165 leader_election.cc:304] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:16.992864 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7c16fe8bbb4d57b242298efe0d7a77" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:16.993371 10360 raft_consensus.cc:359] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.993709 10195 raft_consensus.cc:2468] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 0.
I20260709 13:05:16.993839 10382 raft_consensus.cc:2804] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.994175 10360 raft_consensus.cc:385] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.994611 10360 raft_consensus.cc:740] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.994663 10382 raft_consensus.cc:697] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:16.995437 10360 consensus_queue.cc:260] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.995702 10382 consensus_queue.cc:237] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:16.997813 10360 ts_tablet_manager.cc:1434] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:16.987155 10050 raft_consensus.cc:3060] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.998936 10360 tablet_bootstrap.cc:492] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e: Bootstrap starting.
I20260709 13:05:17.000114 10125 raft_consensus.cc:2468] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:17.000387 10361 tablet_bootstrap.cc:492] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d: Bootstrap starting.
I20260709 13:05:17.010871 10165 leader_election.cc:304] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.011754 10370 raft_consensus.cc:2804] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.006944 10360 tablet_bootstrap.cc:654] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.015805 10361 tablet_bootstrap.cc:654] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.017699 10046 raft_consensus.cc:2468] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:17.007906 10345 raft_consensus.cc:515] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.012365 10370 raft_consensus.cc:697] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:17.021011 10370 consensus_queue.cc:237] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.023272 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7c16fe8bbb4d57b242298efe0d7a77" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:17.024276 10125 raft_consensus.cc:3060] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.025171 10050 raft_consensus.cc:2468] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:17.032307 10360 tablet_bootstrap.cc:492] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e: No bootstrap required, opened a new log
I20260709 13:05:17.033072 10360 ts_tablet_manager.cc:1403] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.014s
I20260709 13:05:17.033926 10361 tablet_bootstrap.cc:492] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d: No bootstrap required, opened a new log
I20260709 13:05:17.034478 10361 ts_tablet_manager.cc:1403] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.001s
I20260709 13:05:17.036535 10360 raft_consensus.cc:359] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.037417 10360 raft_consensus.cc:385] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.037569 10361 raft_consensus.cc:359] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.038316 10361 raft_consensus.cc:385] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.037694 10360 raft_consensus.cc:740] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.038625 10361 raft_consensus.cc:740] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.041046 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7c16fe8bbb4d57b242298efe0d7a77" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.044113 10195 raft_consensus.cc:3060] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.043622 10360 consensus_queue.cc:260] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.046692 10360 ts_tablet_manager.cc:1434] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:05:17.051520  9946 catalog_manager.cc:5697] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.053128 10195 raft_consensus.cc:2468] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 1.
I20260709 13:05:17.054685 10361 consensus_queue.cc:260] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.054880 10015 leader_election.cc:304] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.056420 10378 raft_consensus.cc:2804] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.057082 10361 ts_tablet_manager.cc:1434] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 13:05:17.057165 10378 raft_consensus.cc:697] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:17.058827 10125 raft_consensus.cc:2468] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 1.
I20260709 13:05:17.058605 10378 consensus_queue.cc:237] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.053628  9946 catalog_manager.cc:5697] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.041653 10345 leader_election.cc:290] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 1 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.063776 10370 raft_consensus.cc:493] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.064407 10370 raft_consensus.cc:515] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.065827 10382 raft_consensus.cc:493] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.066447 10382 raft_consensus.cc:515] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.068756 10382 leader_election.cc:290] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:17.070413 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0685c9ec507448db626053896fe5602" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:17.071189 10050 raft_consensus.cc:2468] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:17.072404 10162 leader_election.cc:304] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.070415 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0685c9ec507448db626053896fe5602" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:17.073633 10382 raft_consensus.cc:2804] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.074316 10382 raft_consensus.cc:493] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.074774 10382 raft_consensus.cc:3060] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.074153 10120 raft_consensus.cc:2468] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:17.077903 10377 raft_consensus.cc:493] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.078621 10370 leader_election.cc:290] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:17.078485 10377 raft_consensus.cc:515] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.080732 10377 leader_election.cc:290] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.082267 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:17.082885 10046 raft_consensus.cc:2468] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:17.082676  9948 catalog_manager.cc:5697] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 0 to 1, leader changed from <none> to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 1 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.083841 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:17.084075 10088 leader_election.cc:304] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:17.084663 10050 raft_consensus.cc:2468] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:17.085511 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:17.085907 10162 leader_election.cc:304] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.086344 10195 raft_consensus.cc:2468] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 0.
I20260709 13:05:17.086365 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d" is_pre_election: true
I20260709 13:05:17.086966 10370 raft_consensus.cc:2804] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.087453 10370 raft_consensus.cc:493] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.087919 10334 raft_consensus.cc:2804] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.088248 10370 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.085474 10382 raft_consensus.cc:515] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.089027 10334 raft_consensus.cc:493] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.089874 10334 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.092407 10382 leader_election.cc:290] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:17.087452 10120 raft_consensus.cc:2468] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 0.
I20260709 13:05:17.097152 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0685c9ec507448db626053896fe5602" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:17.097788 10120 raft_consensus.cc:3060] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.101193 10370 raft_consensus.cc:515] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.103303 10370 leader_election.cc:290] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:17.104378 10046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:17.104578 10120 raft_consensus.cc:2468] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:17.105216 10046 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.104619 10125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:17.105968 10125 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.106629 10165 leader_election.cc:304] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.104429 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0685c9ec507448db626053896fe5602" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:17.107756 10050 raft_consensus.cc:3060] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.108304 10370 raft_consensus.cc:2804] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.107932 10334 raft_consensus.cc:515] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.108990 10370 raft_consensus.cc:697] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:17.109982 10370 consensus_queue.cc:237] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.111347 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:17.112071 10047 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.113358 10125 raft_consensus.cc:2468] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:17.113852 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.114750 10165 leader_election.cc:304] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.114851 10195 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.115891 10382 raft_consensus.cc:2804] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.127753 10046 raft_consensus.cc:2468] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:17.119390 10047 raft_consensus.cc:2468] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 1.
I20260709 13:05:17.123059 10195 raft_consensus.cc:2468] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 1.
I20260709 13:05:17.127417 10050 raft_consensus.cc:2468] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 1.
I20260709 13:05:17.115510 10334 leader_election.cc:290] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.129983 10090 leader_election.cc:304] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.128751 10382 raft_consensus.cc:697] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:17.131279 10334 raft_consensus.cc:2804] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.132083 10382 consensus_queue.cc:237] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.132651 10334 raft_consensus.cc:697] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:17.133697 10334 consensus_queue.cc:237] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.135114  9948 catalog_manager.cc:5697] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.147758  9945 catalog_manager.cc:5697] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.155196  9948 catalog_manager.cc:5697] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 0 to 1, leader changed from <none> to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.210017 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f635b52cce78424aac4b15f34ef95f42"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
mode: GRACEFUL
new_leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:54514
I20260709 13:05:17.210628 10195 raft_consensus.cc:606] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Received request to transfer leadership to TS c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:17.216940 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
mode: GRACEFUL
new_leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:54514
I20260709 13:05:17.217568 10195 raft_consensus.cc:606] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Received request to transfer leadership to TS c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:17.223450 10125 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
mode: GRACEFUL
new_leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:39490
I20260709 13:05:17.224054 10125 raft_consensus.cc:606] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Received request to transfer leadership to TS c5b39fd125c84087bf29c0d4b747e04e
I20260709 13:05:17.229884 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
mode: GRACEFUL
new_leader_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:54514
I20260709 13:05:17.230536 10195 raft_consensus.cc:606] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Received request to transfer leadership to TS 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:17.237264 10047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7c16fe8bbb4d57b242298efe0d7a77"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
mode: GRACEFUL
new_leader_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:44848
I20260709 13:05:17.238013 10047 raft_consensus.cc:606] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Received request to transfer leadership to TS 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:17.244647 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49597fd27b47492e8d6d108a9c2733bb"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
mode: GRACEFUL
new_leader_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:54514
I20260709 13:05:17.245318 10195 raft_consensus.cc:606] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Received request to transfer leadership to TS 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:17.251556 10195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0685c9ec507448db626053896fe5602"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
mode: GRACEFUL
new_leader_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:54514
I20260709 13:05:17.252168 10195 raft_consensus.cc:606] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Received request to transfer leadership to TS 2c755ea83e7548b48d55039aee37517d
I20260709 13:05:17.258366 10378 consensus_queue.cc:1048] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.271556 10378 consensus_queue.cc:1048] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.319082 10377 raft_consensus.cc:493] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.319659 10377 raft_consensus.cc:515] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.321707 10377 leader_election.cc:290] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.322822 10047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e" is_pre_election: true
I20260709 13:05:17.323035 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" is_pre_election: true
I20260709 13:05:17.323704 10047 raft_consensus.cc:2393] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c755ea83e7548b48d55039aee37517d in current term 1: Already voted for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in this term.
I20260709 13:05:17.325582 10088 leader_election.cc:304] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d; no voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:17.326370 10377 raft_consensus.cc:3060] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.328128 10382 consensus_queue.cc:1048] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.333282 10377 raft_consensus.cc:2749] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.341540 10047 raft_consensus.cc:3060] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.349507 10297 consensus_queue.cc:1048] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.354856 10297 consensus_queue.cc:1048] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.362884 10382 consensus_queue.cc:1048] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.378249 10297 raft_consensus.cc:993] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd: : Instructing follower c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:17.378830 10382 raft_consensus.cc:1081] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Signalling peer c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:17.381081 10050 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:44838
I20260709 13:05:17.381840 10050 raft_consensus.cc:493] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.382272 10050 raft_consensus.cc:3060] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.390079 10050 raft_consensus.cc:515] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.393344 10050 leader_election.cc:290] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.393797 10120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:17.394553 10120 raft_consensus.cc:3060] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.394937 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a1e9f4cd898479a9ce3ebf9068985a5" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.395577 10195 raft_consensus.cc:3055] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.395912 10195 raft_consensus.cc:740] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:17.396759 10195 consensus_queue.cc:260] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.398046 10195 raft_consensus.cc:3060] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.403482 10120 raft_consensus.cc:2468] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:17.406143 10016 leader_election.cc:304] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:17.406492 10195 raft_consensus.cc:2468] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:17.407091 10378 raft_consensus.cc:2804] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.407636 10378 raft_consensus.cc:697] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:17.408565 10378 consensus_queue.cc:237] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.416747  9945 catalog_manager.cc:5697] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 1 to 2, leader changed from c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195) to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.469239 10358 consensus_queue.cc:1048] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.477669 10378 raft_consensus.cc:993] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e: : Instructing follower 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:17.478286 10345 raft_consensus.cc:1081] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Signalling peer 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:17.480204 10120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f7c16fe8bbb4d57b242298efe0d7a77"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:39468
I20260709 13:05:17.482995 10120 raft_consensus.cc:493] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.483566 10120 raft_consensus.cc:3060] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.484793 10345 consensus_queue.cc:1048] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.493114 10120 raft_consensus.cc:515] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.495849 10120 leader_election.cc:290] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.497189 10050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7c16fe8bbb4d57b242298efe0d7a77" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:17.497967 10050 raft_consensus.cc:3055] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.498279 10050 raft_consensus.cc:740] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:17.499116 10050 consensus_queue.cc:260] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.500389 10050 raft_consensus.cc:3060] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.502816 10382 consensus_queue.cc:1048] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.503271 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7c16fe8bbb4d57b242298efe0d7a77" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.504262 10195 raft_consensus.cc:3060] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.509038 10050 raft_consensus.cc:2468] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:17.510524 10088 leader_election.cc:304] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:17.511441 10377 raft_consensus.cc:2804] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.515013 10195 raft_consensus.cc:2468] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:17.511943 10377 raft_consensus.cc:697] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:17.517410 10377 consensus_queue.cc:237] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.524313 10370 consensus_queue.cc:1048] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.525116 10382 consensus_queue.cc:1048] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.528251 10382 consensus_queue.cc:1048] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.527680 10370 consensus_queue.cc:1048] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:17.536055  9945 catalog_manager.cc:5697] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 1 to 2, leader changed from c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193) to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.539764 10297 raft_consensus.cc:993] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd: : Instructing follower c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:17.540369 10297 raft_consensus.cc:1081] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Signalling peer c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:17.542585 10047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f635b52cce78424aac4b15f34ef95f42"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:44838
I20260709 13:05:17.543493 10047 raft_consensus.cc:493] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.544003 10047 raft_consensus.cc:3060] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.547166 10297 consensus_queue.cc:1048] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.558286 10047 raft_consensus.cc:515] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.563405 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f635b52cce78424aac4b15f34ef95f42" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:17.564273 10121 raft_consensus.cc:3060] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.572806 10382 raft_consensus.cc:993] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd: : Instructing follower 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:17.573519 10370 raft_consensus.cc:1081] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Signalling peer 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:17.574522 10297 consensus_queue.cc:1048] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.577030 10125 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:39478
I20260709 13:05:17.577744 10125 raft_consensus.cc:493] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.579998 10125 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.582408 10377 consensus_queue.cc:1048] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.602327 10421 consensus_queue.cc:1048] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.601060 10125 raft_consensus.cc:515] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.614285 10047 leader_election.cc:290] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.615195 10045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:17.616129 10045 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.616231 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f635b52cce78424aac4b15f34ef95f42" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.616940 10195 raft_consensus.cc:3055] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.617359 10195 raft_consensus.cc:740] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:17.618451 10195 consensus_queue.cc:260] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.620019 10125 leader_election.cc:290] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.585566 10121 raft_consensus.cc:2468] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:17.624850 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.625597 10198 raft_consensus.cc:3055] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.625941 10198 raft_consensus.cc:740] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:17.626905 10198 consensus_queue.cc:260] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.628674 10198 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.631639 10045 raft_consensus.cc:2468] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:17.622452 10195 raft_consensus.cc:3060] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.641105 10421 raft_consensus.cc:993] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd: : Instructing follower 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:17.641765 10421 raft_consensus.cc:1081] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Signalling peer 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:17.644488 10016 leader_election.cc:304] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:17.645687 10358 raft_consensus.cc:2804] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.646241 10358 raft_consensus.cc:697] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:17.647310 10121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49597fd27b47492e8d6d108a9c2733bb"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:39478
I20260709 13:05:17.647243 10358 consensus_queue.cc:237] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.648260 10121 raft_consensus.cc:493] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.648767 10121 raft_consensus.cc:3060] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.650076 10088 leader_election.cc:304] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c5b39fd125c84087bf29c0d4b747e04e; no voters: 
I20260709 13:05:17.652215 10377 raft_consensus.cc:2804] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.653017 10377 raft_consensus.cc:697] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:17.654284 10377 consensus_queue.cc:237] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.658995 10121 raft_consensus.cc:515] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.662667 10120 raft_consensus.cc:1240] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Rejecting Update request from peer c9ace2311e0e4f63ae2edfc9606ac2cd for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:17.667855 10370 consensus_queue.cc:1059] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.669073 10370 raft_consensus.cc:3055] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.669544 10370 raft_consensus.cc:740] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:17.670539 10370 consensus_queue.cc:260] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.666684 10195 raft_consensus.cc:2468] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:17.671778 10370 raft_consensus.cc:3060] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.678151 10334 raft_consensus.cc:993] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d: : Instructing follower c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:17.678649 10334 raft_consensus.cc:1081] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Signalling peer c5b39fd125c84087bf29c0d4b747e04e to start an election
I20260709 13:05:17.681084 10198 raft_consensus.cc:2468] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:17.683212 10045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49597fd27b47492e8d6d108a9c2733bb" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:17.686035 10048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
 from {username='slave'} at 127.0.0.1:44836
I20260709 13:05:17.687711  9945 catalog_manager.cc:5697] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 1 to 2, leader changed from c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195) to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.688587 10048 raft_consensus.cc:493] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.689214 10048 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.694463 10045 raft_consensus.cc:3060] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.725848 10121 leader_election.cc:290] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.727908 10382 raft_consensus.cc:993] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd: : Instructing follower 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:17.730399 10382 raft_consensus.cc:1081] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Signalling peer 2c755ea83e7548b48d55039aee37517d to start an election
I20260709 13:05:17.726321 10048 raft_consensus.cc:515] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.734762 10195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49597fd27b47492e8d6d108a9c2733bb" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.735313 10121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0685c9ec507448db626053896fe5602"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
 from {username='slave'} at 127.0.0.1:39478
I20260709 13:05:17.735937 10048 leader_election.cc:290] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Requested vote from peers 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.736364 10121 raft_consensus.cc:493] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:17.737013 10121 raft_consensus.cc:3060] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.745146 10045 raft_consensus.cc:2468] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:17.745769 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.746495 10197 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.746956 10121 raft_consensus.cc:515] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.747210 10429 consensus_queue.cc:1048] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.747605 10195 raft_consensus.cc:2468] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:17.748775 10090 leader_election.cc:304] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.749311 10121 leader_election.cc:290] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195:43307)
I20260709 13:05:17.751564 10198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0685c9ec507448db626053896fe5602" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
I20260709 13:05:17.751873 10429 raft_consensus.cc:2804] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.752298 10198 raft_consensus.cc:3055] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.752730 10198 raft_consensus.cc:740] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:17.752951 10429 raft_consensus.cc:697] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:17.753990 10429 consensus_queue.cc:237] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.754017 10198 consensus_queue.cc:260] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.755961 10198 raft_consensus.cc:3060] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.757628 10045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0685c9ec507448db626053896fe5602" candidate_uuid: "2c755ea83e7548b48d55039aee37517d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:17.758316 10045 raft_consensus.cc:3060] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.751164  9945 catalog_manager.cc:5697] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 1 to 2, leader changed from c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195) to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.764837 10198 raft_consensus.cc:2468] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:17.764863 10197 raft_consensus.cc:2468] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:17.766191 10195 raft_consensus.cc:1240] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Rejecting Update request from peer 2c755ea83e7548b48d55039aee37517d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:05:17.766516 10090 leader_election.cc:304] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.767445 10426 raft_consensus.cc:2804] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.768018 10426 raft_consensus.cc:697] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Leader. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:17.768914 10426 consensus_queue.cc:237] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.770725 10015 leader_election.cc:304] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:17.773205 10426 consensus_queue.cc:1059] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.774005 10429 raft_consensus.cc:3055] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:17.774372 10429 raft_consensus.cc:740] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:17.771804 10345 raft_consensus.cc:2804] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:17.775029 10345 raft_consensus.cc:697] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Becoming Leader. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:17.774911 10121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1" candidate_uuid: "c5b39fd125c84087bf29c0d4b747e04e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:17.775375 10429 consensus_queue.cc:260] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.776409 10345 consensus_queue.cc:237] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:17.776866 10429 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.781311 10045 raft_consensus.cc:2468] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c755ea83e7548b48d55039aee37517d in term 2.
I20260709 13:05:17.786831  9945 catalog_manager.cc:5697] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e reported cstate change: term changed from 1 to 2, leader changed from 2c755ea83e7548b48d55039aee37517d (127.0.107.194) to c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193). New cstate: current_term: 2 leader_uuid: "c5b39fd125c84087bf29c0d4b747e04e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.791586 10121 raft_consensus.cc:2468] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5b39fd125c84087bf29c0d4b747e04e in term 2.
I20260709 13:05:17.800707  9945 catalog_manager.cc:5697] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 1 to 2, leader changed from c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195) to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.802127  9945 catalog_manager.cc:5697] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d reported cstate change: term changed from 1 to 2, leader changed from c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195) to 2c755ea83e7548b48d55039aee37517d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "2c755ea83e7548b48d55039aee37517d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.965291 10122 raft_consensus.cc:1275] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.967061 10378 consensus_queue.cc:1048] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.975833 10197 raft_consensus.cc:1275] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.976811 10195 raft_consensus.cc:1275] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.979164 10426 consensus_queue.cc:1048] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:17.980078 10345 consensus_queue.cc:1048] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:17.995421 10045 raft_consensus.cc:1275] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:17.997018 10429 consensus_queue.cc:1048] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:18.118871 10122 raft_consensus.cc:1275] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.120467 10345 consensus_queue.cc:1048] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.129997 10197 raft_consensus.cc:1275] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.132875 10345 consensus_queue.cc:1048] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.168624 10197 raft_consensus.cc:1275] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.170118 10429 consensus_queue.cc:1048] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:18.179591 10045 raft_consensus.cc:1275] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.181049 10430 consensus_queue.cc:1048] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.239359 10045 raft_consensus.cc:1275] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.240815 10430 consensus_queue.cc:1048] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.250821 10197 raft_consensus.cc:1275] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.252909 10334 consensus_queue.cc:1048] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.325366 10045 raft_consensus.cc:1275] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.326936 10430 consensus_queue.cc:1048] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.337965 10197 raft_consensus.cc:1275] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer 2c755ea83e7548b48d55039aee37517d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.339496 10334 consensus_queue.cc:1048] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.404470 10122 raft_consensus.cc:1275] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.405769 10197 raft_consensus.cc:1275] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Refusing update from remote peer c5b39fd125c84087bf29c0d4b747e04e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.406445 10345 consensus_queue.cc:1048] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:18.407519 10378 consensus_queue.cc:1048] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.259435  9948 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52222:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:20.282066  9948 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52222:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:20.356936   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:20.546665 10471 tablet.cc:1724] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.562077 10476 tablet.cc:1724] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.516527 10469 tablet.cc:1724] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.634693 10479 tablet.cc:1724] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.637256 10489 tablet.cc:1724] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:20.629340 10015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43307, user_credentials={real_user=slave}} blocked reactor thread for 55356.4us
I20260709 13:05:20.649683 10486 tablet.cc:1724] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.656569 10471 tablet.cc:1724] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.635169 10490 tablet.cc:1724] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.689589 10491 tablet.cc:1724] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.712779 10469 tablet.cc:1724] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.720295 10476 tablet.cc:1724] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.726512 10492 tablet.cc:1724] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.761049 10496 tablet.cc:1724] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.765607 10500 tablet.cc:1724] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:20.781811 10090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:43307, user_credentials={real_user=slave}} blocked reactor thread for 124746us
I20260709 13:05:20.744684 10499 tablet.cc:1724] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.803681 10471 tablet.cc:1724] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.813231 10489 tablet.cc:1724] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.830454 10492 tablet.cc:1724] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.842326 10479 tablet.cc:1724] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.844000 10491 tablet.cc:1724] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.845105 10486 tablet.cc:1724] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.846949 10490 tablet.cc:1724] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.851048 10119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
mode: GRACEFUL
new_leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
 from {username='slave'} at 127.0.0.1:60502
I20260709 13:05:20.851799 10119 raft_consensus.cc:606] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Received request to transfer leadership to TS c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:20.863540 10469 tablet.cc:1724] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.871910 10499 tablet.cc:1724] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.889245 10479 tablet.cc:1724] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.896728 10496 tablet.cc:1724] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.917055 10500 tablet.cc:1724] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:20.933481 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
mode: GRACEFUL
new_leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
 from {username='slave'} at 127.0.0.1:54870
I20260709 13:05:20.934371 10048 raft_consensus.cc:606] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Received request to transfer leadership to TS c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:20.936327   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:05:20.937109   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:20.948724 10048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a"
dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
mode: GRACEFUL
new_leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
 from {username='slave'} at 127.0.0.1:54870
I20260709 13:05:20.949467 10048 raft_consensus.cc:606] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Received request to transfer leadership to TS c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:20.950048  9945 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c: soft_deleted_table [id=4cfd7260f2164c008e3a12fe1bb581b8] alter complete (version 1)
I20260709 13:05:20.952926 10119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2b8bb477df64462a43529bc66839022"
dest_uuid: "2c755ea83e7548b48d55039aee37517d"
mode: GRACEFUL
new_leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
 from {username='slave'} at 127.0.0.1:60502
I20260709 13:05:20.953631 10119 raft_consensus.cc:606] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Received request to transfer leadership to TS c9ace2311e0e4f63ae2edfc9606ac2cd
I20260709 13:05:20.955356   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:20.956161   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:20.968204 10334 raft_consensus.cc:993] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d: : Instructing follower c9ace2311e0e4f63ae2edfc9606ac2cd to start an election
I20260709 13:05:20.969060 10498 raft_consensus.cc:1081] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Signalling peer c9ace2311e0e4f63ae2edfc9606ac2cd to start an election
I20260709 13:05:20.971297 10197 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2b8bb477df64462a43529bc66839022"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
 from {username='slave'} at 127.0.0.1:54486
I20260709 13:05:20.971980 10197 raft_consensus.cc:493] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:20.972512 10197 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.979260 10197 raft_consensus.cc:515] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:20.981464 10197 leader_election.cc:290] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 3 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:20.982664 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:20.983399 10048 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.983217 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b8bb477df64462a43529bc66839022" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:20.984212 10119 raft_consensus.cc:3055] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:20.984543 10119 raft_consensus.cc:740] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:20.985648 10119 consensus_queue.cc:260] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:20.986990 10119 raft_consensus.cc:3060] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.989399 10048 raft_consensus.cc:2468] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 3.
I20260709 13:05:20.990734 10162 leader_election.cc:304] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:20.991472 10382 raft_consensus.cc:2804] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:20.991936 10382 raft_consensus.cc:697] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:20.992811 10382 consensus_queue.cc:237] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:20.997227 10119 raft_consensus.cc:2468] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 3.
I20260709 13:05:21.003523  9946 catalog_manager.cc:5697] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 2 to 3, leader changed from 2c755ea83e7548b48d55039aee37517d (127.0.107.194) to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.060153 10434 raft_consensus.cc:993] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e: : Instructing follower c9ace2311e0e4f63ae2edfc9606ac2cd to start an election
I20260709 13:05:21.060925 10493 raft_consensus.cc:1081] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Signalling peer c9ace2311e0e4f63ae2edfc9606ac2cd to start an election
I20260709 13:05:21.062875 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
 from {username='slave'} at 127.0.0.1:54498
I20260709 13:05:21.063505 10196 raft_consensus.cc:493] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.063832 10196 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.069443 10196 raft_consensus.cc:515] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.071280 10196 leader_election.cc:290] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 3 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:21.072654 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:21.072537 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a4f168e98a42e385a164bda9d39f2a" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:21.073408 10119 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.073393 10048 raft_consensus.cc:3055] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:21.074000 10048 raft_consensus.cc:740] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:21.074895 10048 consensus_queue.cc:260] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.076233 10048 raft_consensus.cc:3060] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.081144 10119 raft_consensus.cc:2468] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 3.
I20260709 13:05:21.082830 10165 leader_election.cc:304] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:21.083061 10048 raft_consensus.cc:2468] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 3.
I20260709 13:05:21.083742 10382 raft_consensus.cc:2804] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.084280 10382 raft_consensus.cc:697] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:21.085165 10382 consensus_queue.cc:237] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.093940  9946 catalog_manager.cc:5697] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 2 to 3, leader changed from c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193) to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.295214 10493 raft_consensus.cc:993] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e: : Instructing follower c9ace2311e0e4f63ae2edfc9606ac2cd to start an election
I20260709 13:05:21.295991 10452 raft_consensus.cc:1081] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Signalling peer c9ace2311e0e4f63ae2edfc9606ac2cd to start an election
I20260709 13:05:21.298086 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
 from {username='slave'} at 127.0.0.1:54498
I20260709 13:05:21.298813 10196 raft_consensus.cc:493] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.299252 10196 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.305969 10196 raft_consensus.cc:515] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.308116 10196 leader_election.cc:290] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 3 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:21.309275 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:21.309324 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc09e89b97344b13a7b9283e35bd39a1" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:21.310112 10048 raft_consensus.cc:3055] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:21.310477 10119 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.310508 10048 raft_consensus.cc:740] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c5b39fd125c84087bf29c0d4b747e04e, State: Running, Role: LEADER
I20260709 13:05:21.311697 10048 consensus_queue.cc:260] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.313211 10048 raft_consensus.cc:3060] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.318367 10119 raft_consensus.cc:2468] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 3.
I20260709 13:05:21.319607 10165 leader_election.cc:304] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c755ea83e7548b48d55039aee37517d, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:21.320530 10382 raft_consensus.cc:2804] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.321051 10382 raft_consensus.cc:697] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:21.321316 10048 raft_consensus.cc:2468] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 3.
I20260709 13:05:21.321887 10382 consensus_queue.cc:237] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.330597  9946 catalog_manager.cc:5697] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 2 to 3, leader changed from c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193) to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.429502 10334 raft_consensus.cc:993] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d: : Instructing follower c9ace2311e0e4f63ae2edfc9606ac2cd to start an election
I20260709 13:05:21.430151 10334 raft_consensus.cc:1081] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Signalling peer c9ace2311e0e4f63ae2edfc9606ac2cd to start an election
I20260709 13:05:21.432348 10196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1"
dest_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd"
 from {username='slave'} at 127.0.0.1:54486
I20260709 13:05:21.433558 10196 raft_consensus.cc:493] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:21.434160 10196 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.442098 10196 raft_consensus.cc:515] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.445202 10048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c5b39fd125c84087bf29c0d4b747e04e"
I20260709 13:05:21.445266 10196 leader_election.cc:290] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 3 election: Requested vote from peers c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915), 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889)
I20260709 13:05:21.446554 10048 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.447449 10125 raft_consensus.cc:1275] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Refusing update from remote peer c9ace2311e0e4f63ae2edfc9606ac2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:21.448522 10119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae3e982bee53440996e25dffe76875d1" candidate_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2c755ea83e7548b48d55039aee37517d"
I20260709 13:05:21.449476 10119 raft_consensus.cc:3055] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:21.449334 10382 consensus_queue.cc:1048] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:21.450045 10119 raft_consensus.cc:740] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2c755ea83e7548b48d55039aee37517d, State: Running, Role: LEADER
I20260709 13:05:21.451146 10119 consensus_queue.cc:260] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.452865 10119 raft_consensus.cc:3060] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.454914 10048 raft_consensus.cc:2468] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 3.
I20260709 13:05:21.456812 10162 leader_election.cc:304] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c5b39fd125c84087bf29c0d4b747e04e, c9ace2311e0e4f63ae2edfc9606ac2cd; no voters: 
I20260709 13:05:21.457988 10382 raft_consensus.cc:2804] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.458596 10382 raft_consensus.cc:697] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 LEADER]: Becoming Leader. State: Replica: c9ace2311e0e4f63ae2edfc9606ac2cd, State: Running, Role: LEADER
I20260709 13:05:21.459535 10382 consensus_queue.cc:237] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } }
I20260709 13:05:21.463605 10119 raft_consensus.cc:2468] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9ace2311e0e4f63ae2edfc9606ac2cd in term 3.
I20260709 13:05:21.470296  9946 catalog_manager.cc:5697] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd reported cstate change: term changed from 2 to 3, leader changed from 2c755ea83e7548b48d55039aee37517d (127.0.107.194) to c9ace2311e0e4f63ae2edfc9606ac2cd (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9ace2311e0e4f63ae2edfc9606ac2cd" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43307 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.473922 10048 raft_consensus.cc:1275] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Refusing update from remote peer c9ace2311e0e4f63ae2edfc9606ac2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:21.476471 10508 consensus_queue.cc:1048] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.686789 10119 raft_consensus.cc:1275] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Refusing update from remote peer c9ace2311e0e4f63ae2edfc9606ac2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:21.688659 10508 consensus_queue.cc:1048] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:21.709239 10048 raft_consensus.cc:1275] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Refusing update from remote peer c9ace2311e0e4f63ae2edfc9606ac2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:21.711493 10475 consensus_queue.cc:1048] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.769699 10119 raft_consensus.cc:1275] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Refusing update from remote peer c9ace2311e0e4f63ae2edfc9606ac2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:21.771201 10508 consensus_queue.cc:1048] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:21.779970 10048 raft_consensus.cc:1275] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Refusing update from remote peer c9ace2311e0e4f63ae2edfc9606ac2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:21.781702 10475 consensus_queue.cc:1048] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:21.864609 10048 raft_consensus.cc:1275] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Refusing update from remote peer c9ace2311e0e4f63ae2edfc9606ac2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:21.866185 10475 consensus_queue.cc:1048] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5b39fd125c84087bf29c0d4b747e04e" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:21.878257 10119 raft_consensus.cc:1275] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Refusing update from remote peer c9ace2311e0e4f63ae2edfc9606ac2cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:21.880700 10508 consensus_queue.cc:1048] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c755ea83e7548b48d55039aee37517d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:22.028781   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:05:22.035338   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:05:22.035902   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:22.041527   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:05:22.042200   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:23.081123   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:05:23.109323 10088 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:05:23.117930 10088 consensus_peers.cc:597] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.139122   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:23.140174   431 tablet_replica.cc:333] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.140974   431 raft_consensus.cc:2243] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.141530   431 raft_consensus.cc:2272] T bc09e89b97344b13a7b9283e35bd39a1 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.143751   431 tablet_replica.cc:333] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.144433   431 raft_consensus.cc:2243] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.144930   431 raft_consensus.cc:2272] T 49597fd27b47492e8d6d108a9c2733bb P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.146804   431 tablet_replica.cc:333] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.147367   431 raft_consensus.cc:2243] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.147828   431 raft_consensus.cc:2272] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.149791   431 tablet_replica.cc:333] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.150483   431 raft_consensus.cc:2243] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.151146   431 raft_consensus.cc:2272] T ae3e982bee53440996e25dffe76875d1 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.153465   431 tablet_replica.cc:333] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.154250   431 raft_consensus.cc:2243] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.154819   431 raft_consensus.cc:2272] T 128a8114799a498193bab8a2012537ff P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.156824   431 tablet_replica.cc:333] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.157418   431 raft_consensus.cc:2243] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.157878   431 raft_consensus.cc:2272] T c0685c9ec507448db626053896fe5602 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.159758   431 tablet_replica.cc:333] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.160404   431 raft_consensus.cc:2243] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.161187   431 raft_consensus.cc:2272] T f93dc29fbefa4cbfaab40efabbc77e46 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.163215   431 tablet_replica.cc:333] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.163875   431 raft_consensus.cc:2243] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.164397   431 raft_consensus.cc:2272] T c8a4f168e98a42e385a164bda9d39f2a P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.167003   431 tablet_replica.cc:333] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.167635   431 raft_consensus.cc:2243] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.168114   431 raft_consensus.cc:2272] T 23ef029cf89847d5bc90dec72f9848bf P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.170470   431 tablet_replica.cc:333] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.171265   431 raft_consensus.cc:2243] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.171815   431 raft_consensus.cc:2272] T f2b8bb477df64462a43529bc66839022 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.174815   431 tablet_replica.cc:333] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.175659   431 raft_consensus.cc:2243] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:05:23.175546 10162 consensus_peers.cc:597] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.176810   431 raft_consensus.cc:2272] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.179386   431 tablet_replica.cc:333] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.180116   431 raft_consensus.cc:2243] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.180609   431 raft_consensus.cc:2272] T 1672e25d2e934530932794c0a0482107 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.182866   431 tablet_replica.cc:333] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.183454   431 raft_consensus.cc:2243] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.184334   431 raft_consensus.cc:2272] T ad33365d4b2c4861b6c6c32f7821d83a P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.186173   431 tablet_replica.cc:333] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.186728   431 raft_consensus.cc:2243] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.187500   431 raft_consensus.cc:2272] T f635b52cce78424aac4b15f34ef95f42 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.189471   431 tablet_replica.cc:333] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.190023   431 raft_consensus.cc:2243] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.190860   431 raft_consensus.cc:2272] T 8003ff9dc64c486faae3f3a82bdaa11e P c5b39fd125c84087bf29c0d4b747e04e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.193590   431 tablet_replica.cc:333] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.194213   431 raft_consensus.cc:2243] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.195055   431 raft_consensus.cc:2272] T 385ba8f2042241febbda746c9bb96b78 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.197177   431 tablet_replica.cc:333] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.197693   431 raft_consensus.cc:2243] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.198141   431 raft_consensus.cc:2272] T 216ec5b1720144aca4d4675cbc6fabf6 P c5b39fd125c84087bf29c0d4b747e04e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.200116   431 tablet_replica.cc:333] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e: stopping tablet replica
I20260709 13:05:23.200585   431 raft_consensus.cc:2243] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.201007   431 raft_consensus.cc:2272] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c5b39fd125c84087bf29c0d4b747e04e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:23.246184 10088 consensus_peers.cc:597] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.258970 10088 consensus_peers.cc:597] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.274050 10088 consensus_peers.cc:597] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.334215   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:23.353201 10162 consensus_peers.cc:597] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.354103 10162 consensus_peers.cc:597] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.372653 10162 consensus_peers.cc:597] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.380914 10162 consensus_peers.cc:597] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.422506   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:05:23.460727 10088 consensus_peers.cc:597] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.476653   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:23.477828   431 tablet_replica.cc:333] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.478726   431 raft_consensus.cc:2243] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.479431   431 raft_consensus.cc:2272] T ae3e982bee53440996e25dffe76875d1 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.482132   431 tablet_replica.cc:333] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.482720   431 raft_consensus.cc:2243] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.483529   431 raft_consensus.cc:2272] T bc09e89b97344b13a7b9283e35bd39a1 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.486588   431 tablet_replica.cc:333] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.487244   431 raft_consensus.cc:2243] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.487918   431 raft_consensus.cc:2272] T ad33365d4b2c4861b6c6c32f7821d83a P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.490506   431 tablet_replica.cc:333] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.491187   431 raft_consensus.cc:2243] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.492709   431 raft_consensus.cc:2272] T 49597fd27b47492e8d6d108a9c2733bb P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.496155   431 tablet_replica.cc:333] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.496928   431 raft_consensus.cc:2243] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.498371   431 raft_consensus.cc:2272] T 4f7c16fe8bbb4d57b242298efe0d7a77 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.501374   431 tablet_replica.cc:333] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.501986   431 raft_consensus.cc:2243] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.503265   431 raft_consensus.cc:2272] T c0685c9ec507448db626053896fe5602 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.506407   431 tablet_replica.cc:333] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.507143   431 raft_consensus.cc:2243] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.508224   431 raft_consensus.cc:2272] T 128a8114799a498193bab8a2012537ff P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.511171   431 tablet_replica.cc:333] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.511897   431 raft_consensus.cc:2243] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.512606   431 raft_consensus.cc:2272] T f93dc29fbefa4cbfaab40efabbc77e46 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.515128   431 tablet_replica.cc:333] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.515803   431 raft_consensus.cc:2243] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.516462   431 raft_consensus.cc:2272] T c8a4f168e98a42e385a164bda9d39f2a P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.518980   431 tablet_replica.cc:333] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.519644   431 raft_consensus.cc:2243] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.520251   431 raft_consensus.cc:2272] T 23ef029cf89847d5bc90dec72f9848bf P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.522683   431 tablet_replica.cc:333] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.523298   431 raft_consensus.cc:2243] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.524479   431 raft_consensus.cc:2272] T 29c57ecf7faa412ab93e405d8b1e2ef7 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.526899   431 tablet_replica.cc:333] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.527469   431 raft_consensus.cc:2243] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.528491   431 raft_consensus.cc:2272] T 1672e25d2e934530932794c0a0482107 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.531221   431 tablet_replica.cc:333] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.531803   431 raft_consensus.cc:2243] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.532991   431 raft_consensus.cc:2272] T 216ec5b1720144aca4d4675cbc6fabf6 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.535727   431 tablet_replica.cc:333] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.536329   431 raft_consensus.cc:2243] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.537346   431 raft_consensus.cc:2272] T f635b52cce78424aac4b15f34ef95f42 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.540804   431 tablet_replica.cc:333] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.541606   431 raft_consensus.cc:2243] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:23.542471 10165 consensus_peers.cc:597] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Couldn't send request to peer 2c755ea83e7548b48d55039aee37517d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.542536   431 raft_consensus.cc:2272] T 8003ff9dc64c486faae3f3a82bdaa11e P 2c755ea83e7548b48d55039aee37517d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.545364   431 tablet_replica.cc:333] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.545982   431 raft_consensus.cc:2243] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.546559   431 raft_consensus.cc:2272] T 385ba8f2042241febbda746c9bb96b78 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.548846   431 tablet_replica.cc:333] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.549435   431 raft_consensus.cc:2243] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.550046   431 raft_consensus.cc:2272] T 1a1e9f4cd898479a9ce3ebf9068985a5 P 2c755ea83e7548b48d55039aee37517d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.552541   431 tablet_replica.cc:333] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d: stopping tablet replica
I20260709 13:05:23.553071   431 raft_consensus.cc:2243] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.553586   431 raft_consensus.cc:2272] T f2b8bb477df64462a43529bc66839022 P 2c755ea83e7548b48d55039aee37517d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.601761   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:05:23.603641 10165 consensus_peers.cc:597] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Couldn't send request to peer 2c755ea83e7548b48d55039aee37517d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.622918 10162 consensus_peers.cc:597] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer c5b39fd125c84087bf29c0d4b747e04e (127.0.107.193:40915): Couldn't send request to peer c5b39fd125c84087bf29c0d4b747e04e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:23.634650 10165 consensus_peers.cc:597] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd -> Peer 2c755ea83e7548b48d55039aee37517d (127.0.107.194:37889): Couldn't send request to peer 2c755ea83e7548b48d55039aee37517d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37889: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.655165   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:05:23.696120   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:23.697099   431 tablet_replica.cc:333] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.698755   431 raft_consensus.cc:2243] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.700791   431 raft_consensus.cc:2272] T bc09e89b97344b13a7b9283e35bd39a1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.704957   431 tablet_replica.cc:333] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.706180   431 raft_consensus.cc:2243] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.707371   431 raft_consensus.cc:2272] T ae3e982bee53440996e25dffe76875d1 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.710175   431 tablet_replica.cc:333] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.710911   431 raft_consensus.cc:2243] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.711566   431 raft_consensus.cc:2272] T 49597fd27b47492e8d6d108a9c2733bb P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.714466   431 tablet_replica.cc:333] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.715188   431 raft_consensus.cc:2243] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.715879   431 raft_consensus.cc:2272] T 4f7c16fe8bbb4d57b242298efe0d7a77 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.718675   431 tablet_replica.cc:333] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.719429   431 raft_consensus.cc:2243] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.720248   431 raft_consensus.cc:2272] T ad33365d4b2c4861b6c6c32f7821d83a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.722929   431 tablet_replica.cc:333] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.723596   431 raft_consensus.cc:2243] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.724304   431 raft_consensus.cc:2272] T 8003ff9dc64c486faae3f3a82bdaa11e P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.727583   431 tablet_replica.cc:333] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.728449   431 raft_consensus.cc:2243] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.729142   431 raft_consensus.cc:2272] T 385ba8f2042241febbda746c9bb96b78 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.731985   431 tablet_replica.cc:333] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.732793   431 raft_consensus.cc:2243] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.733510   431 raft_consensus.cc:2272] T f635b52cce78424aac4b15f34ef95f42 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.736718   431 tablet_replica.cc:333] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.737510   431 raft_consensus.cc:2243] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.738200   431 raft_consensus.cc:2272] T c0685c9ec507448db626053896fe5602 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.741237   431 tablet_replica.cc:333] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.741973   431 raft_consensus.cc:2243] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.742640   431 raft_consensus.cc:2272] T f93dc29fbefa4cbfaab40efabbc77e46 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.745656   431 tablet_replica.cc:333] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.746430   431 raft_consensus.cc:2243] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.747970   431 raft_consensus.cc:2272] T 128a8114799a498193bab8a2012537ff P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.750648   431 tablet_replica.cc:333] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.751524   431 raft_consensus.cc:2243] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.752185   431 raft_consensus.cc:2272] T 29c57ecf7faa412ab93e405d8b1e2ef7 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.754912   431 tablet_replica.cc:333] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.755613   431 raft_consensus.cc:2243] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.756345   431 raft_consensus.cc:2272] T 216ec5b1720144aca4d4675cbc6fabf6 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.759083   431 tablet_replica.cc:333] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.759729   431 raft_consensus.cc:2243] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.760368   431 raft_consensus.cc:2272] T 1672e25d2e934530932794c0a0482107 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.762899   431 tablet_replica.cc:333] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.763518   431 raft_consensus.cc:2243] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.764664   431 raft_consensus.cc:2272] T 23ef029cf89847d5bc90dec72f9848bf P c9ace2311e0e4f63ae2edfc9606ac2cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.767807   431 tablet_replica.cc:333] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.768626   431 raft_consensus.cc:2243] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.769762   431 raft_consensus.cc:2272] T c8a4f168e98a42e385a164bda9d39f2a P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.772395   431 tablet_replica.cc:333] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.773010   431 raft_consensus.cc:2243] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:23.773627   431 raft_consensus.cc:2272] T 1a1e9f4cd898479a9ce3ebf9068985a5 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.776136   431 tablet_replica.cc:333] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd: stopping tablet replica
I20260709 13:05:23.776667   431 raft_consensus.cc:2243] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.777778   431 raft_consensus.cc:2272] T f2b8bb477df64462a43529bc66839022 P c9ace2311e0e4f63ae2edfc9606ac2cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.828447   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:23.880836   431 master.cc:562] Master@127.0.107.254:39905 shutting down...
I20260709 13:05:23.911271   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:23.912243   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:23.912673   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5524595632af40d8938833eb0e22d35c: stopping tablet replica
I20260709 13:05:23.938163   431 master.cc:584] Master@127.0.107.254:39905 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12895 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:05:24.000715   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41097
I20260709 13:05:24.001809   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:24.009147 10528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:24.009145 10527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:24.010535 10530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:24.010965   431 server_base.cc:1061] running on GCE node
I20260709 13:05:24.012137   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:24.012336   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:24.012471   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602324012460 us; error 0 us; skew 500 ppm
I20260709 13:05:24.012974   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:24.015676   431 webserver.cc:533] Webserver started at http://127.0.107.254:46213/ using document root <none> and password file <none>
I20260709 13:05:24.016250   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:24.016431   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:24.016664   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:24.018054   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/master-0-root/instance:
uuid: "0d4d21ca4e0c4821858f9dfc23ed404d"
format_stamp: "Formatted at 2026-07-09 13:05:24 on dist-test-slave-smzk"
I20260709 13:05:24.023118   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:05:24.027209 10535 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.028210   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:24.028584   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/master-0-root
uuid: "0d4d21ca4e0c4821858f9dfc23ed404d"
format_stamp: "Formatted at 2026-07-09 13:05:24 on dist-test-slave-smzk"
I20260709 13:05:24.028883   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:24.061353   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:24.062825   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:24.112558   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41097
I20260709 13:05:24.112655 10586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41097 every 8 connection(s)
I20260709 13:05:24.117936 10587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.132391 10587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d: Bootstrap starting.
I20260709 13:05:24.138092 10587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:24.143069 10587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d: No bootstrap required, opened a new log
I20260709 13:05:24.145447 10587 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d4d21ca4e0c4821858f9dfc23ed404d" member_type: VOTER }
I20260709 13:05:24.145874 10587 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:24.146070 10587 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d4d21ca4e0c4821858f9dfc23ed404d, State: Initialized, Role: FOLLOWER
I20260709 13:05:24.146579 10587 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d4d21ca4e0c4821858f9dfc23ed404d" member_type: VOTER }
I20260709 13:05:24.147071 10587 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:24.147271 10587 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:24.147493 10587 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:24.152374 10587 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d4d21ca4e0c4821858f9dfc23ed404d" member_type: VOTER }
I20260709 13:05:24.152873 10587 leader_election.cc:304] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d4d21ca4e0c4821858f9dfc23ed404d; no voters: 
I20260709 13:05:24.154085 10587 leader_election.cc:290] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:24.154815 10590 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:24.157024 10590 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 1 LEADER]: Becoming Leader. State: Replica: 0d4d21ca4e0c4821858f9dfc23ed404d, State: Running, Role: LEADER
I20260709 13:05:24.157846 10590 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d4d21ca4e0c4821858f9dfc23ed404d" member_type: VOTER }
I20260709 13:05:24.157968 10587 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:24.167137 10592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d4d21ca4e0c4821858f9dfc23ed404d. Latest consensus state: current_term: 1 leader_uuid: "0d4d21ca4e0c4821858f9dfc23ed404d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d4d21ca4e0c4821858f9dfc23ed404d" member_type: VOTER } }
I20260709 13:05:24.167794 10592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:24.168457 10591 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d4d21ca4e0c4821858f9dfc23ed404d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d4d21ca4e0c4821858f9dfc23ed404d" member_type: VOTER } }
I20260709 13:05:24.169253 10591 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:24.170289 10600 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:24.176292 10600 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:24.177560   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:24.186925 10600 catalog_manager.cc:1383] Generated new cluster ID: 940b6a0ae84442fe855aea8e62c6bd4a
I20260709 13:05:24.187282 10600 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:24.208007 10600 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:24.209656 10600 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:24.223073 10600 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d: Generated new TSK 0
I20260709 13:05:24.223855 10600 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:24.244819   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:24.252547 10608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:24.252888 10609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:24.259789   431 server_base.cc:1061] running on GCE node
W20260709 13:05:24.259959 10611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:24.264987   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:24.265269   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:24.265475   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602324265448 us; error 0 us; skew 500 ppm
I20260709 13:05:24.266016   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:24.269007   431 webserver.cc:533] Webserver started at http://127.0.107.193:34691/ using document root <none> and password file <none>
I20260709 13:05:24.269565   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:24.269834   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:24.270123   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:24.271323   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-0-root/instance:
uuid: "85c88fd77ae44877b903aa43df3211a9"
format_stamp: "Formatted at 2026-07-09 13:05:24 on dist-test-slave-smzk"
I20260709 13:05:24.276484   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:24.280258 10616 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.281420   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:24.281831   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-0-root
uuid: "85c88fd77ae44877b903aa43df3211a9"
format_stamp: "Formatted at 2026-07-09 13:05:24 on dist-test-slave-smzk"
I20260709 13:05:24.282187   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:24.301860   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:24.303215   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:24.305115   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:24.307765   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:24.308007   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.308300   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:24.308490   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.360944   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:42049
I20260709 13:05:24.361138 10678 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:42049 every 8 connection(s)
I20260709 13:05:24.366295   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:24.375242 10683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:24.375525 10684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:24.378880 10686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:24.380604   431 server_base.cc:1061] running on GCE node
I20260709 13:05:24.382056   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:24.382414   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:24.382634   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602324382615 us; error 0 us; skew 500 ppm
I20260709 13:05:24.382836 10679 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41097
I20260709 13:05:24.383296   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:24.383424 10679 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:24.384630 10679 heartbeater.cc:507] Master 127.0.107.254:41097 requested a full tablet report, sending...
I20260709 13:05:24.386603   431 webserver.cc:533] Webserver started at http://127.0.107.194:40379/ using document root <none> and password file <none>
I20260709 13:05:24.387279   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:24.387468   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:24.387815   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:24.387828 10552 ts_manager.cc:194] Registered new tserver with Master: 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049)
I20260709 13:05:24.389122   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-1-root/instance:
uuid: "00ea50ef9f5143f5a019e96aa66c5154"
format_stamp: "Formatted at 2026-07-09 13:05:24 on dist-test-slave-smzk"
I20260709 13:05:24.390535 10552 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44472
I20260709 13:05:24.394373   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:05:24.398664 10691 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.399708   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:05:24.400142   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-1-root
uuid: "00ea50ef9f5143f5a019e96aa66c5154"
format_stamp: "Formatted at 2026-07-09 13:05:24 on dist-test-slave-smzk"
I20260709 13:05:24.400439   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:24.451434   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:24.453118   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:24.454921   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:24.457608   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:24.457873   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.458158   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:24.458364   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.511089   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:41601
I20260709 13:05:24.511274 10753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:41601 every 8 connection(s)
I20260709 13:05:24.517423   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:24.526424 10757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:24.528357 10758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:24.532640 10761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:24.534051   431 server_base.cc:1061] running on GCE node
I20260709 13:05:24.534597 10754 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41097
I20260709 13:05:24.535236 10754 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:24.535377   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:24.535748   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:24.535948   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602324535927 us; error 0 us; skew 500 ppm
I20260709 13:05:24.536345 10754 heartbeater.cc:507] Master 127.0.107.254:41097 requested a full tablet report, sending...
I20260709 13:05:24.536628   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:24.539232 10552 ts_manager.cc:194] Registered new tserver with Master: 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:24.539917   431 webserver.cc:533] Webserver started at http://127.0.107.195:38353/ using document root <none> and password file <none>
I20260709 13:05:24.540617   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:24.540825   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:24.541124   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:24.541474 10552 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44486
I20260709 13:05:24.542306   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-2-root/instance:
uuid: "cbf3815fdab94160b27744ee35801b55"
format_stamp: "Formatted at 2026-07-09 13:05:24 on dist-test-slave-smzk"
I20260709 13:05:24.547708   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:05:24.552234 10765 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.553383   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:24.553732   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-2-root
uuid: "cbf3815fdab94160b27744ee35801b55"
format_stamp: "Formatted at 2026-07-09 13:05:24 on dist-test-slave-smzk"
I20260709 13:05:24.554337   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBUscro/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602014598663-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:24.599326   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:24.601105   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:24.603135   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:24.605988   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:24.606210   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.606580   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:24.606735   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:24.668704   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:40135
I20260709 13:05:24.668769 10827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:40135 every 8 connection(s)
I20260709 13:05:24.686112 10828 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41097
I20260709 13:05:24.686569 10828 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:24.687386 10828 heartbeater.cc:507] Master 127.0.107.254:41097 requested a full tablet report, sending...
I20260709 13:05:24.689739 10552 ts_manager.cc:194] Registered new tserver with Master: cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:24.689949   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.0169404s
I20260709 13:05:24.691406 10552 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44488
I20260709 13:05:24.725384 10552 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44490:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:24.729029 10552 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:24.812841 10793 tablet_service.cc:1511] Processing CreateTablet for tablet e8b4bf606302404890fd04b953fdb519 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:24.815285 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b4bf606302404890fd04b953fdb519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.819042 10792 tablet_service.cc:1511] Processing CreateTablet for tablet b96de0a197bf4f04b94aaa0f84d4c239 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:24.821406 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b96de0a197bf4f04b94aaa0f84d4c239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.828461 10791 tablet_service.cc:1511] Processing CreateTablet for tablet ef8cdfc7d09543dc8af92f7813c524f2 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:24.830376 10791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8cdfc7d09543dc8af92f7813c524f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.834935 10790 tablet_service.cc:1511] Processing CreateTablet for tablet a0fa882d5b5f496e9b9ede0825792d89 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:24.839354 10718 tablet_service.cc:1511] Processing CreateTablet for tablet b96de0a197bf4f04b94aaa0f84d4c239 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:24.840981 10718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b96de0a197bf4f04b94aaa0f84d4c239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.842075 10715 tablet_service.cc:1511] Processing CreateTablet for tablet 755d9f68be0647e7bd1a073fae32e644 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:24.842818 10643 tablet_service.cc:1511] Processing CreateTablet for tablet b96de0a197bf4f04b94aaa0f84d4c239 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:24.843684 10715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755d9f68be0647e7bd1a073fae32e644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.843933 10644 tablet_service.cc:1511] Processing CreateTablet for tablet e8b4bf606302404890fd04b953fdb519 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:24.844496 10643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b96de0a197bf4f04b94aaa0f84d4c239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.845378 10644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b4bf606302404890fd04b953fdb519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.845243 10716 tablet_service.cc:1511] Processing CreateTablet for tablet a0fa882d5b5f496e9b9ede0825792d89 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:24.847664 10717 tablet_service.cc:1511] Processing CreateTablet for tablet ef8cdfc7d09543dc8af92f7813c524f2 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:24.849229 10642 tablet_service.cc:1511] Processing CreateTablet for tablet ef8cdfc7d09543dc8af92f7813c524f2 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:24.837445 10719 tablet_service.cc:1511] Processing CreateTablet for tablet e8b4bf606302404890fd04b953fdb519 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:24.852108 10790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fa882d5b5f496e9b9ede0825792d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.853364 10640 tablet_service.cc:1511] Processing CreateTablet for tablet 755d9f68be0647e7bd1a073fae32e644 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:24.855729 10789 tablet_service.cc:1511] Processing CreateTablet for tablet 755d9f68be0647e7bd1a073fae32e644 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:24.852164 10641 tablet_service.cc:1511] Processing CreateTablet for tablet a0fa882d5b5f496e9b9ede0825792d89 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:24.857225 10789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755d9f68be0647e7bd1a073fae32e644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.850615 10642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8cdfc7d09543dc8af92f7813c524f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.864761 10640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 755d9f68be0647e7bd1a073fae32e644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.865607 10716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fa882d5b5f496e9b9ede0825792d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.865881 10641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0fa882d5b5f496e9b9ede0825792d89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.866577 10717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8cdfc7d09543dc8af92f7813c524f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.868539 10719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b4bf606302404890fd04b953fdb519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.884317 10639 tablet_service.cc:1511] Processing CreateTablet for tablet 67de90e515a540dda2a2d1cf7e3d08b5 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:24.886219 10639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67de90e515a540dda2a2d1cf7e3d08b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.894292 10714 tablet_service.cc:1511] Processing CreateTablet for tablet 67de90e515a540dda2a2d1cf7e3d08b5 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:24.896203 10714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67de90e515a540dda2a2d1cf7e3d08b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.897367 10788 tablet_service.cc:1511] Processing CreateTablet for tablet 67de90e515a540dda2a2d1cf7e3d08b5 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:24.899426 10788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67de90e515a540dda2a2d1cf7e3d08b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.906983 10638 tablet_service.cc:1511] Processing CreateTablet for tablet 92ea8c96386a441db4e7f2525862c020 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:24.909848 10713 tablet_service.cc:1511] Processing CreateTablet for tablet 92ea8c96386a441db4e7f2525862c020 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:24.910015 10637 tablet_service.cc:1511] Processing CreateTablet for tablet f588edef19fb4dc8a37155df01a6015e (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:24.911158 10786 tablet_service.cc:1511] Processing CreateTablet for tablet f588edef19fb4dc8a37155df01a6015e (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:24.911734 10713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ea8c96386a441db4e7f2525862c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.913183 10786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f588edef19fb4dc8a37155df01a6015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.903582 10787 tablet_service.cc:1511] Processing CreateTablet for tablet 92ea8c96386a441db4e7f2525862c020 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:24.917883 10787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ea8c96386a441db4e7f2525862c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.918375 10712 tablet_service.cc:1511] Processing CreateTablet for tablet f588edef19fb4dc8a37155df01a6015e (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:24.920367 10712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f588edef19fb4dc8a37155df01a6015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.921382 10638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ea8c96386a441db4e7f2525862c020. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.926440 10636 tablet_service.cc:1511] Processing CreateTablet for tablet 12c33d3d53c04acc99ce779a56a0c953 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:24.928779 10637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f588edef19fb4dc8a37155df01a6015e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.932515 10636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c33d3d53c04acc99ce779a56a0c953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.960443 10711 tablet_service.cc:1511] Processing CreateTablet for tablet 12c33d3d53c04acc99ce779a56a0c953 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:24.962435 10711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c33d3d53c04acc99ce779a56a0c953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.989044 10793 tablet_service.cc:1511] Processing CreateTablet for tablet 12c33d3d53c04acc99ce779a56a0c953 (DEFAULT_TABLE table=test-workload [id=1a94d25f53a040579d0f3b1eedc4fc58]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:24.990573 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12c33d3d53c04acc99ce779a56a0c953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.994972 10848 tablet_bootstrap.cc:492] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.003878 10847 tablet_bootstrap.cc:492] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.024780 10848 tablet_bootstrap.cc:654] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.024926 10846 tablet_bootstrap.cc:492] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.033555 10847 tablet_bootstrap.cc:654] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.050297 10846 tablet_bootstrap.cc:654] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.081488 10846 tablet_bootstrap.cc:492] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.082193 10846 ts_tablet_manager.cc:1403] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.015s
I20260709 13:05:25.082715 10847 tablet_bootstrap.cc:492] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.082973 10848 tablet_bootstrap.cc:492] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.083369 10847 ts_tablet_manager.cc:1403] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.080s	user 0.003s	sys 0.010s
I20260709 13:05:25.083607 10848 ts_tablet_manager.cc:1403] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.008s
I20260709 13:05:25.086068 10846 raft_consensus.cc:359] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.086300 10848 raft_consensus.cc:359] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.087023 10846 raft_consensus.cc:385] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.087178 10848 raft_consensus.cc:385] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.086906 10847 raft_consensus.cc:359] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.087642 10846 raft_consensus.cc:740] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.087865 10847 raft_consensus.cc:385] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.088487 10847 raft_consensus.cc:740] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.088811 10846 consensus_queue.cc:260] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.089356 10847 consensus_queue.cc:260] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.087769 10848 raft_consensus.cc:740] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.092180 10828 heartbeater.cc:499] Master 127.0.107.254:41097 was elected leader, sending a full tablet report...
I20260709 13:05:25.092562 10848 consensus_queue.cc:260] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.093391 10846 ts_tablet_manager.cc:1434] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:05:25.094789 10846 tablet_bootstrap.cc:492] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.095047 10847 ts_tablet_manager.cc:1434] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:05:25.096100 10679 heartbeater.cc:499] Master 127.0.107.254:41097 was elected leader, sending a full tablet report...
I20260709 13:05:25.096336 10847 tablet_bootstrap.cc:492] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.102347 10846 tablet_bootstrap.cc:654] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.106153 10847 tablet_bootstrap.cc:654] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.137953 10754 heartbeater.cc:499] Master 127.0.107.254:41097 was elected leader, sending a full tablet report...
I20260709 13:05:25.138669 10848 ts_tablet_manager.cc:1434] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.055s	user 0.028s	sys 0.017s
I20260709 13:05:25.140478 10848 tablet_bootstrap.cc:492] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.152310 10848 tablet_bootstrap.cc:654] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.160143 10846 tablet_bootstrap.cc:492] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.160776 10846 ts_tablet_manager.cc:1403] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.021s
I20260709 13:05:25.161651 10847 tablet_bootstrap.cc:492] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.162446 10847 ts_tablet_manager.cc:1403] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.047s
I20260709 13:05:25.164369 10846 raft_consensus.cc:359] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.165256 10846 raft_consensus.cc:385] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.165530 10846 raft_consensus.cc:740] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.165642 10847 raft_consensus.cc:359] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.166524 10847 raft_consensus.cc:385] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.167078 10847 raft_consensus.cc:740] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.166522 10846 consensus_queue.cc:260] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.167914 10847 consensus_queue.cc:260] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.172308 10848 tablet_bootstrap.cc:492] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.172888 10848 ts_tablet_manager.cc:1403] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.008s
W20260709 13:05:25.169432 10599 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:25.174389 10847 ts_tablet_manager.cc:1434] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 13:05:25.175496 10847 tablet_bootstrap.cc:492] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.175953 10848 raft_consensus.cc:359] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.176777 10848 raft_consensus.cc:385] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.177074 10848 raft_consensus.cc:740] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.178078 10848 consensus_queue.cc:260] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.179670 10846 ts_tablet_manager.cc:1434] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:05:25.180363 10848 ts_tablet_manager.cc:1434] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:25.180927 10846 tablet_bootstrap.cc:492] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.183014 10847 tablet_bootstrap.cc:654] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.190814 10846 tablet_bootstrap.cc:654] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.195500 10847 tablet_bootstrap.cc:492] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.196198 10847 ts_tablet_manager.cc:1403] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.015s
I20260709 13:05:25.199095 10852 raft_consensus.cc:493] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.199658 10847 raft_consensus.cc:359] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.200603 10847 raft_consensus.cc:385] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.199883 10852 raft_consensus.cc:515] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.200918 10847 raft_consensus.cc:740] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.201082 10848 tablet_bootstrap.cc:492] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.202031 10847 consensus_queue.cc:260] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.204789 10847 ts_tablet_manager.cc:1434] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:05:25.205940 10847 tablet_bootstrap.cc:492] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.208833 10848 tablet_bootstrap.cc:654] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.212658 10847 tablet_bootstrap.cc:654] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.222687 10848 tablet_bootstrap.cc:492] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.223412 10848 ts_tablet_manager.cc:1403] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.002s
I20260709 13:05:25.227589 10848 raft_consensus.cc:359] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.228804 10848 raft_consensus.cc:385] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.229197 10848 raft_consensus.cc:740] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.229280 10852 leader_election.cc:290] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:25.231197 10853 raft_consensus.cc:493] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.230945 10848 consensus_queue.cc:260] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.231797 10853 raft_consensus.cc:515] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.238197 10848 ts_tablet_manager.cc:1434] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:05:25.239711 10848 tablet_bootstrap.cc:492] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.244930 10853 leader_election.cc:290] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.253930 10846 tablet_bootstrap.cc:492] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.254667 10846 ts_tablet_manager.cc:1403] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.074s	user 0.022s	sys 0.042s
I20260709 13:05:25.257678 10846 raft_consensus.cc:359] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.258303 10846 raft_consensus.cc:385] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.258566 10846 raft_consensus.cc:740] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.259338 10846 consensus_queue.cc:260] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.261574 10846 ts_tablet_manager.cc:1434] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:25.262706 10846 tablet_bootstrap.cc:492] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.270632 10847 tablet_bootstrap.cc:492] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.271088 10848 tablet_bootstrap.cc:654] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.271438 10847 ts_tablet_manager.cc:1403] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.009s
I20260709 13:05:25.274125 10846 tablet_bootstrap.cc:654] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.288286 10854 raft_consensus.cc:493] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.288936 10854 raft_consensus.cc:515] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.291046 10847 raft_consensus.cc:359] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.291931 10847 raft_consensus.cc:385] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.292255 10847 raft_consensus.cc:740] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.293021 10847 consensus_queue.cc:260] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.299362 10848 tablet_bootstrap.cc:492] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.299145 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa882d5b5f496e9b9ede0825792d89" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:25.300161 10848 ts_tablet_manager.cc:1403] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.006s
I20260709 13:05:25.302722 10854 leader_election.cc:290] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.303246 10848 raft_consensus.cc:359] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.304163 10848 raft_consensus.cc:385] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.304459 10848 raft_consensus.cc:740] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.305225 10848 consensus_queue.cc:260] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.307720 10848 ts_tablet_manager.cc:1434] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:25.311872 10848 tablet_bootstrap.cc:492] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.311738 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
W20260709 13:05:25.313134 10766 leader_election.cc:343] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.318311 10846 tablet_bootstrap.cc:492] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.318636 10847 ts_tablet_manager.cc:1434] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:05:25.319053 10846 ts_tablet_manager.cc:1403] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.011s
I20260709 13:05:25.320535 10847 tablet_bootstrap.cc:492] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.322154 10848 tablet_bootstrap.cc:654] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.323350 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa882d5b5f496e9b9ede0825792d89" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
W20260709 13:05:25.325799 10768 leader_election.cc:343] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.326428 10768 leader_election.cc:304] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbf3815fdab94160b27744ee35801b55; no voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:25.328060 10852 raft_consensus.cc:2749] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.332268 10847 tablet_bootstrap.cc:654] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:25.336745 10617 leader_election.cc:343] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.330781 10846 raft_consensus.cc:359] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.340111 10846 raft_consensus.cc:385] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.340592 10846 raft_consensus.cc:740] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.342213 10846 consensus_queue.cc:260] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.345789 10846 ts_tablet_manager.cc:1434] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:05:25.343539 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.347272 10803 raft_consensus.cc:2468] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:25.347648 10846 tablet_bootstrap.cc:492] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.352738 10618 leader_election.cc:304] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:25.353322 10848 tablet_bootstrap.cc:492] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.353952 10848 ts_tablet_manager.cc:1403] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.020s
I20260709 13:05:25.353924 10853 raft_consensus.cc:2804] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.354485 10853 raft_consensus.cc:493] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.354848 10853 raft_consensus.cc:3060] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.358013 10846 tablet_bootstrap.cc:654] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.361126 10848 raft_consensus.cc:359] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.361996 10848 raft_consensus.cc:385] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.362294 10848 raft_consensus.cc:740] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.363229 10848 consensus_queue.cc:260] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.369374 10848 ts_tablet_manager.cc:1434] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:05:25.370399 10848 tablet_bootstrap.cc:492] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.377127 10848 tablet_bootstrap.cc:654] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.382853 10846 tablet_bootstrap.cc:492] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.383432 10846 ts_tablet_manager.cc:1403] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.036s	user 0.027s	sys 0.006s
I20260709 13:05:25.386917 10846 raft_consensus.cc:359] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.387719 10846 raft_consensus.cc:385] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.388007 10846 raft_consensus.cc:740] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.388855 10846 consensus_queue.cc:260] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.391072 10846 ts_tablet_manager.cc:1434] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:25.383170 10853 raft_consensus.cc:515] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.394738 10848 tablet_bootstrap.cc:492] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.395395 10848 ts_tablet_manager.cc:1403] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:05:25.396250 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:25.396904 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.398525 10848 raft_consensus.cc:359] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
W20260709 13:05:25.398842 10693 leader_election.cc:343] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.399411 10848 raft_consensus.cc:385] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:25.398808 10617 leader_election.cc:343] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.400712 10846 tablet_bootstrap.cc:492] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.403131 10853 leader_election.cc:290] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.408663 10846 tablet_bootstrap.cc:654] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.410135 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:25.410840 10803 raft_consensus.cc:3060] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.399802 10848 raft_consensus.cc:740] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.411995 10848 consensus_queue.cc:260] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.414762 10848 ts_tablet_manager.cc:1434] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 13:05:25.415252 10847 tablet_bootstrap.cc:492] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.415863 10848 tablet_bootstrap.cc:492] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.416239 10847 ts_tablet_manager.cc:1403] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.096s	user 0.038s	sys 0.044s
I20260709 13:05:25.420527 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:25.421370 10654 raft_consensus.cc:2468] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 0.
I20260709 13:05:25.422322 10847 raft_consensus.cc:359] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.423069 10694 leader_election.cc:304] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: cbf3815fdab94160b27744ee35801b55
I20260709 13:05:25.423607 10848 tablet_bootstrap.cc:654] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.423645 10847 raft_consensus.cc:385] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.424458 10847 raft_consensus.cc:740] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.424525 10854 raft_consensus.cc:2804] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.425251 10854 raft_consensus.cc:493] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.425731 10854 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.436008 10848 tablet_bootstrap.cc:492] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.436710 10848 ts_tablet_manager.cc:1403] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:05:25.420601 10853 raft_consensus.cc:493] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.439810 10848 raft_consensus.cc:359] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.442719 10848 raft_consensus.cc:385] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.443078 10848 raft_consensus.cc:740] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.442809 10853 raft_consensus.cc:515] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.443953 10848 consensus_queue.cc:260] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.451336 10852 raft_consensus.cc:493] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.452247 10852 raft_consensus.cc:515] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.453186 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b4bf606302404890fd04b953fdb519" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:25.453785 10848 ts_tablet_manager.cc:1434] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:05:25.454010 10729 raft_consensus.cc:2468] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:25.454360 10853 leader_election.cc:290] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:25.455525 10617 leader_election.cc:304] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:25.455247 10848 tablet_bootstrap.cc:492] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.456923 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b4bf606302404890fd04b953fdb519" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:25.451001 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b4bf606302404890fd04b953fdb519" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.457635 10853 raft_consensus.cc:2804] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.458225 10853 raft_consensus.cc:493] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.458392 10802 raft_consensus.cc:2468] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:25.458782 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b4bf606302404890fd04b953fdb519" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:25.459746 10852 leader_election.cc:290] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049)
I20260709 13:05:25.459765 10729 raft_consensus.cc:2468] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:25.440382 10847 consensus_queue.cc:260] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.462464 10766 leader_election.cc:304] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:25.458670 10853 raft_consensus.cc:3060] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.463521 10852 raft_consensus.cc:2804] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.463825 10854 raft_consensus.cc:515] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.470433 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:25.472116 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:25.473224 10653 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.475533 10848 tablet_bootstrap.cc:654] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:25.472602 10693 leader_election.cc:343] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.442097 10803 raft_consensus.cc:2468] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
I20260709 13:05:25.478780 10618 leader_election.cc:304] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:25.463922 10852 raft_consensus.cc:493] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.479913 10852 raft_consensus.cc:3060] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.479805 10854 leader_election.cc:290] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.495101 10853 raft_consensus.cc:515] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.496572 10654 raft_consensus.cc:2393] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbf3815fdab94160b27744ee35801b55 in current term 1: Already voted for candidate 85c88fd77ae44877b903aa43df3211a9 in this term.
I20260709 13:05:25.497023 10846 tablet_bootstrap.cc:492] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.497681 10846 ts_tablet_manager.cc:1403] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.097s	user 0.041s	sys 0.025s
I20260709 13:05:25.498636 10847 ts_tablet_manager.cc:1434] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.082s	user 0.032s	sys 0.000s
I20260709 13:05:25.501376 10846 raft_consensus.cc:359] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.502607 10846 raft_consensus.cc:385] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.503870 10880 raft_consensus.cc:2804] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.504834 10880 raft_consensus.cc:697] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:25.503008 10846 raft_consensus.cc:740] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.506095 10846 consensus_queue.cc:260] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.506155 10880 consensus_queue.cc:237] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.508255 10847 tablet_bootstrap.cc:492] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.511957 10881 raft_consensus.cc:493] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.512894 10881 raft_consensus.cc:515] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.503016 10653 raft_consensus.cc:2468] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 1.
I20260709 13:05:25.519577 10694 leader_election.cc:304] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: cbf3815fdab94160b27744ee35801b55
I20260709 13:05:25.521032 10854 raft_consensus.cc:2804] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.521812 10854 raft_consensus.cc:697] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:25.523057 10853 leader_election.cc:290] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Requested vote from peers cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:25.522819 10854 consensus_queue.cc:237] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.523377 10847 tablet_bootstrap.cc:654] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.525691 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b4bf606302404890fd04b953fdb519" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:25.532366 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b4bf606302404890fd04b953fdb519" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:25.532760 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d9f68be0647e7bd1a073fae32e644" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.533299 10729 raft_consensus.cc:3060] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.533689 10802 raft_consensus.cc:2468] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:25.535392 10618 leader_election.cc:304] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:25.534650 10548 catalog_manager.cc:5697] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.539989 10881 leader_election.cc:290] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.541178 10881 raft_consensus.cc:2804] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.541661 10881 raft_consensus.cc:493] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.545732 10846 ts_tablet_manager.cc:1434] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.048s	user 0.016s	sys 0.009s
I20260709 13:05:25.547096 10846 tablet_bootstrap.cc:492] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.547690 10848 tablet_bootstrap.cc:492] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.548427 10848 ts_tablet_manager.cc:1403] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.035s
I20260709 13:05:25.560698 10729 raft_consensus.cc:2468] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
I20260709 13:05:25.562572 10847 tablet_bootstrap.cc:492] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.562981 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d9f68be0647e7bd1a073fae32e644" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:25.563939 10728 raft_consensus.cc:2468] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:25.563388 10847 ts_tablet_manager.cc:1403] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.004s
I20260709 13:05:25.565454 10846 tablet_bootstrap.cc:654] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.566941 10848 raft_consensus.cc:359] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.568120 10848 raft_consensus.cc:385] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.542039 10881 raft_consensus.cc:3060] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.568608 10848 raft_consensus.cc:740] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.569221 10549 catalog_manager.cc:5697] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.569752 10848 consensus_queue.cc:260] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.572149 10617 leader_election.cc:304] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:25.573138 10847 raft_consensus.cc:359] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.574005 10847 raft_consensus.cc:385] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.574882 10847 raft_consensus.cc:740] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.575346 10848 ts_tablet_manager.cc:1434] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.011s
I20260709 13:05:25.575383 10852 raft_consensus.cc:515] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.575779 10847 consensus_queue.cc:260] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.576606 10848 tablet_bootstrap.cc:492] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:25.576954 10803 raft_consensus.cc:2393] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85c88fd77ae44877b903aa43df3211a9 in current term 1: Already voted for candidate cbf3815fdab94160b27744ee35801b55 in this term.
I20260709 13:05:25.573930 10853 raft_consensus.cc:2804] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.580448 10847 ts_tablet_manager.cc:1434] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:05:25.581682 10853 raft_consensus.cc:697] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:25.584316 10853 consensus_queue.cc:237] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } }
I20260709 13:05:25.588182 10881 raft_consensus.cc:515] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.590674 10880 raft_consensus.cc:493] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.591300 10880 raft_consensus.cc:515] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.592262 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d9f68be0647e7bd1a073fae32e644" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:25.592846 10728 raft_consensus.cc:3060] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.593477 10848 tablet_bootstrap.cc:654] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.593786 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b4bf606302404890fd04b953fdb519" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:25.595005 10729 raft_consensus.cc:2393] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cbf3815fdab94160b27744ee35801b55 in current term 1: Already voted for candidate 85c88fd77ae44877b903aa43df3211a9 in this term.
I20260709 13:05:25.593888 10880 leader_election.cc:290] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.597718 10852 leader_election.cc:290] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049)
I20260709 13:05:25.598090 10847 tablet_bootstrap.cc:492] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.598709 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa882d5b5f496e9b9ede0825792d89" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:25.599720 10729 raft_consensus.cc:2468] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:25.591171 10881 leader_election.cc:290] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.601598 10617 leader_election.cc:304] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:25.602772 10881 raft_consensus.cc:2804] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.603137 10881 raft_consensus.cc:493] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.603461 10881 raft_consensus.cc:3060] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.608608 10847 tablet_bootstrap.cc:654] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.611007 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d9f68be0647e7bd1a073fae32e644" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:25.611124 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8b4bf606302404890fd04b953fdb519" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:25.612241 10803 raft_consensus.cc:3060] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.617617 10880 raft_consensus.cc:493] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.618808 10880 raft_consensus.cc:515] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.625240 10880 leader_election.cc:290] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.626364 10854 raft_consensus.cc:493] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.626875 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:25.627650 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa882d5b5f496e9b9ede0825792d89" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.628476 10802 raft_consensus.cc:2468] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:25.628916 10852 raft_consensus.cc:493] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.629769 10852 raft_consensus.cc:515] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.630080 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.633018 10852 leader_election.cc:290] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
W20260709 13:05:25.633086 10618 leader_election.cc:343] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.634306 10768 leader_election.cc:304] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbf3815fdab94160b27744ee35801b55; no voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:25.634678 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:25.636454 10727 raft_consensus.cc:2468] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:25.635013 10728 raft_consensus.cc:2468] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
I20260709 13:05:25.638403 10852 raft_consensus.cc:2749] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.627015 10854 raft_consensus.cc:515] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.635541 10803 raft_consensus.cc:2468] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
I20260709 13:05:25.640547 10854 leader_election.cc:290] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.640915 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:25.641007 10729 raft_consensus.cc:2468] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:25.643296 10618 leader_election.cc:304] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:25.626963 10881 raft_consensus.cc:515] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.643947 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:25.644295 10880 raft_consensus.cc:2804] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.644861 10653 raft_consensus.cc:2468] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 0.
I20260709 13:05:25.644927 10880 raft_consensus.cc:697] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
W20260709 13:05:25.645922 10768 leader_election.cc:343] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.653183 10880 consensus_queue.cc:237] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.657402 10766 leader_election.cc:304] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:25.658077 10617 leader_election.cc:304] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: cbf3815fdab94160b27744ee35801b55
I20260709 13:05:25.658859 10852 raft_consensus.cc:2804] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.659260 10852 raft_consensus.cc:493] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.659705 10852 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.660053 10881 leader_election.cc:290] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.659309 10853 raft_consensus.cc:2804] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.661881 10853 raft_consensus.cc:493] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.662230 10853 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.656642 10694 leader_election.cc:304] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:25.665251 10854 raft_consensus.cc:2804] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.665627 10854 raft_consensus.cc:493] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.665961 10854 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.669414 10846 tablet_bootstrap.cc:492] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.672165 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.672798 10853 raft_consensus.cc:515] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
W20260709 13:05:25.673610 10693 leader_election.cc:343] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.675580 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa882d5b5f496e9b9ede0825792d89" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:25.676198 10853 leader_election.cc:290] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.676992 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
W20260709 13:05:25.678402 10618 leader_election.cc:343] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.679171 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0fa882d5b5f496e9b9ede0825792d89" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:25.679697 10729 raft_consensus.cc:3060] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.683686 10879 raft_consensus.cc:493] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.684379 10879 raft_consensus.cc:515] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.685014 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:25.676218 10802 raft_consensus.cc:3060] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.686774 10879 leader_election.cc:290] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.688983 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:25.691442 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.692162 10803 raft_consensus.cc:2468] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 0.
I20260709 13:05:25.672199 10846 ts_tablet_manager.cc:1403] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.012s
W20260709 13:05:25.693012 10694 leader_election.cc:343] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.699020 10848 tablet_bootstrap.cc:492] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:25.699971 10848 ts_tablet_manager.cc:1403] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.124s	user 0.050s	sys 0.026s
I20260709 13:05:25.701792 10693 leader_election.cc:304] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:25.703147 10879 raft_consensus.cc:2804] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.703521 10879 raft_consensus.cc:493] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.703881 10879 raft_consensus.cc:3060] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.701423 10846 raft_consensus.cc:359] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.704666 10846 raft_consensus.cc:385] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.705664 10846 raft_consensus.cc:740] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.688800 10854 raft_consensus.cc:515] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.708789 10728 raft_consensus.cc:2393] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85c88fd77ae44877b903aa43df3211a9 in current term 1: Already voted for candidate 00ea50ef9f5143f5a019e96aa66c5154 in this term.
I20260709 13:05:25.711205 10617 leader_election.cc:304] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9; no voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55
I20260709 13:05:25.713743 10854 leader_election.cc:290] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.714860 10846 consensus_queue.cc:260] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.716343 10549 catalog_manager.cc:5697] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.717403 10846 ts_tablet_manager.cc:1434] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:05:25.718487 10846 tablet_bootstrap.cc:492] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.718387 10549 catalog_manager.cc:5697] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.720588 10880 raft_consensus.cc:2749] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.722761 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:25.723695 10653 raft_consensus.cc:2393] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 00ea50ef9f5143f5a019e96aa66c5154 in current term 1: Already voted for candidate 85c88fd77ae44877b903aa43df3211a9 in this term.
I20260709 13:05:25.703617 10848 raft_consensus.cc:359] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.724187 10848 raft_consensus.cc:385] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.724467 10848 raft_consensus.cc:740] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.725306 10848 consensus_queue.cc:260] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.726246 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:25.726570 10802 raft_consensus.cc:2468] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
I20260709 13:05:25.726871 10803 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.729166 10618 leader_election.cc:304] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:25.730346 10880 raft_consensus.cc:2804] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.731544 10880 raft_consensus.cc:697] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:25.731865 10848 ts_tablet_manager.cc:1434] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.004s
I20260709 13:05:25.733048 10880 consensus_queue.cc:237] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.733969 10846 tablet_bootstrap.cc:654] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.683790 10852 raft_consensus.cc:515] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.740916 10803 raft_consensus.cc:2468] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 1.
I20260709 13:05:25.742470 10693 leader_election.cc:304] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:25.743263 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:25.743759 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:25.743371 10854 raft_consensus.cc:2804] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.744596 10728 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.751341 10729 raft_consensus.cc:2468] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
W20260709 13:05:25.754026 10768 leader_election.cc:343] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.757594 10854 raft_consensus.cc:697] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:25.757428 10852 leader_election.cc:290] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:25.763458 10854 consensus_queue.cc:237] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.766469 10898 raft_consensus.cc:493] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.767515 10898 raft_consensus.cc:515] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.768596 10879 raft_consensus.cc:515] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.768966 10728 raft_consensus.cc:2468] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 1.
I20260709 13:05:25.770344 10898 leader_election.cc:290] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.770746 10766 leader_election.cc:304] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:25.771147 10879 leader_election.cc:290] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:25.773241 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:25.773957 10852 raft_consensus.cc:2804] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.773442 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:25.775000 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:25.776122 10802 raft_consensus.cc:3060] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.776494 10852 raft_consensus.cc:697] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:25.777623 10852 consensus_queue.cc:237] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.775234 10803 raft_consensus.cc:2393] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00ea50ef9f5143f5a019e96aa66c5154 in current term 1: Already voted for candidate 85c88fd77ae44877b903aa43df3211a9 in this term.
I20260709 13:05:25.786429 10847 tablet_bootstrap.cc:492] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.787380 10847 ts_tablet_manager.cc:1403] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.190s	user 0.053s	sys 0.040s
I20260709 13:05:25.789718 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:25.791577 10847 raft_consensus.cc:359] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.792421 10847 raft_consensus.cc:385] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.792719 10847 raft_consensus.cc:740] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.799276 10802 raft_consensus.cc:2468] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 1.
I20260709 13:05:25.800321 10847 consensus_queue.cc:260] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.803040 10694 leader_election.cc:304] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154; no voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55
I20260709 13:05:25.801381 10693 leader_election.cc:304] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:25.808918 10897 raft_consensus.cc:2804] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.809993 10897 raft_consensus.cc:697] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:25.809478 10854 raft_consensus.cc:3060] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.812299 10846 tablet_bootstrap.cc:492] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.813169 10846 ts_tablet_manager.cc:1403] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.017s
W20260709 13:05:25.810359 10694 leader_election.cc:343] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:25.814026 10897 consensus_queue.cc:237] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.816133 10847 ts_tablet_manager.cc:1434] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:05:25.817512 10847 tablet_bootstrap.cc:492] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.821013 10846 raft_consensus.cc:359] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.822379 10846 raft_consensus.cc:385] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.822707 10846 raft_consensus.cc:740] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.821671 10548 catalog_manager.cc:5697] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.823789 10846 consensus_queue.cc:260] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.825186 10549 catalog_manager.cc:5697] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.828310 10854 raft_consensus.cc:2749] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:25.831630 10847 tablet_bootstrap.cc:654] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.826136 10846 ts_tablet_manager.cc:1434] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:25.837776 10846 tablet_bootstrap.cc:492] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:25.838065 10847 tablet_bootstrap.cc:492] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.838625 10847 ts_tablet_manager.cc:1403] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.000s
I20260709 13:05:25.840201 10552 catalog_manager.cc:5697] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.841827 10847 raft_consensus.cc:359] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.842696 10847 raft_consensus.cc:385] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.842991 10847 raft_consensus.cc:740] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.843333 10552 catalog_manager.cc:5697] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:25.843778 10847 consensus_queue.cc:260] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.846623 10847 ts_tablet_manager.cc:1434] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:25.847694 10847 tablet_bootstrap.cc:492] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:25.852128 10846 tablet_bootstrap.cc:654] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.854178 10847 tablet_bootstrap.cc:654] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:25.858642 10846 tablet_bootstrap.cc:492] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:25.859316 10846 ts_tablet_manager.cc:1403] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 13:05:25.862354 10846 raft_consensus.cc:359] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.862776 10847 tablet_bootstrap.cc:492] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:25.862977 10846 raft_consensus.cc:385] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.863364 10846 raft_consensus.cc:740] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.863396 10847 ts_tablet_manager.cc:1403] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:05:25.864167 10846 consensus_queue.cc:260] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.866317 10847 raft_consensus.cc:359] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.866852 10846 ts_tablet_manager.cc:1434] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:05:25.867102 10847 raft_consensus.cc:385] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:25.867465 10847 raft_consensus.cc:740] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:25.868193 10847 consensus_queue.cc:260] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.870525 10847 ts_tablet_manager.cc:1434] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:05:25.872493 10852 raft_consensus.cc:493] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.873173 10852 raft_consensus.cc:515] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.875577 10852 leader_election.cc:290] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:25.877503 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c33d3d53c04acc99ce779a56a0c953" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:25.877681 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c33d3d53c04acc99ce779a56a0c953" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:25.878477 10728 raft_consensus.cc:2468] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:25.878535 10653 raft_consensus.cc:2468] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:25.880228 10766 leader_election.cc:304] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:25.881419 10852 raft_consensus.cc:2804] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:25.881979 10852 raft_consensus.cc:493] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.882308 10852 raft_consensus.cc:3060] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.889168 10852 raft_consensus.cc:515] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.891607 10852 leader_election.cc:290] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:25.892645 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c33d3d53c04acc99ce779a56a0c953" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:25.893024 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12c33d3d53c04acc99ce779a56a0c953" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:25.893518 10653 raft_consensus.cc:3060] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.893693 10728 raft_consensus.cc:3060] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:25.901234 10653 raft_consensus.cc:2468] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 1.
I20260709 13:05:25.901234 10728 raft_consensus.cc:2468] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 1.
I20260709 13:05:25.902819 10768 leader_election.cc:304] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:25.903694 10852 raft_consensus.cc:2804] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:25.904397 10852 raft_consensus.cc:697] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:25.905247 10852 consensus_queue.cc:237] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:25.913854 10548 catalog_manager.cc:5697] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.962965 10880 consensus_queue.cc:1048] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:25.977475 10880 consensus_queue.cc:1048] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.022809 10802 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.031165 10897 consensus_queue.cc:1048] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.039330 10880 consensus_queue.cc:1048] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.044601 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
mode: GRACEFUL
new_leader_uuid: "85c88fd77ae44877b903aa43df3211a9"
 from {username='slave'} at 127.0.0.1:56336
I20260709 13:05:26.045423 10728 raft_consensus.cc:606] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Received request to transfer leadership to TS 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:26.046669 10897 consensus_queue.cc:1048] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.052937 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
mode: GRACEFUL
new_leader_uuid: "85c88fd77ae44877b903aa43df3211a9"
 from {username='slave'} at 127.0.0.1:56336
I20260709 13:05:26.053624 10728 raft_consensus.cc:606] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Received request to transfer leadership to TS 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:26.059674 10880 consensus_queue.cc:1048] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.076463 10854 raft_consensus.cc:993] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154: : Instructing follower 85c88fd77ae44877b903aa43df3211a9 to start an election
I20260709 13:05:26.077080 10854 raft_consensus.cc:1081] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Signalling peer 85c88fd77ae44877b903aa43df3211a9 to start an election
I20260709 13:05:26.079452 10653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239"
dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
 from {username='slave'} at 127.0.0.1:47232
I20260709 13:05:26.080267 10653 raft_consensus.cc:493] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.080657 10653 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.082737 10881 consensus_queue.cc:1048] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.089814 10653 raft_consensus.cc:515] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.093415 10653 leader_election.cc:290] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 2 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:26.097460 10653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "755d9f68be0647e7bd1a073fae32e644"
dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
mode: GRACEFUL
new_leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:47248
I20260709 13:05:26.098162 10653 raft_consensus.cc:606] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Received request to transfer leadership to TS 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:26.098543 10853 consensus_queue.cc:1048] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.098651 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:26.100677 10803 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.098816 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:26.101850 10728 raft_consensus.cc:3055] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:26.102205 10728 raft_consensus.cc:740] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:26.103139 10728 consensus_queue.cc:260] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.104632 10728 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.107575 10853 raft_consensus.cc:493] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.108227 10853 raft_consensus.cc:515] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.109570 10803 raft_consensus.cc:2468] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 2.
I20260709 13:05:26.111552 10618 leader_election.cc:304] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:26.112246 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:26.115180 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:26.116238 10801 raft_consensus.cc:2393] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85c88fd77ae44877b903aa43df3211a9 in current term 1: Already voted for candidate 00ea50ef9f5143f5a019e96aa66c5154 in this term.
I20260709 13:05:26.115370 10881 raft_consensus.cc:2804] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:26.117065 10881 raft_consensus.cc:697] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:26.112941 10853 leader_election.cc:290] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:26.117957 10881 consensus_queue.cc:237] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.118196 10618 leader_election.cc:304] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9; no voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55
I20260709 13:05:26.120316 10884 raft_consensus.cc:3060] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.113896 10728 raft_consensus.cc:2468] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 2.
I20260709 13:05:26.129613 10653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5"
dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
mode: GRACEFUL
new_leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:47248
I20260709 13:05:26.130393 10653 raft_consensus.cc:606] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Received request to transfer leadership to TS 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:26.129813 10552 catalog_manager.cc:5697] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 1 to 2, leader changed from 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194) to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.130129 10884 raft_consensus.cc:2749] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:26.152513 10802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
mode: GRACEFUL
new_leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:58724
I20260709 13:05:26.153080 10802 raft_consensus.cc:606] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Received request to transfer leadership to TS 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:26.168141 10854 consensus_queue.cc:1048] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.173053 10884 consensus_queue.cc:1048] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.187292 10879 consensus_queue.cc:1048] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.191898 10853 consensus_queue.cc:1048] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.215422 10879 consensus_queue.cc:1048] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.226564 10854 raft_consensus.cc:993] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154: : Instructing follower 85c88fd77ae44877b903aa43df3211a9 to start an election
I20260709 13:05:26.227128 10854 raft_consensus.cc:1081] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Signalling peer 85c88fd77ae44877b903aa43df3211a9 to start an election
I20260709 13:05:26.230504 10897 consensus_queue.cc:1048] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.234567 10654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2"
dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
 from {username='slave'} at 127.0.0.1:47232
I20260709 13:05:26.235188 10654 raft_consensus.cc:493] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.236208 10654 raft_consensus.cc:3060] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.245182 10654 raft_consensus.cc:515] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.248312 10654 leader_election.cc:290] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 2 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:26.248260 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:26.249027 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8cdfc7d09543dc8af92f7813c524f2" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:26.249828 10801 raft_consensus.cc:3060] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.249066 10728 raft_consensus.cc:3055] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:26.256737 10728 raft_consensus.cc:740] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:26.257197 10801 raft_consensus.cc:2468] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 2.
I20260709 13:05:26.257691 10728 consensus_queue.cc:260] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.258524 10618 leader_election.cc:304] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:26.259042 10728 raft_consensus.cc:3060] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.259505 10881 raft_consensus.cc:2804] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:26.260211 10881 raft_consensus.cc:697] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:26.261066 10881 consensus_queue.cc:237] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.265445 10728 raft_consensus.cc:2468] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 2.
I20260709 13:05:26.268739 10548 catalog_manager.cc:5697] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 1 to 2, leader changed from 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194) to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.296950 10881 raft_consensus.cc:493] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.297662 10881 raft_consensus.cc:515] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.299657 10881 leader_election.cc:290] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:26.300812 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:26.300987 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:26.301851 10728 raft_consensus.cc:2393] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85c88fd77ae44877b903aa43df3211a9 in current term 1: Already voted for candidate cbf3815fdab94160b27744ee35801b55 in this term.
I20260709 13:05:26.303292 10617 leader_election.cc:304] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9; no voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55
I20260709 13:05:26.304141 10881 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:26.310166 10881 raft_consensus.cc:2749] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:26.338675 10852 consensus_queue.cc:1048] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.344841 10852 consensus_queue.cc:1048] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.354818 10930 consensus_queue.cc:1048] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:26.371925 10930 consensus_queue.cc:1048] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:26.384203 10883 raft_consensus.cc:993] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55: : Instructing follower 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:26.384807 10932 raft_consensus.cc:1081] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Signalling peer 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:26.387007 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:56314
I20260709 13:05:26.387583 10729 raft_consensus.cc:493] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.387931 10729 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.394553 10729 raft_consensus.cc:515] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.396692 10729 leader_election.cc:290] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:26.398309 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:26.398667 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:26.399180 10801 raft_consensus.cc:3055] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:26.399315 10654 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.399585 10801 raft_consensus.cc:740] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:26.400717 10801 consensus_queue.cc:260] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.402616 10801 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.408942 10654 raft_consensus.cc:2468] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:26.410568 10694 leader_election.cc:304] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:26.410811 10801 raft_consensus.cc:2468] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:26.411482 10879 raft_consensus.cc:2804] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:26.412094 10879 raft_consensus.cc:697] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:26.413000 10879 consensus_queue.cc:237] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.419593 10853 raft_consensus.cc:993] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9: : Instructing follower 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:26.420269 10881 raft_consensus.cc:1081] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Signalling peer 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:26.420490 10549 catalog_manager.cc:5697] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 1 to 2, leader changed from cbf3815fdab94160b27744ee35801b55 (127.0.107.195) to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.421918 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:56320
I20260709 13:05:26.422559 10729 raft_consensus.cc:493] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.422823 10729 raft_consensus.cc:3060] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.428391 10729 raft_consensus.cc:515] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.431519 10729 leader_election.cc:290] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:26.432229 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:26.431938 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67de90e515a540dda2a2d1cf7e3d08b5" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:26.433211 10801 raft_consensus.cc:3060] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.433311 10654 raft_consensus.cc:3055] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:26.433820 10654 raft_consensus.cc:740] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:26.434618 10654 consensus_queue.cc:260] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.435622 10654 raft_consensus.cc:3060] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.439626 10801 raft_consensus.cc:2468] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:26.440970 10654 raft_consensus.cc:2468] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:26.441157 10693 leader_election.cc:304] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:26.442289 10879 raft_consensus.cc:2804] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:26.442716 10879 raft_consensus.cc:697] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:26.443557 10879 consensus_queue.cc:237] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.451135 10549 catalog_manager.cc:5697] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 1 to 2, leader changed from 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193) to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.657348 10729 raft_consensus.cc:1275] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Refusing update from remote peer 85c88fd77ae44877b903aa43df3211a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.659008 10881 consensus_queue.cc:1048] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.669346 10801 raft_consensus.cc:1275] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 85c88fd77ae44877b903aa43df3211a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.671262 10884 consensus_queue.cc:1048] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.672307 10853 raft_consensus.cc:993] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9: : Instructing follower 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:26.672887 10853 raft_consensus.cc:1081] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Signalling peer 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:26.675163 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "755d9f68be0647e7bd1a073fae32e644"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:56320
I20260709 13:05:26.675704 10729 raft_consensus.cc:493] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:26.676126 10729 raft_consensus.cc:3060] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.683465 10729 raft_consensus.cc:515] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.686074 10729 leader_election.cc:290] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:26.686583 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d9f68be0647e7bd1a073fae32e644" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:26.686791 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "755d9f68be0647e7bd1a073fae32e644" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:26.687567 10801 raft_consensus.cc:3060] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.687567 10654 raft_consensus.cc:3055] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:26.688212 10654 raft_consensus.cc:740] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:26.689287 10654 consensus_queue.cc:260] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.690711 10654 raft_consensus.cc:3060] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:26.696719 10801 raft_consensus.cc:2468] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:26.698539 10693 leader_election.cc:304] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:26.698802 10654 raft_consensus.cc:2468] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:26.699550 10879 raft_consensus.cc:2804] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:26.700165 10879 raft_consensus.cc:697] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:26.701001 10879 consensus_queue.cc:237] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:26.708256 10548 catalog_manager.cc:5697] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 1 to 2, leader changed from 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193) to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:26.751490 10801 raft_consensus.cc:1275] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 85c88fd77ae44877b903aa43df3211a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.753436 10884 consensus_queue.cc:1048] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.762799 10729 raft_consensus.cc:1275] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Refusing update from remote peer 85c88fd77ae44877b903aa43df3211a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.765233 10884 consensus_queue.cc:1048] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:26.862100 10654 raft_consensus.cc:1275] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.863765 10879 consensus_queue.cc:1048] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.873207 10801 raft_consensus.cc:1275] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.875077 10854 consensus_queue.cc:1048] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.988297 10654 raft_consensus.cc:1275] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:26.990000 10854 consensus_queue.cc:1048] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:26.999622 10801 raft_consensus.cc:1275] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:27.001796 10879 consensus_queue.cc:1048] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.129395 10801 raft_consensus.cc:1275] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:27.130947 10879 consensus_queue.cc:1048] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.141819 10654 raft_consensus.cc:1275] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:27.144775 10854 consensus_queue.cc:1048] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:29.193096 10549 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44506:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:29.195397 10549 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:05:29.232497 10599 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:29.252548 10636 tablet_service.cc:1511] Processing CreateTablet for tablet b6c0d8f75799427faa37c4ffdcc174ad (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:29.253515 10711 tablet_service.cc:1511] Processing CreateTablet for tablet b6c0d8f75799427faa37c4ffdcc174ad (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:29.254273 10636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c0d8f75799427faa37c4ffdcc174ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.254850 10711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c0d8f75799427faa37c4ffdcc174ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.255389 10637 tablet_service.cc:1511] Processing CreateTablet for tablet ce4b20bf948c4b018cef62addae72b37 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:29.257202 10637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4b20bf948c4b018cef62addae72b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.258327 10788 tablet_service.cc:1511] Processing CreateTablet for tablet b6c0d8f75799427faa37c4ffdcc174ad (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:05:29.259727 10788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6c0d8f75799427faa37c4ffdcc174ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.261788 10642 tablet_service.cc:1511] Processing CreateTablet for tablet 206927a5de3d4b0e9b12c1c65cdd8662 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:29.263309 10642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 206927a5de3d4b0e9b12c1c65cdd8662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.266059 10641 tablet_service.cc:1511] Processing CreateTablet for tablet 40c046c421954ec19cfdd961d5ad66bf (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:29.267573 10641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c046c421954ec19cfdd961d5ad66bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.269685 10793 tablet_service.cc:1511] Processing CreateTablet for tablet ce4b20bf948c4b018cef62addae72b37 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:29.270277 10787 tablet_service.cc:1511] Processing CreateTablet for tablet 206927a5de3d4b0e9b12c1c65cdd8662 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:29.271245 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4b20bf948c4b018cef62addae72b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.269687 10638 tablet_service.cc:1511] Processing CreateTablet for tablet 277854f4b12746f3b886af36ac68d74e (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:29.273468 10638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277854f4b12746f3b886af36ac68d74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.274870 10712 tablet_service.cc:1511] Processing CreateTablet for tablet ce4b20bf948c4b018cef62addae72b37 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:05:29.275313 10717 tablet_service.cc:1511] Processing CreateTablet for tablet 40c046c421954ec19cfdd961d5ad66bf (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:29.276269 10712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4b20bf948c4b018cef62addae72b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.277087 10714 tablet_service.cc:1511] Processing CreateTablet for tablet 206927a5de3d4b0e9b12c1c65cdd8662 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:05:29.277092 10717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c046c421954ec19cfdd961d5ad66bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.275575 10716 tablet_service.cc:1511] Processing CreateTablet for tablet 277854f4b12746f3b886af36ac68d74e (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:29.277289 10792 tablet_service.cc:1511] Processing CreateTablet for tablet 40c046c421954ec19cfdd961d5ad66bf (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:05:29.286686 10640 tablet_service.cc:1511] Processing CreateTablet for tablet a97cdcbf7fdb42f7bc99ff74b33c85c0 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:29.287139 10713 tablet_service.cc:1511] Processing CreateTablet for tablet a97cdcbf7fdb42f7bc99ff74b33c85c0 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:29.279510 10786 tablet_service.cc:1511] Processing CreateTablet for tablet 277854f4b12746f3b886af36ac68d74e (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:05:29.292388 10640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97cdcbf7fdb42f7bc99ff74b33c85c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.292932 10791 tablet_service.cc:1511] Processing CreateTablet for tablet a97cdcbf7fdb42f7bc99ff74b33c85c0 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:05:29.295377 10716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277854f4b12746f3b886af36ac68d74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.300505 10714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 206927a5de3d4b0e9b12c1c65cdd8662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.285108 10787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 206927a5de3d4b0e9b12c1c65cdd8662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.302275 10713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97cdcbf7fdb42f7bc99ff74b33c85c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.302685 10791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a97cdcbf7fdb42f7bc99ff74b33c85c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.305685 10786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 277854f4b12746f3b886af36ac68d74e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.308579 10644 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd359419f234541886b094b38db3816 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:29.309949 10644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd359419f234541886b094b38db3816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.310366 10789 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd359419f234541886b094b38db3816 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:29.311463 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40c046c421954ec19cfdd961d5ad66bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.313540 10715 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd359419f234541886b094b38db3816 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:05:29.314991 10715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd359419f234541886b094b38db3816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.316450 10789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd359419f234541886b094b38db3816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.331550 10718 tablet_service.cc:1511] Processing CreateTablet for tablet 40d7e9668954487890b00a1f823f4b82 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:29.333256 10718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d7e9668954487890b00a1f823f4b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.334204 10790 tablet_service.cc:1511] Processing CreateTablet for tablet 40d7e9668954487890b00a1f823f4b82 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:29.335675 10790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d7e9668954487890b00a1f823f4b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.349185 10719 tablet_service.cc:1511] Processing CreateTablet for tablet b028b012543345579519d6731939c9d9 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:29.350626 10719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028b012543345579519d6731939c9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.353065 10785 tablet_service.cc:1511] Processing CreateTablet for tablet b028b012543345579519d6731939c9d9 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:29.354879 10785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028b012543345579519d6731939c9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.413499 10956 tablet_bootstrap.cc:492] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:29.422295 10636 tablet_service.cc:1511] Processing CreateTablet for tablet b028b012543345579519d6731939c9d9 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:05:29.423926 10636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b028b012543345579519d6731939c9d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.431756 10954 tablet_bootstrap.cc:492] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:29.446791 10644 tablet_service.cc:1511] Processing CreateTablet for tablet 40d7e9668954487890b00a1f823f4b82 (DEFAULT_TABLE table=soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:05:29.448298 10644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40d7e9668954487890b00a1f823f4b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:29.464772 10956 tablet_bootstrap.cc:654] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.470671 10954 tablet_bootstrap.cc:654] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.498528 10957 tablet_bootstrap.cc:492] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:29.499863 10956 tablet_bootstrap.cc:492] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:29.500793 10956 ts_tablet_manager.cc:1403] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.013s
I20260709 13:05:29.503942 10956 raft_consensus.cc:359] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.504910 10956 raft_consensus.cc:385] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.505275 10956 raft_consensus.cc:740] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.506220 10956 consensus_queue.cc:260] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.507565 10954 tablet_bootstrap.cc:492] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:29.508312 10954 ts_tablet_manager.cc:1403] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.000s
I20260709 13:05:29.509055 10956 ts_tablet_manager.cc:1434] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:29.510491 10957 tablet_bootstrap.cc:654] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.510949 10956 tablet_bootstrap.cc:492] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:29.512244 10954 raft_consensus.cc:359] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.513168 10954 raft_consensus.cc:385] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.513470 10954 raft_consensus.cc:740] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.514314 10954 consensus_queue.cc:260] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.520244 10956 tablet_bootstrap.cc:654] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.523169 10957 tablet_bootstrap.cc:492] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:29.523895 10957 ts_tablet_manager.cc:1403] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:05:29.532076 10954 ts_tablet_manager.cc:1434] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:05:29.532699 10956 tablet_bootstrap.cc:492] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:29.533416 10956 ts_tablet_manager.cc:1403] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.016s
I20260709 13:05:29.534171 10957 raft_consensus.cc:359] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.535171 10957 raft_consensus.cc:385] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.535509 10957 raft_consensus.cc:740] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.536899 10954 tablet_bootstrap.cc:492] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:29.536924 10956 raft_consensus.cc:359] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.538080 10956 raft_consensus.cc:385] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.538403 10956 raft_consensus.cc:740] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.539192 10956 consensus_queue.cc:260] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.540309 10957 consensus_queue.cc:260] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.541729 10956 ts_tablet_manager.cc:1434] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:29.542970 10957 ts_tablet_manager.cc:1434] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:05:29.543004 10956 tablet_bootstrap.cc:492] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:29.544554 10957 tablet_bootstrap.cc:492] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:29.555713 10957 tablet_bootstrap.cc:654] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.560128 10956 tablet_bootstrap.cc:654] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.561806 10954 tablet_bootstrap.cc:654] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.571805 10954 tablet_bootstrap.cc:492] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:29.572196 10957 tablet_bootstrap.cc:492] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:29.572454 10954 ts_tablet_manager.cc:1403] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.002s
I20260709 13:05:29.572928 10957 ts_tablet_manager.cc:1403] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.008s
I20260709 13:05:29.573076 10956 tablet_bootstrap.cc:492] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:29.573799 10956 ts_tablet_manager.cc:1403] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.012s
I20260709 13:05:29.575639 10957 raft_consensus.cc:359] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.576450 10957 raft_consensus.cc:385] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.576860 10957 raft_consensus.cc:740] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.576297 10954 raft_consensus.cc:359] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.577324 10954 raft_consensus.cc:385] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.577111 10956 raft_consensus.cc:359] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.577668 10954 raft_consensus.cc:740] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.577998 10956 raft_consensus.cc:385] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.577689 10957 consensus_queue.cc:260] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.578469 10956 raft_consensus.cc:740] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.578831 10954 consensus_queue.cc:260] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.580543 10957 ts_tablet_manager.cc:1434] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:05:29.581617 10957 tablet_bootstrap.cc:492] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:29.581871 10954 ts_tablet_manager.cc:1434] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:05:29.579465 10956 consensus_queue.cc:260] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.582974 10954 tablet_bootstrap.cc:492] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:29.584679 10956 ts_tablet_manager.cc:1434] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:05:29.585870 10956 tablet_bootstrap.cc:492] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:29.592089 10954 tablet_bootstrap.cc:654] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.595784 10957 tablet_bootstrap.cc:654] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.596944 10956 tablet_bootstrap.cc:654] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.612711 10956 tablet_bootstrap.cc:492] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:29.613567 10956 ts_tablet_manager.cc:1403] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.003s
W20260709 13:05:29.615953 10755 tablet.cc:2406] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:29.617398 10956 raft_consensus.cc:359] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.618230 10956 raft_consensus.cc:385] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.618528 10956 raft_consensus.cc:740] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.619343 10956 consensus_queue.cc:260] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.621220 10956 ts_tablet_manager.cc:1434] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:05:29.622902 10956 tablet_bootstrap.cc:492] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:29.624078 10954 tablet_bootstrap.cc:492] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:29.624792 10954 ts_tablet_manager.cc:1403] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.008s
I20260709 13:05:29.625022 10957 tablet_bootstrap.cc:492] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:29.625684 10957 ts_tablet_manager.cc:1403] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.012s
I20260709 13:05:29.628546 10954 raft_consensus.cc:359] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.629397 10954 raft_consensus.cc:385] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.629333 10957 raft_consensus.cc:359] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.630070 10954 raft_consensus.cc:740] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.630323 10956 tablet_bootstrap.cc:654] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.630448 10957 raft_consensus.cc:385] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.632360 10957 raft_consensus.cc:740] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.632203 10954 consensus_queue.cc:260] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.635423 10954 ts_tablet_manager.cc:1434] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:05:29.639716 10954 tablet_bootstrap.cc:492] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:29.636343 10957 consensus_queue.cc:260] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.644479 10957 ts_tablet_manager.cc:1434] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:05:29.649415 10957 tablet_bootstrap.cc:492] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:29.650074 10954 tablet_bootstrap.cc:654] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.652813 10956 tablet_bootstrap.cc:492] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:29.652822 10939 raft_consensus.cc:493] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.654784 10956 ts_tablet_manager.cc:1403] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.007s
I20260709 13:05:29.654632 10939 raft_consensus.cc:515] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.658185 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277854f4b12746f3b886af36ac68d74e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:29.658432 10956 raft_consensus.cc:359] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.659209 10956 raft_consensus.cc:385] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.659343 10957 tablet_bootstrap.cc:654] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.659403 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277854f4b12746f3b886af36ac68d74e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
W20260709 13:05:29.660233 10768 leader_election.cc:343] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.660485 10729 raft_consensus.cc:2468] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:29.659605 10956 raft_consensus.cc:740] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.661875 10956 consensus_queue.cc:260] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.662416 10766 leader_election.cc:304] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:29.664448 10956 ts_tablet_manager.cc:1434] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:05:29.665635 10956 tablet_bootstrap.cc:492] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:29.668509 10939 leader_election.cc:290] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:29.669497 10939 raft_consensus.cc:2804] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.670077 10939 raft_consensus.cc:493] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.671053 10939 raft_consensus.cc:3060] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.673310 10956 tablet_bootstrap.cc:654] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.691679 10854 raft_consensus.cc:493] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.692296 10854 raft_consensus.cc:515] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.693182 10956 tablet_bootstrap.cc:492] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:29.693882 10956 ts_tablet_manager.cc:1403] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 13:05:29.700170 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd359419f234541886b094b38db3816" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:29.701236 10654 raft_consensus.cc:2468] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 0.
I20260709 13:05:29.702843 10694 leader_election.cc:304] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:29.704279 10954 tablet_bootstrap.cc:492] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:29.705890 10854 leader_election.cc:290] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.709509 10854 raft_consensus.cc:2804] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.709764 10954 ts_tablet_manager.cc:1403] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.008s
I20260709 13:05:29.709926 10854 raft_consensus.cc:493] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.707695 10939 raft_consensus.cc:515] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.710863 10956 raft_consensus.cc:359] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.715776 10854 raft_consensus.cc:3060] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.715945 10956 raft_consensus.cc:385] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.716343 10956 raft_consensus.cc:740] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
W20260709 13:05:29.715018 10766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:41601, user_credentials={real_user=slave}} blocked reactor thread for 52742.4us
I20260709 13:05:29.717216 10956 consensus_queue.cc:260] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.717813 10957 tablet_bootstrap.cc:492] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:29.718103 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd359419f234541886b094b38db3816" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:29.718736 10957 ts_tablet_manager.cc:1403] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.070s	user 0.030s	sys 0.032s
W20260709 13:05:29.719671 10693 leader_election.cc:343] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.719758 10956 ts_tablet_manager.cc:1434] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:05:29.721093 10956 tablet_bootstrap.cc:492] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:29.722443 10957 raft_consensus.cc:359] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.722519 10954 raft_consensus.cc:359] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.723893 10957 raft_consensus.cc:385] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.723896 10954 raft_consensus.cc:385] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.724586 10957 raft_consensus.cc:740] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.724603 10954 raft_consensus.cc:740] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.726063 10957 consensus_queue.cc:260] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.726053 10954 consensus_queue.cc:260] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.728705 10957 ts_tablet_manager.cc:1434] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:29.729069 10954 ts_tablet_manager.cc:1434] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:05:29.729827 10957 tablet_bootstrap.cc:492] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:29.730479 10954 tablet_bootstrap.cc:492] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:29.737541 10957 tablet_bootstrap.cc:654] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.737548 10954 tablet_bootstrap.cc:654] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.746023 10939 leader_election.cc:290] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:29.746308 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277854f4b12746f3b886af36ac68d74e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:29.747123 10939 raft_consensus.cc:493] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.747718 10768 leader_election.cc:343] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.748061 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277854f4b12746f3b886af36ac68d74e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:29.748550 10939 raft_consensus.cc:515] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.749188 10729 raft_consensus.cc:3060] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.755386 10955 raft_consensus.cc:493] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.756529 10955 raft_consensus.cc:515] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.759907 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4b20bf948c4b018cef62addae72b37" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:29.760124 10955 leader_election.cc:290] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.760775 10728 raft_consensus.cc:2468] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:29.761065 10956 tablet_bootstrap.cc:654] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.756469 10973 raft_consensus.cc:493] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.762421 10617 leader_election.cc:304] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:29.764555 10973 raft_consensus.cc:515] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.764971 10955 raft_consensus.cc:2804] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.763063 10939 leader_election.cc:290] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:29.765527 10955 raft_consensus.cc:493] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.765513 10854 raft_consensus.cc:515] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.766489 10955 raft_consensus.cc:3060] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.767204 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4b20bf948c4b018cef62addae72b37" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:29.768004 10801 raft_consensus.cc:2468] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:29.768302 10854 leader_election.cc:290] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.769249 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:29.772536 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:29.773608 10728 raft_consensus.cc:2468] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:29.775660 10766 leader_election.cc:304] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:29.777365 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd359419f234541886b094b38db3816" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:29.781002 10939 raft_consensus.cc:2804] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:05:29.779700 10768 leader_election.cc:343] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.783293 10939 raft_consensus.cc:493] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.783916 10939 raft_consensus.cc:3060] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:29.784639 10693 leader_election.cc:343] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.793875 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028b012543345579519d6731939c9d9" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:29.795527 10801 raft_consensus.cc:2468] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 0.
I20260709 13:05:29.798069 10693 leader_election.cc:304] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:29.799437 10854 raft_consensus.cc:2804] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.799341 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd359419f234541886b094b38db3816" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:29.800093 10854 raft_consensus.cc:493] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.800256 10654 raft_consensus.cc:3060] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.800500 10854 raft_consensus.cc:3060] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.807750 10854 raft_consensus.cc:515] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.808014 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028b012543345579519d6731939c9d9" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:29.812101 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028b012543345579519d6731939c9d9" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:29.812259 10854 leader_election.cc:290] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.812734 10801 raft_consensus.cc:3060] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.815269 10654 raft_consensus.cc:2468] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 1.
I20260709 13:05:29.820577 10801 raft_consensus.cc:2468] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 1.
I20260709 13:05:29.808602 10973 leader_election.cc:290] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.832368 10693 leader_election.cc:304] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
W20260709 13:05:29.835062 10694 leader_election.cc:343] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.835956 10957 tablet_bootstrap.cc:492] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:29.836241 10694 leader_election.cc:304] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: cbf3815fdab94160b27744ee35801b55
I20260709 13:05:29.836568 10957 ts_tablet_manager.cc:1403] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.107s	user 0.031s	sys 0.024s
I20260709 13:05:29.839445 10729 raft_consensus.cc:2468] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 1.
I20260709 13:05:29.840929 10766 leader_election.cc:304] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:29.840996 10957 raft_consensus.cc:359] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.841842 10957 raft_consensus.cc:385] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.842134 10957 raft_consensus.cc:740] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.842268 10977 raft_consensus.cc:2804] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.842777 10977 raft_consensus.cc:697] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:29.842913 10957 consensus_queue.cc:260] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.843669 10977 consensus_queue.cc:237] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.840946 10884 raft_consensus.cc:493] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.850798 10973 raft_consensus.cc:2804] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.845862 10954 tablet_bootstrap.cc:492] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:29.856266 10954 ts_tablet_manager.cc:1403] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.126s	user 0.020s	sys 0.001s
I20260709 13:05:29.851733 10955 raft_consensus.cc:515] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.856416 10854 raft_consensus.cc:2804] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.857295 10854 raft_consensus.cc:697] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:29.858147 10957 ts_tablet_manager.cc:1434] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:05:29.858299 10955 leader_election.cc:290] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.859514 10956 tablet_bootstrap.cc:492] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:29.859633 10957 tablet_bootstrap.cc:492] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:29.846594 10884 raft_consensus.cc:515] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.860739 10956 ts_tablet_manager.cc:1403] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.140s	user 0.039s	sys 0.034s
I20260709 13:05:29.861387 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4b20bf948c4b018cef62addae72b37" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:29.862059 10729 raft_consensus.cc:3060] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.863206 10884 leader_election.cc:290] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.864498 10956 raft_consensus.cc:359] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.865907 10956 raft_consensus.cc:385] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.866479 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4b20bf948c4b018cef62addae72b37" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:29.866739 10956 raft_consensus.cc:740] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.867193 10801 raft_consensus.cc:3060] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.867939 10956 consensus_queue.cc:260] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.868917 10954 raft_consensus.cc:359] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.869794 10954 raft_consensus.cc:385] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.870090 10954 raft_consensus.cc:740] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.870857 10954 consensus_queue.cc:260] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.871268 10729 raft_consensus.cc:2468] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
I20260709 13:05:29.852453 10939 raft_consensus.cc:515] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.872674 10617 leader_election.cc:304] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:29.873597 10884 raft_consensus.cc:2804] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.874076 10884 raft_consensus.cc:697] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:29.860236 10973 raft_consensus.cc:697] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:29.871425 10956 ts_tablet_manager.cc:1434] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:05:29.874943 10884 consensus_queue.cc:237] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.875334 10973 consensus_queue.cc:237] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.876097 10956 tablet_bootstrap.cc:492] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:29.877444 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:29.877904 10957 tablet_bootstrap.cc:654] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.878144 10727 raft_consensus.cc:3060] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.880236 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "206927a5de3d4b0e9b12c1c65cdd8662" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:29.858331 10854 consensus_queue.cc:237] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.874173 10939 leader_election.cc:290] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
W20260709 13:05:29.883455 10618 leader_election.cc:343] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.883935 10954 ts_tablet_manager.cc:1434] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:05:29.885223 10954 tablet_bootstrap.cc:492] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:29.882730 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "206927a5de3d4b0e9b12c1c65cdd8662" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:29.894352 10728 raft_consensus.cc:2468] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 0.
I20260709 13:05:29.894372 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028b012543345579519d6731939c9d9" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:29.893349 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:29.897038 10617 leader_election.cc:304] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: cbf3815fdab94160b27744ee35801b55
I20260709 13:05:29.900452 10884 raft_consensus.cc:493] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.901774 10884 raft_consensus.cc:515] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.902168 10980 raft_consensus.cc:2804] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:29.902877 10980 raft_consensus.cc:493] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.903335 10980 raft_consensus.cc:3060] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:29.904285 10884 leader_election.cc:290] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.903632 10551 catalog_manager.cc:5697] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:29.905273 10727 raft_consensus.cc:2468] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 1.
I20260709 13:05:29.907622 10956 tablet_bootstrap.cc:654] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.909492 10766 leader_election.cc:304] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
W20260709 13:05:29.910307 10694 leader_election.cc:343] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:29.910410 10768 leader_election.cc:343] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.912344 10939 raft_consensus.cc:2804] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:29.913318 10939 raft_consensus.cc:697] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:29.914635 10939 consensus_queue.cc:237] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.917255 10957 tablet_bootstrap.cc:492] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:29.918112 10957 ts_tablet_manager.cc:1403] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.003s
I20260709 13:05:29.923379 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
W20260709 13:05:29.925362 10618 leader_election.cc:343] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.935292 10801 raft_consensus.cc:2468] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
I20260709 13:05:29.949242 10979 raft_consensus.cc:493] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.928647 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:29.945781 10954 tablet_bootstrap.cc:654] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:29.946767 10548 catalog_manager.cc:5697] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.962386 10979 raft_consensus.cc:515] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.973912 10979 leader_election.cc:290] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:29.975790 10552 catalog_manager.cc:5697] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:29.971223 10980 raft_consensus.cc:515] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.959909 10957 raft_consensus.cc:359] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.986418 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:29.987308 10654 raft_consensus.cc:2468] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 0.
W20260709 13:05:29.983093 10617 leader_election.cc:343] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.984350 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:29.989645 10617 leader_election.cc:304] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9; no voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55
W20260709 13:05:29.990813 10693 leader_election.cc:343] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:29.991438 10955 raft_consensus.cc:2749] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:29.988811 10957 raft_consensus.cc:385] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:29.995275 10957 raft_consensus.cc:740] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:29.996557 10957 consensus_queue.cc:260] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:29.999771 10694 leader_election.cc:304] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: cbf3815fdab94160b27744ee35801b55
I20260709 13:05:30.000391 10956 tablet_bootstrap.cc:492] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:30.001024 10956 ts_tablet_manager.cc:1403] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.125s	user 0.022s	sys 0.032s
I20260709 13:05:30.000902 10973 raft_consensus.cc:2804] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.001400 10973 raft_consensus.cc:493] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.002079 10973 raft_consensus.cc:3060] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.004407 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "206927a5de3d4b0e9b12c1c65cdd8662" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:30.005522 10728 raft_consensus.cc:3060] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.006325 10956 raft_consensus.cc:359] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.007215 10956 raft_consensus.cc:385] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.007508 10956 raft_consensus.cc:740] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.008380 10956 consensus_queue.cc:260] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.010783 10956 ts_tablet_manager.cc:1434] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:05:30.011300 10957 ts_tablet_manager.cc:1434] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.093s	user 0.012s	sys 0.001s
I20260709 13:05:30.012024 10956 tablet_bootstrap.cc:492] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154: Bootstrap starting.
I20260709 13:05:30.013118 10957 tablet_bootstrap.cc:492] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:30.021260 10956 tablet_bootstrap.cc:654] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.025108 10957 tablet_bootstrap.cc:654] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.026371 10973 raft_consensus.cc:515] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.032680 10954 tablet_bootstrap.cc:492] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:30.033706 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:30.047533 10954 ts_tablet_manager.cc:1403] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.163s	user 0.019s	sys 0.011s
I20260709 13:05:30.048027 10654 raft_consensus.cc:3060] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.034315 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "206927a5de3d4b0e9b12c1c65cdd8662" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:30.035888 10728 raft_consensus.cc:2468] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 1.
W20260709 13:05:30.052513 10618 leader_election.cc:343] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.055832 10617 leader_election.cc:304] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: cbf3815fdab94160b27744ee35801b55
I20260709 13:05:30.056850 10955 raft_consensus.cc:2804] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:30.057350 10955 raft_consensus.cc:697] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:30.058131 10955 consensus_queue.cc:237] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.058507 10957 tablet_bootstrap.cc:492] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:30.059623 10957 ts_tablet_manager.cc:1403] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.007s
I20260709 13:05:30.039870 10973 leader_election.cc:290] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.045827 10956 tablet_bootstrap.cc:492] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154: No bootstrap required, opened a new log
I20260709 13:05:30.061827 10956 ts_tablet_manager.cc:1403] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.011s
I20260709 13:05:30.045738 10551 catalog_manager.cc:5697] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.063385 10654 raft_consensus.cc:2468] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 1.
I20260709 13:05:30.060252 10954 raft_consensus.cc:359] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.064854 10954 raft_consensus.cc:385] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.065001 10694 leader_election.cc:304] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:30.032822 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:30.065330 10954 raft_consensus.cc:740] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.034407 10980 leader_election.cc:290] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.066658 10954 consensus_queue.cc:260] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.067899 10939 raft_consensus.cc:493] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.068516 10939 raft_consensus.cc:515] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.070941 10939 leader_election.cc:290] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:30.071765 10956 raft_consensus.cc:359] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.072566 10956 raft_consensus.cc:385] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.072444 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd359419f234541886b094b38db3816" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:30.073058 10956 raft_consensus.cc:740] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.073501 10654 raft_consensus.cc:2393] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbf3815fdab94160b27744ee35801b55 in current term 1: Already voted for candidate 00ea50ef9f5143f5a019e96aa66c5154 in this term.
I20260709 13:05:30.072976 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd359419f234541886b094b38db3816" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
W20260709 13:05:30.074048 10693 leader_election.cc:343] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.073853 10956 consensus_queue.cc:260] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.075352 10976 raft_consensus.cc:2804] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:30.075820 10954 ts_tablet_manager.cc:1434] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.003s
I20260709 13:05:30.075518 10766 leader_election.cc:304] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbf3815fdab94160b27744ee35801b55; no voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:30.077003 10954 tablet_bootstrap.cc:492] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:30.078667 10939 raft_consensus.cc:3060] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.079607 10957 raft_consensus.cc:359] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.080826 10957 raft_consensus.cc:385] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.081100 10957 raft_consensus.cc:740] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.081948 10957 consensus_queue.cc:260] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.084317 10976 raft_consensus.cc:697] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:30.085901 10956 ts_tablet_manager.cc:1434] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:05:30.085505 10976 consensus_queue.cc:237] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.086957 10954 tablet_bootstrap.cc:654] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.090108 10957 ts_tablet_manager.cc:1434] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 13:05:30.092645 10977 raft_consensus.cc:493] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.093544 10977 raft_consensus.cc:515] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.096957 10977 leader_election.cc:290] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:30.098070 10552 catalog_manager.cc:5697] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.101890 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:30.102897 10728 raft_consensus.cc:2468] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:30.103012 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
W20260709 13:05:30.104822 10768 leader_election.cc:343] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.105746 10766 leader_election.cc:304] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:30.107133 10977 raft_consensus.cc:2804] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.107596 10977 raft_consensus.cc:493] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.107939 10977 raft_consensus.cc:3060] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.092150 10957 tablet_bootstrap.cc:492] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:30.118331 10977 raft_consensus.cc:515] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.119941 10957 tablet_bootstrap.cc:654] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.122108 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:30.119675 10939 raft_consensus.cc:2749] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.124251 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:30.125136 10728 raft_consensus.cc:3060] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:30.126365 10768 leader_election.cc:343] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:30.128840 10548 catalog_manager.cc:5697] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.136546 10977 leader_election.cc:290] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:30.142189 10728 raft_consensus.cc:2468] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 1.
I20260709 13:05:30.147203 10766 leader_election.cc:304] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:30.150316 10977 raft_consensus.cc:2804] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:30.151135 10977 raft_consensus.cc:697] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:30.152505 10977 consensus_queue.cc:237] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.163105 10957 tablet_bootstrap.cc:492] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:30.163852 10957 ts_tablet_manager.cc:1403] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.030s
I20260709 13:05:30.166577 10957 raft_consensus.cc:359] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.167177 10957 raft_consensus.cc:385] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.167407 10957 raft_consensus.cc:740] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.168576 10977 raft_consensus.cc:493] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.169697 10977 raft_consensus.cc:515] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.170962 10957 consensus_queue.cc:260] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.173728 10957 ts_tablet_manager.cc:1434] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:30.173883 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:30.174665 10654 raft_consensus.cc:2468] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:30.174847 10957 tablet_bootstrap.cc:492] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55: Bootstrap starting.
I20260709 13:05:30.176759 10768 leader_election.cc:304] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:30.178058 10939 raft_consensus.cc:2804] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:30.178609 10939 raft_consensus.cc:493] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.179121 10939 raft_consensus.cc:3060] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.181192 10551 catalog_manager.cc:5697] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.183707 10957 tablet_bootstrap.cc:654] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.185843 10552 catalog_manager.cc:5697] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.190197 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:30.191552 10728 raft_consensus.cc:2468] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 0.
I20260709 13:05:30.193846 10977 leader_election.cc:290] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:30.195946 10957 tablet_bootstrap.cc:492] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55: No bootstrap required, opened a new log
I20260709 13:05:30.196619 10957 ts_tablet_manager.cc:1403] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.002s
I20260709 13:05:30.199872 10957 raft_consensus.cc:359] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.200817 10957 raft_consensus.cc:385] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.201228 10957 raft_consensus.cc:740] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.201366 10939 raft_consensus.cc:515] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.202088 10957 consensus_queue.cc:260] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.205152 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:30.205787 10654 raft_consensus.cc:3060] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.212359 10957 ts_tablet_manager.cc:1434] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:30.214197 10654 raft_consensus.cc:2468] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 1.
I20260709 13:05:30.215770 10768 leader_election.cc:304] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:30.216981 10977 raft_consensus.cc:2804] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:30.217659 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:30.217893 10977 raft_consensus.cc:697] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:30.218535 10728 raft_consensus.cc:3060] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.219053 10977 consensus_queue.cc:237] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.230700 10939 leader_election.cc:290] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:30.231639 10954 tablet_bootstrap.cc:492] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:30.230137 10728 raft_consensus.cc:2468] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 1.
I20260709 13:05:30.232549 10954 ts_tablet_manager.cc:1403] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.156s	user 0.060s	sys 0.088s
W20260709 13:05:30.237661 10599 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:30.240721 10954 raft_consensus.cc:359] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.241511 10954 raft_consensus.cc:385] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.241817 10954 raft_consensus.cc:740] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.242682 10954 consensus_queue.cc:260] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.245415 10954 ts_tablet_manager.cc:1434] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:05:30.246560 10954 tablet_bootstrap.cc:492] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:30.245684 10551 catalog_manager.cc:5697] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.255026 10954 tablet_bootstrap.cc:654] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.261165 10954 tablet_bootstrap.cc:492] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:30.261737 10954 ts_tablet_manager.cc:1403] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.001s
I20260709 13:05:30.264487 10954 raft_consensus.cc:359] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.265051 10954 raft_consensus.cc:385] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.265318 10954 raft_consensus.cc:740] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.265949 10954 consensus_queue.cc:260] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.267570 10954 ts_tablet_manager.cc:1434] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:05:30.268923 10954 tablet_bootstrap.cc:492] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9: Bootstrap starting.
I20260709 13:05:30.275107 10955 consensus_queue.cc:1048] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.277091 10954 tablet_bootstrap.cc:654] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:30.289223 10977 consensus_queue.cc:1048] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.295910 10954 tablet_bootstrap.cc:492] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9: No bootstrap required, opened a new log
I20260709 13:05:30.296737 10954 ts_tablet_manager.cc:1403] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.008s
I20260709 13:05:30.301331 10954 raft_consensus.cc:359] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.301729 10884 consensus_queue.cc:1048] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.302770 10954 raft_consensus.cc:385] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:30.303283 10954 raft_consensus.cc:740] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Initialized, Role: FOLLOWER
I20260709 13:05:30.304526 10954 consensus_queue.cc:260] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.307440 10954 ts_tablet_manager.cc:1434] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:05:30.321650 10970 raft_consensus.cc:493] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.322427 10970 raft_consensus.cc:515] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.324831 10970 leader_election.cc:290] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:30.327104 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:30.328368 10654 raft_consensus.cc:2393] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbf3815fdab94160b27744ee35801b55 in current term 1: Already voted for candidate 00ea50ef9f5143f5a019e96aa66c5154 in this term.
I20260709 13:05:30.337611 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:30.338398 10654 raft_consensus.cc:3060] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.339395 10766 leader_election.cc:304] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbf3815fdab94160b27744ee35801b55; no voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:30.340896 10977 raft_consensus.cc:3060] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.346350 10653 raft_consensus.cc:3060] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.353565 10970 raft_consensus.cc:493] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.353848 10977 raft_consensus.cc:2749] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.354336 10970 raft_consensus.cc:515] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.356837 10976 consensus_queue.cc:1048] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.358763 10970 leader_election.cc:290] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:30.358981 10973 consensus_queue.cc:1048] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.359905 10970 consensus_queue.cc:1048] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:30.364980 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "206927a5de3d4b0e9b12c1c65cdd8662" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:30.365896 10728 raft_consensus.cc:2393] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbf3815fdab94160b27744ee35801b55 in current term 1: Already voted for candidate 85c88fd77ae44877b903aa43df3211a9 in this term.
I20260709 13:05:30.369910 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "206927a5de3d4b0e9b12c1c65cdd8662" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85c88fd77ae44877b903aa43df3211a9" is_pre_election: true
I20260709 13:05:30.373726 10768 leader_election.cc:304] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbf3815fdab94160b27744ee35801b55; no voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:30.375756 10970 raft_consensus.cc:3060] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.400561 10970 raft_consensus.cc:2749] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.415704 10884 raft_consensus.cc:493] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.416606 10884 raft_consensus.cc:515] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.420073 10973 consensus_queue.cc:1048] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.421341 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:30.421756 10884 leader_election.cc:290] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.422201 10728 raft_consensus.cc:2393] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85c88fd77ae44877b903aa43df3211a9 in current term 1: Already voted for candidate cbf3815fdab94160b27744ee35801b55 in this term.
I20260709 13:05:30.428839 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:30.431380 10618 leader_election.cc:304] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9; no voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55
I20260709 13:05:30.439939 10980 raft_consensus.cc:3060] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.450239 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
mode: GRACEFUL
new_leader_uuid: "85c88fd77ae44877b903aa43df3211a9"
 from {username='slave'} at 127.0.0.1:56336
I20260709 13:05:30.451375 10728 raft_consensus.cc:606] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Received request to transfer leadership to TS 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:30.473758 10803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
mode: GRACEFUL
new_leader_uuid: "85c88fd77ae44877b903aa43df3211a9"
 from {username='slave'} at 127.0.0.1:58724
I20260709 13:05:30.474619 10803 raft_consensus.cc:606] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Received request to transfer leadership to TS 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:30.476795 10980 raft_consensus.cc:2749] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.485229 11014 consensus_queue.cc:1048] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.485241 10802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "277854f4b12746f3b886af36ac68d74e"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
mode: GRACEFUL
new_leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:58724
I20260709 13:05:30.486850 10802 raft_consensus.cc:606] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Received request to transfer leadership to TS 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:30.506773 10802 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
mode: GRACEFUL
new_leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:58724
I20260709 13:05:30.507613 10802 raft_consensus.cc:606] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Received request to transfer leadership to TS 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:30.520560 10803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
mode: GRACEFUL
new_leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:58724
I20260709 13:05:30.521196 10803 raft_consensus.cc:606] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Received request to transfer leadership to TS 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:30.528458 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b028b012543345579519d6731939c9d9"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
mode: GRACEFUL
new_leader_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:56336
I20260709 13:05:30.528776 10884 raft_consensus.cc:493] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.529268 10728 raft_consensus.cc:606] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Received request to transfer leadership to TS cbf3815fdab94160b27744ee35801b55
I20260709 13:05:30.529767 10884 raft_consensus.cc:515] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.532333 10884 leader_election.cc:290] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.533427 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154" is_pre_election: true
I20260709 13:05:30.534226 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf3815fdab94160b27744ee35801b55" is_pre_election: true
I20260709 13:05:30.534443 10728 raft_consensus.cc:2393] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 85c88fd77ae44877b903aa43df3211a9 in current term 1: Already voted for candidate cbf3815fdab94160b27744ee35801b55 in this term.
I20260709 13:05:30.535882 10617 leader_election.cc:304] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9; no voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55
I20260709 13:05:30.536868 10884 raft_consensus.cc:3060] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:30.543195 10884 raft_consensus.cc:2749] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:30.546919 10977 consensus_queue.cc:1048] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.548074 10970 consensus_queue.cc:1048] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.560381 10939 raft_consensus.cc:993] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55: : Instructing follower 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:30.562625 10970 raft_consensus.cc:1081] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Signalling peer 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:30.565186 10728 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:56314
I20260709 13:05:30.565889 10728 raft_consensus.cc:493] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.566303 10728 raft_consensus.cc:3060] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.574708 10728 raft_consensus.cc:515] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.576903 10884 consensus_queue.cc:1048] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.578490 10728 leader_election.cc:290] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.579795 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:30.580207 10652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a97cdcbf7fdb42f7bc99ff74b33c85c0" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:30.581146 10652 raft_consensus.cc:3060] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.580575 10803 raft_consensus.cc:3055] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.582604 10803 raft_consensus.cc:740] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:30.583559 10803 consensus_queue.cc:260] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.584964 10803 raft_consensus.cc:3060] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.593885 10652 raft_consensus.cc:2468] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:30.595821 10694 leader_election.cc:304] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:30.597257 10979 raft_consensus.cc:2804] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.597829 10979 raft_consensus.cc:697] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:30.593885 10803 raft_consensus.cc:2468] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:30.598747 10979 consensus_queue.cc:237] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.601565 10980 consensus_queue.cc:1048] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.610096 10979 consensus_queue.cc:1048] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.613209 10548 catalog_manager.cc:5697] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 1 to 2, leader changed from cbf3815fdab94160b27744ee35801b55 (127.0.107.195) to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.620155 10973 raft_consensus.cc:993] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154: : Instructing follower 85c88fd77ae44877b903aa43df3211a9 to start an election
I20260709 13:05:30.621320 10973 raft_consensus.cc:1081] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Signalling peer 85c88fd77ae44877b903aa43df3211a9 to start an election
I20260709 13:05:30.624660 10654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad"
dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
 from {username='slave'} at 127.0.0.1:47232
I20260709 13:05:30.626255 10654 raft_consensus.cc:493] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.626662 10654 raft_consensus.cc:3060] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.627708 10973 consensus_queue.cc:1048] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.632789 10654 raft_consensus.cc:515] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.642407 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:30.643149 10728 raft_consensus.cc:3055] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.643435 10728 raft_consensus.cc:740] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:30.644094 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6c0d8f75799427faa37c4ffdcc174ad" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:30.644431 10728 consensus_queue.cc:260] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.644937 10803 raft_consensus.cc:3060] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.645666 10728 raft_consensus.cc:3060] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.643947 10654 leader_election.cc:290] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 2 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.654660 10803 raft_consensus.cc:2468] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 2.
I20260709 13:05:30.655314 10728 raft_consensus.cc:2468] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 2.
I20260709 13:05:30.656678 10618 leader_election.cc:304] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:30.657665 10980 raft_consensus.cc:2804] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.658205 10980 raft_consensus.cc:697] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:30.659314 10980 consensus_queue.cc:237] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.668392 10552 catalog_manager.cc:5697] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 1 to 2, leader changed from 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194) to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.668828 10977 consensus_queue.cc:1048] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.677434 10939 raft_consensus.cc:993] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55: : Instructing follower 85c88fd77ae44877b903aa43df3211a9 to start an election
I20260709 13:05:30.678006 10970 raft_consensus.cc:1081] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Signalling peer 85c88fd77ae44877b903aa43df3211a9 to start an election
I20260709 13:05:30.682569 10654 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf"
dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
 from {username='slave'} at 127.0.0.1:47228
I20260709 13:05:30.683228 10654 raft_consensus.cc:493] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.683751 10654 raft_consensus.cc:3060] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.684319 10977 consensus_queue.cc:1048] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.689769 10970 consensus_queue.cc:1048] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.691555 10654 raft_consensus.cc:515] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.694154 10654 leader_election.cc:290] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 2 election: Requested vote from peers 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.694661 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:30.696092 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40c046c421954ec19cfdd961d5ad66bf" candidate_uuid: "85c88fd77ae44877b903aa43df3211a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:30.696892 10803 raft_consensus.cc:3055] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.697402 10803 raft_consensus.cc:740] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:30.698421 10803 consensus_queue.cc:260] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.699592 10803 raft_consensus.cc:3060] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.707746 10939 raft_consensus.cc:993] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55: : Instructing follower 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:30.708312 10939 raft_consensus.cc:1081] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Signalling peer 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:30.710260 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:56314
I20260709 13:05:30.710862 10729 raft_consensus.cc:493] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.711242 10729 raft_consensus.cc:3060] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.712872 10803 raft_consensus.cc:2468] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85c88fd77ae44877b903aa43df3211a9 in term 2.
I20260709 13:05:30.714354 10618 leader_election.cc:304] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:30.714437 10977 consensus_queue.cc:1048] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:30.715677 10955 raft_consensus.cc:2804] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.716248 10955 raft_consensus.cc:697] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Becoming Leader. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:30.717094 10955 consensus_queue.cc:237] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.730326 10551 catalog_manager.cc:5697] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 reported cstate change: term changed from 1 to 2, leader changed from cbf3815fdab94160b27744ee35801b55 (127.0.107.195) to 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "85c88fd77ae44877b903aa43df3211a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.732544 10729 raft_consensus.cc:515] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.736366 10727 raft_consensus.cc:1240] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Rejecting Update request from peer cbf3815fdab94160b27744ee35801b55 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:30.743809 10729 leader_election.cc:290] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.743852 10652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:30.742468 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40d7e9668954487890b00a1f823f4b82" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:30.742956 10977 consensus_queue.cc:1059] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:30.746351 10803 raft_consensus.cc:3055] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.746737 10803 raft_consensus.cc:740] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:30.747789 10803 consensus_queue.cc:260] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.749225 10803 raft_consensus.cc:3060] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.757766 10803 raft_consensus.cc:2468] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
W20260709 13:05:30.758263 10939 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:05:30.759092 10693 leader_election.cc:304] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 85c88fd77ae44877b903aa43df3211a9
I20260709 13:05:30.760244 10979 raft_consensus.cc:2804] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.760736 10979 raft_consensus.cc:697] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:30.761548 10979 consensus_queue.cc:237] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.768797 10548 catalog_manager.cc:5697] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 1 to 2, leader changed from cbf3815fdab94160b27744ee35801b55 (127.0.107.195) to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:30.791494 10973 raft_consensus.cc:993] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154: : Instructing follower cbf3815fdab94160b27744ee35801b55 to start an election
I20260709 13:05:30.792202 10979 raft_consensus.cc:1081] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Signalling peer cbf3815fdab94160b27744ee35801b55 to start an election
I20260709 13:05:30.794028 10803 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b028b012543345579519d6731939c9d9"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:58710
I20260709 13:05:30.794709 10803 raft_consensus.cc:493] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.795058 10803 raft_consensus.cc:3060] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.802320 10803 raft_consensus.cc:515] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.805030 10803 leader_election.cc:290] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 2 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:30.806245 10727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028b012543345579519d6731939c9d9" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:30.806497 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b028b012543345579519d6731939c9d9" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:30.807061 10727 raft_consensus.cc:3055] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.807410 10727 raft_consensus.cc:740] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:30.807480 10654 raft_consensus.cc:3060] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.808310 10727 consensus_queue.cc:260] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.809823 10727 raft_consensus.cc:3060] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.815315 10654 raft_consensus.cc:2468] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 2.
I20260709 13:05:30.817159 10768 leader_election.cc:304] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:30.817935 10727 raft_consensus.cc:2468] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 2.
I20260709 13:05:30.818264 10939 raft_consensus.cc:2804] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.819012 10939 raft_consensus.cc:697] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 2 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:30.820988 10939 consensus_queue.cc:237] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.837990 10551 catalog_manager.cc:5697] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 1 to 2, leader changed from 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194) to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:30.897423 10970 raft_consensus.cc:993] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55: : Instructing follower 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:30.898149 10939 raft_consensus.cc:1081] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Signalling peer 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:30.901031 10727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "277854f4b12746f3b886af36ac68d74e"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:56314
I20260709 13:05:30.901958 10727 raft_consensus.cc:493] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:30.902616 10727 raft_consensus.cc:3060] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.914562 10727 raft_consensus.cc:515] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.917043 10727 leader_election.cc:290] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:30.918859 10803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277854f4b12746f3b886af36ac68d74e" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:30.918708 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "277854f4b12746f3b886af36ac68d74e" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:30.920301 10654 raft_consensus.cc:3060] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.921401 10803 raft_consensus.cc:3055] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:30.922022 10803 raft_consensus.cc:740] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:30.923000 10803 consensus_queue.cc:260] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.925285 10803 raft_consensus.cc:3060] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.927604 10654 raft_consensus.cc:2468] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:30.929368 10694 leader_election.cc:304] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, 85c88fd77ae44877b903aa43df3211a9; no voters: 
I20260709 13:05:30.930608 10979 raft_consensus.cc:2804] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:30.931221 10979 raft_consensus.cc:697] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:30.932086 10979 consensus_queue.cc:237] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:30.938023 10803 raft_consensus.cc:2468] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 2.
I20260709 13:05:30.947201 10551 catalog_manager.cc:5697] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 1 to 2, leader changed from cbf3815fdab94160b27744ee35801b55 (127.0.107.195) to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.069738 10654 raft_consensus.cc:1275] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.072109 10973 consensus_queue.cc:1048] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.086066 10803 raft_consensus.cc:1275] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.089952 10976 consensus_queue.cc:1048] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.123540 10803 raft_consensus.cc:1275] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 85c88fd77ae44877b903aa43df3211a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.130358 10980 consensus_queue.cc:1048] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.149511 10727 raft_consensus.cc:3060] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.169620 10727 raft_consensus.cc:1275] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Refusing update from remote peer 85c88fd77ae44877b903aa43df3211a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.172184 10980 consensus_queue.cc:1048] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.194274 10803 raft_consensus.cc:1275] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.196151 10979 consensus_queue.cc:1048] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.212352 10654 raft_consensus.cc:3060] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.224233 10654 raft_consensus.cc:1275] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.227464 10976 consensus_queue.cc:1048] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.271414 10727 raft_consensus.cc:1275] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Refusing update from remote peer 85c88fd77ae44877b903aa43df3211a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.273875 10980 consensus_queue.cc:1048] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.277920 10803 raft_consensus.cc:1275] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 85c88fd77ae44877b903aa43df3211a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.280493 10955 consensus_queue.cc:1048] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.425335 10727 raft_consensus.cc:1275] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Refusing update from remote peer cbf3815fdab94160b27744ee35801b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.427994 10970 consensus_queue.cc:1048] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.440202 10654 raft_consensus.cc:1275] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Refusing update from remote peer cbf3815fdab94160b27744ee35801b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.444077 10970 consensus_queue.cc:1048] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.474720 10654 raft_consensus.cc:1275] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.476310 10976 consensus_queue.cc:1048] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.481719 10803 raft_consensus.cc:1275] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:31.483511 10976 consensus_queue.cc:1048] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:33.534590 10552 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44506:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:05:33.563606 10552 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44506:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:05:33.596668   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:33.863320 10650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239"
dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
mode: GRACEFUL
new_leader_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:46796
W20260709 13:05:33.870505 11063 log.cc:927] Time spent T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: Append to log took a long time: real 0.091s	user 0.005s	sys 0.000s
I20260709 13:05:33.889745 10650 raft_consensus.cc:606] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Received request to transfer leadership to TS cbf3815fdab94160b27744ee35801b55
I20260709 13:05:33.908692 11080 tablet.cc:1724] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:05:33.914311 11072 log.cc:927] Time spent T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154: Append to log took a long time: real 0.098s	user 0.002s	sys 0.000s
W20260709 13:05:33.989212 11074 log.cc:927] Time spent T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55: Append to log took a long time: real 0.162s	user 0.003s	sys 0.001s
W20260709 13:05:33.992302 11073 log.cc:927] Time spent T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55: Append to log took a long time: real 0.094s	user 0.003s	sys 0.000s
W20260709 13:05:33.989833 11066 log.cc:927] Time spent T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55: Append to log took a long time: real 0.207s	user 0.009s	sys 0.000s
I20260709 13:05:34.067709 11057 raft_consensus.cc:993] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9: : Instructing follower cbf3815fdab94160b27744ee35801b55 to start an election
I20260709 13:05:34.067203 11096 tablet.cc:1724] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.076108 11071 raft_consensus.cc:1081] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Signalling peer cbf3815fdab94160b27744ee35801b55 to start an election
W20260709 13:05:34.106187 10694 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:42049, user_credentials={real_user=slave}} blocked reactor thread for 53177.8us
I20260709 13:05:34.050043 11095 tablet.cc:1724] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.142316 10798 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:58702
I20260709 13:05:34.143517 10798 raft_consensus.cc:493] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:34.142539 11099 tablet.cc:1724] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.144083 10798 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.147745 11097 tablet.cc:1724] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.056357 11090 tablet.cc:1724] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.181375 10727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
mode: GRACEFUL
new_leader_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:49862
I20260709 13:05:34.188962 10727 raft_consensus.cc:606] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Received request to transfer leadership to TS cbf3815fdab94160b27744ee35801b55
I20260709 13:05:34.197659   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 13:05:34.195004 10693 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:40135, user_credentials={real_user=slave}} blocked reactor thread for 53467.4us
I20260709 13:05:34.199189   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:34.178969 11105 tablet.cc:1724] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.169009 11107 tablet.cc:1724] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.173576 11104 tablet.cc:1724] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.172329 11103 tablet.cc:1724] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.225142 11108 tablet.cc:1724] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.229174 11109 tablet.cc:1724] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.258674 10798 raft_consensus.cc:515] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:34.262830 11109 tablet.cc:1724] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.275309 10654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:34.276086 10654 raft_consensus.cc:3055] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.276407 10654 raft_consensus.cc:740] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 85c88fd77ae44877b903aa43df3211a9, State: Running, Role: LEADER
I20260709 13:05:34.277328 10654 consensus_queue.cc:260] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:34.278503 10654 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.283386 11107 tablet.cc:1724] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.285261 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:34.286067 10728 raft_consensus.cc:3060] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.286698 11080 tablet.cc:1724] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.291199 10798 leader_election.cc:290] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 3 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:34.295851 10654 raft_consensus.cc:2468] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 3.
I20260709 13:05:34.308598 10728 raft_consensus.cc:2468] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 3.
I20260709 13:05:34.310643 10766 leader_election.cc:304] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:34.312927 11078 raft_consensus.cc:2804] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:34.313587 11078 raft_consensus.cc:697] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 3 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:34.314797 11078 consensus_queue.cc:237] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:34.318459 11109 tablet.cc:1724] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.330853 11096 tablet.cc:1724] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.400347 11103 tablet.cc:1724] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.407531 11108 tablet.cc:1724] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.415015 11107 tablet.cc:1724] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.422425 11096 tablet.cc:1724] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.439231 11104 tablet.cc:1724] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.425611 11097 tablet.cc:1724] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.444638 11095 tablet.cc:1724] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.405972 11099 tablet.cc:1724] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.459246 11090 tablet.cc:1724] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:34.460310 11108 tablet.cc:1724] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:05:35.184960 10654 raft_consensus.cc:1275] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Refusing update from remote peer cbf3815fdab94160b27744ee35801b55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:35.199458 10766 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:41601, user_credentials={real_user=slave}} blocked reactor thread for 61312us
I20260709 13:05:35.213855 11120 consensus_queue.cc:1048] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:35.219515 10729 raft_consensus.cc:1275] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Refusing update from remote peer cbf3815fdab94160b27744ee35801b55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.224606 11123 consensus_queue.cc:1048] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:05:35.242457 11114 raft_consensus.cc:993] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154: : Instructing follower cbf3815fdab94160b27744ee35801b55 to start an election
I20260709 13:05:35.243242 11114 raft_consensus.cc:1081] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Signalling peer cbf3815fdab94160b27744ee35801b55 to start an election
I20260709 13:05:35.251163 10798 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:58710
I20260709 13:05:35.251787 10798 raft_consensus.cc:493] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:35.252193 10798 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.257637 11097 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:56300 (request call id 18) took 1673 ms. Trace:
I20260709 13:05:35.258462 11097 rpcz_store.cc:276] 0709 13:05:33.584532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.585703 (+  1171us) service_pool.cc:224] Handling call
0709 13:05:35.257550 (+1671847us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:33.613060 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 13:05:33.645067 (+ 32007us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 13:05:33.648382 (+  3315us) alter_schema_op.cc:66] Acquired schema lock
0709 13:05:33.664555 (+ 16173us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 13:05:33.664671 (+   116us) alter_schema_op.cc:128] START. Timestamp: 1783602333664611
0709 13:05:33.664707 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:05:33.683947 (+ 19240us) log.cc:844] Serialized 204 byte log entry
0709 13:05:33.866304 (+182357us) spinlock_profiling.cc:243] Waited 8.51 ms on lock 0x7b4400022b4c. stack: 00007fd02b9e9343 00007fd02b9e9240 00007fd02b3781d4 00007fd0350b6304 00007fd0350b6299 00007fd02b8a3db1 00007fd02b941c85 00007fd02b9426a2 00007fd02e6b41db 00007fd02e6afaaf 00007fd02e6a386e 00007fd02e6a2bb6 00007fd02e6a27d8 00007fd02e6ac221 00007fd02e6ac1d9 00007fd02e6ac169
0709 13:05:34.146344 (+280040us) op_driver.cc:464] REPLICATION: finished
0709 13:05:34.404424 (+258080us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 13:05:34.447688 (+ 43264us) log.cc:844] Serialized 5 byte log entry
0709 13:05:35.248947 (+801259us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:35.249817 (+   870us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.257378 (+  7561us) alter_schema_op.cc:73] Released schema lock
0709 13:05:35.257409 (+    31us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":255584,"prepare.queue_time_us":24267,"prepare.run_cpu_time_us":59454,"prepare.run_wall_time_us":175780,"raft.queue_time_us":735,"raft.run_cpu_time_us":1160,"raft.run_wall_time_us":1161,"replication_time_us":481443,"spinlock_wait_cycles":19565312,"thread_start_us":100742,"threads_started":2,"wal-append.queue_time_us":87953}]]}
I20260709 13:05:35.263890 10798 raft_consensus.cc:515] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:35.271055 10798 leader_election.cc:290] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 3 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:35.273500 10729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:35.274184 10729 raft_consensus.cc:3055] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:35.274478 10729 raft_consensus.cc:740] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:35.275735 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f588edef19fb4dc8a37155df01a6015e" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:35.276718 10653 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.280580 10729 consensus_queue.cc:260] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:35.287005 10729 raft_consensus.cc:3060] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.293473 10653 raft_consensus.cc:2468] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 3.
I20260709 13:05:35.298388 10729 raft_consensus.cc:2468] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 3.
I20260709 13:05:35.301254 10768 leader_election.cc:304] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:35.302559 11078 raft_consensus.cc:2804] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:35.303331 11078 raft_consensus.cc:697] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 3 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:35.304512 11078 consensus_queue.cc:237] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:35.323194   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:35.345829 10548 catalog_manager.cc:5697] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 2 to 3, leader changed from 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193) to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } } }
I20260709 13:05:35.347630 10728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
mode: GRACEFUL
new_leader_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:49862
I20260709 13:05:35.348461 10728 raft_consensus.cc:606] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Received request to transfer leadership to TS cbf3815fdab94160b27744ee35801b55
I20260709 13:05:35.351598 10652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b96de0a197bf4f04b94aaa0f84d4c239"
dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
mode: GRACEFUL
new_leader_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:46796
I20260709 13:05:35.352363 10652 raft_consensus.cc:606] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Received request to transfer leadership to TS cbf3815fdab94160b27744ee35801b55
I20260709 13:05:35.352761 10652 raft_consensus.cc:614] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:35.354233   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:35.354869   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:35.359331 10551 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d: soft_deleted_table [id=15253a9d1a1a4873bf7b470448e4b220] alter complete (version 1)
I20260709 13:05:35.373569 10548 catalog_manager.cc:5697] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 2 to 3, leader changed from 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194) to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.638077 11111 raft_consensus.cc:993] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154: : Instructing follower cbf3815fdab94160b27744ee35801b55 to start an election
I20260709 13:05:35.638840 10976 raft_consensus.cc:1081] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Signalling peer cbf3815fdab94160b27744ee35801b55 to start an election
I20260709 13:05:35.640590 10796 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
 from {username='slave'} at 127.0.0.1:58710
I20260709 13:05:35.641136 10796 raft_consensus.cc:493] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:35.641446 10796 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.647502 10796 raft_consensus.cc:515] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:35.649573 10796 leader_election.cc:290] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 2 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601)
I20260709 13:05:35.650466 10652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:35.650646 10728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "cbf3815fdab94160b27744ee35801b55" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
I20260709 13:05:35.651322 10652 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.651547 10728 raft_consensus.cc:3055] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:35.652179 10728 raft_consensus.cc:740] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:35.653103 10728 consensus_queue.cc:260] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:35.654314 10728 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:35.659356 10652 raft_consensus.cc:2468] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 2.
I20260709 13:05:35.660558 10768 leader_election.cc:304] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85c88fd77ae44877b903aa43df3211a9, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:35.661315 11123 raft_consensus.cc:2804] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:35.661738 11123 raft_consensus.cc:697] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 2 LEADER]: Becoming Leader. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:35.662528 11123 consensus_queue.cc:237] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:35.662839 10728 raft_consensus.cc:2468] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf3815fdab94160b27744ee35801b55 in term 2.
I20260709 13:05:35.671226 10552 catalog_manager.cc:5697] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 reported cstate change: term changed from 1 to 2, leader changed from 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194) to cbf3815fdab94160b27744ee35801b55 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "cbf3815fdab94160b27744ee35801b55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.711472 10653 raft_consensus.cc:1275] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Refusing update from remote peer cbf3815fdab94160b27744ee35801b55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.712977 11123 consensus_queue.cc:1048] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.726478 10728 raft_consensus.cc:1275] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Refusing update from remote peer cbf3815fdab94160b27744ee35801b55: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.727805 11078 consensus_queue.cc:1048] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:35.827104 10583 debug-util.cc:398] Leaking SignalData structure 0x7b080001f8a0 after lost signal to thread 434
W20260709 13:05:35.828224 10583 debug-util.cc:398] Leaking SignalData structure 0x7b08003e3820 after lost signal to thread 10586
W20260709 13:05:35.829635 10583 debug-util.cc:398] Leaking SignalData structure 0x7b080004cf20 after lost signal to thread 10678
W20260709 13:05:35.830724 10583 debug-util.cc:398] Leaking SignalData structure 0x7b0800274200 after lost signal to thread 10753
W20260709 13:05:35.831867 10583 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcb40 after lost signal to thread 10827
W20260709 13:05:35.832316 10583 debug-util.cc:398] Leaking SignalData structure 0x7b0800083580 after lost signal to thread 11041
W20260709 13:05:35.832628 10583 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc340 after lost signal to thread 11065
I20260709 13:05:36.148298 10653 raft_consensus.cc:1275] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Refusing update from remote peer cbf3815fdab94160b27744ee35801b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:36.150204 11078 consensus_queue.cc:1048] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:36.164393 10728 raft_consensus.cc:1275] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Refusing update from remote peer cbf3815fdab94160b27744ee35801b55: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:36.167726 11078 consensus_queue.cc:1048] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:36.396664   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:36.418919 10796 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020"
dest_uuid: "cbf3815fdab94160b27744ee35801b55"
mode: GRACEFUL
new_leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:41980
I20260709 13:05:36.419617 10796 raft_consensus.cc:606] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 2 LEADER]: Received request to transfer leadership to TS 00ea50ef9f5143f5a019e96aa66c5154
I20260709 13:05:36.421363   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:05:36.421988   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:36.600411 11120 raft_consensus.cc:993] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55: : Instructing follower 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:36.601083 11120 raft_consensus.cc:1081] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 2 LEADER]: Signalling peer 00ea50ef9f5143f5a019e96aa66c5154 to start an election
I20260709 13:05:36.603024 10729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020"
dest_uuid: "00ea50ef9f5143f5a019e96aa66c5154"
 from {username='slave'} at 127.0.0.1:56314
I20260709 13:05:36.603627 10729 raft_consensus.cc:493] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:36.604017 10729 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.611363 10729 raft_consensus.cc:515] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:36.613206 10729 leader_election.cc:290] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 3 election: Requested vote from peers 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049), cbf3815fdab94160b27744ee35801b55 (127.0.107.195:40135)
I20260709 13:05:36.614338 10653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "85c88fd77ae44877b903aa43df3211a9"
I20260709 13:05:36.614785 10796 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ea8c96386a441db4e7f2525862c020" candidate_uuid: "00ea50ef9f5143f5a019e96aa66c5154" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbf3815fdab94160b27744ee35801b55"
I20260709 13:05:36.615260 10653 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.615536 10796 raft_consensus.cc:3055] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:36.615944 10796 raft_consensus.cc:740] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbf3815fdab94160b27744ee35801b55, State: Running, Role: LEADER
I20260709 13:05:36.616793 10796 consensus_queue.cc:260] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:36.618016 10796 raft_consensus.cc:3060] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.624312 10796 raft_consensus.cc:2468] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 3.
I20260709 13:05:36.625106 10653 raft_consensus.cc:2468] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00ea50ef9f5143f5a019e96aa66c5154 in term 3.
I20260709 13:05:36.625886 10693 leader_election.cc:304] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00ea50ef9f5143f5a019e96aa66c5154, cbf3815fdab94160b27744ee35801b55; no voters: 
I20260709 13:05:36.627729 11141 raft_consensus.cc:2804] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:36.628365 11141 raft_consensus.cc:697] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 LEADER]: Becoming Leader. State: Replica: 00ea50ef9f5143f5a019e96aa66c5154, State: Running, Role: LEADER
I20260709 13:05:36.629272 11141 consensus_queue.cc:237] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } }
I20260709 13:05:36.637101 10548 catalog_manager.cc:5697] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 reported cstate change: term changed from 2 to 3, leader changed from cbf3815fdab94160b27744ee35801b55 (127.0.107.195) to 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "00ea50ef9f5143f5a019e96aa66c5154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00ea50ef9f5143f5a019e96aa66c5154" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 41601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.090454 10796 raft_consensus.cc:1275] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.092737 11141 consensus_queue.cc:1048] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf3815fdab94160b27744ee35801b55" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 40135 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.111907 10652 raft_consensus.cc:1275] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Refusing update from remote peer 00ea50ef9f5143f5a019e96aa66c5154: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:37.119432 11149 consensus_queue.cc:1048] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85c88fd77ae44877b903aa43df3211a9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 42049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:37.508517   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:05:37.524830 10694 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260709 13:05:37.543834 10694 consensus_peers.cc:597] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:37.545029 10694 consensus_peers.cc:597] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:37.546065 10768 consensus_peers.cc:597] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:37.549263 10694 consensus_peers.cc:597] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.580021   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:37.581122   431 tablet_replica.cc:333] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.582145   431 raft_consensus.cc:2243] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.582854   431 raft_consensus.cc:2272] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.585831   431 tablet_replica.cc:333] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.586715   431 raft_consensus.cc:2243] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.587281   431 raft_consensus.cc:2272] T 277854f4b12746f3b886af36ac68d74e P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.590065   431 tablet_replica.cc:333] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.590801   431 raft_consensus.cc:2243] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.591302   431 raft_consensus.cc:2272] T b028b012543345579519d6731939c9d9 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.594038   431 tablet_replica.cc:333] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.594758   431 raft_consensus.cc:2243] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.595719   431 raft_consensus.cc:2272] T 40c046c421954ec19cfdd961d5ad66bf P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.598322   431 tablet_replica.cc:333] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.598974   431 raft_consensus.cc:2243] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.599936   431 raft_consensus.cc:2272] T 206927a5de3d4b0e9b12c1c65cdd8662 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.602648   431 tablet_replica.cc:333] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.603428   431 raft_consensus.cc:2243] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.604466   431 raft_consensus.cc:2272] T ce4b20bf948c4b018cef62addae72b37 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.607159   431 tablet_replica.cc:333] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.607923   431 raft_consensus.cc:2243] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.609045   431 raft_consensus.cc:2272] T b6c0d8f75799427faa37c4ffdcc174ad P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.612731   431 tablet_replica.cc:333] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.613430   431 raft_consensus.cc:2243] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.614056   431 raft_consensus.cc:2272] T 67de90e515a540dda2a2d1cf7e3d08b5 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.617002   431 tablet_replica.cc:333] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.617828   431 raft_consensus.cc:2243] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.618546   431 raft_consensus.cc:2272] T 12c33d3d53c04acc99ce779a56a0c953 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.622470   431 tablet_replica.cc:333] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.623471   431 raft_consensus.cc:2243] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.624168   431 raft_consensus.cc:2272] T f588edef19fb4dc8a37155df01a6015e P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.627625   431 tablet_replica.cc:333] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.628353   431 raft_consensus.cc:2243] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.629398   431 raft_consensus.cc:2272] T ef8cdfc7d09543dc8af92f7813c524f2 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.632548   431 tablet_replica.cc:333] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.633205   431 raft_consensus.cc:2243] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.634146   431 raft_consensus.cc:2272] T a0fa882d5b5f496e9b9ede0825792d89 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.636847   431 tablet_replica.cc:333] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.637741   431 raft_consensus.cc:2243] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.638324   431 raft_consensus.cc:2272] T 40d7e9668954487890b00a1f823f4b82 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.641187   431 tablet_replica.cc:333] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.641898   431 raft_consensus.cc:2243] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.643023   431 raft_consensus.cc:2272] T e8b4bf606302404890fd04b953fdb519 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.646500   431 tablet_replica.cc:333] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.647392   431 raft_consensus.cc:2243] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.648077   431 raft_consensus.cc:2272] T 0fd359419f234541886b094b38db3816 P 85c88fd77ae44877b903aa43df3211a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.652081   431 tablet_replica.cc:333] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.653228   431 raft_consensus.cc:2243] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.653976   431 raft_consensus.cc:2272] T 755d9f68be0647e7bd1a073fae32e644 P 85c88fd77ae44877b903aa43df3211a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.658305   431 tablet_replica.cc:333] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
W20260709 13:05:37.658598 10694 consensus_peers.cc:597] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.659173   431 raft_consensus.cc:2243] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.659886   431 raft_consensus.cc:2272] T 92ea8c96386a441db4e7f2525862c020 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.664687   431 tablet_replica.cc:333] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9: stopping tablet replica
I20260709 13:05:37.665566   431 raft_consensus.cc:2243] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.666203   431 raft_consensus.cc:2272] T b96de0a197bf4f04b94aaa0f84d4c239 P 85c88fd77ae44877b903aa43df3211a9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:37.671866 10694 consensus_peers.cc:597] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.719835   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:05:37.737133 10768 consensus_peers.cc:597] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:37.743772 10694 consensus_peers.cc:597] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.782152   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:05:37.828853   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:37.829896   431 tablet_replica.cc:333] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.831101   431 raft_consensus.cc:2243] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.831749   431 raft_consensus.cc:2272] T 40c046c421954ec19cfdd961d5ad66bf P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.833931   431 tablet_replica.cc:333] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.834542   431 raft_consensus.cc:2243] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.835016   431 raft_consensus.cc:2272] T 206927a5de3d4b0e9b12c1c65cdd8662 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.837255   431 tablet_replica.cc:333] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.837874   431 raft_consensus.cc:2243] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.838380   431 raft_consensus.cc:2272] T b6c0d8f75799427faa37c4ffdcc174ad P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.840525   431 tablet_replica.cc:333] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.841207   431 raft_consensus.cc:2243] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.842041   431 raft_consensus.cc:2272] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.844326   431 tablet_replica.cc:333] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.844966   431 raft_consensus.cc:2243] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.845467   431 raft_consensus.cc:2272] T b028b012543345579519d6731939c9d9 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.847771   431 tablet_replica.cc:333] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.848402   431 raft_consensus.cc:2243] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.849323   431 raft_consensus.cc:2272] T 277854f4b12746f3b886af36ac68d74e P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.851867   431 tablet_replica.cc:333] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
W20260709 13:05:37.852473 10766 consensus_peers.cc:597] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 -> Peer 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601): Couldn't send request to peer 00ea50ef9f5143f5a019e96aa66c5154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.852690   431 raft_consensus.cc:2243] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.853243   431 raft_consensus.cc:2272] T ce4b20bf948c4b018cef62addae72b37 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.855578   431 tablet_replica.cc:333] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.856220   431 raft_consensus.cc:2243] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.857128   431 raft_consensus.cc:2272] T 67de90e515a540dda2a2d1cf7e3d08b5 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.859938   431 tablet_replica.cc:333] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.860637   431 raft_consensus.cc:2243] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.861177   431 raft_consensus.cc:2272] T 12c33d3d53c04acc99ce779a56a0c953 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.863544   431 tablet_replica.cc:333] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.864229   431 raft_consensus.cc:2243] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.864655   431 raft_consensus.cc:2272] T f588edef19fb4dc8a37155df01a6015e P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.866904   431 tablet_replica.cc:333] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.867504   431 raft_consensus.cc:2243] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.868079   431 raft_consensus.cc:2272] T ef8cdfc7d09543dc8af92f7813c524f2 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.870443   431 tablet_replica.cc:333] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.871068   431 raft_consensus.cc:2243] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.871515   431 raft_consensus.cc:2272] T a0fa882d5b5f496e9b9ede0825792d89 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.874017   431 tablet_replica.cc:333] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.874615   431 raft_consensus.cc:2243] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.875519   431 raft_consensus.cc:2272] T 40d7e9668954487890b00a1f823f4b82 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.878175   431 tablet_replica.cc:333] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
W20260709 13:05:37.878633 10766 consensus_peers.cc:597] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 -> Peer 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601): Couldn't send request to peer 00ea50ef9f5143f5a019e96aa66c5154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.878984   431 raft_consensus.cc:2243] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.879618   431 raft_consensus.cc:2272] T e8b4bf606302404890fd04b953fdb519 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.882004   431 tablet_replica.cc:333] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.882575   431 raft_consensus.cc:2243] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.883538   431 raft_consensus.cc:2272] T 0fd359419f234541886b094b38db3816 P 00ea50ef9f5143f5a019e96aa66c5154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.885984   431 tablet_replica.cc:333] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.886535   431 raft_consensus.cc:2243] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.887374   431 raft_consensus.cc:2272] T 755d9f68be0647e7bd1a073fae32e644 P 00ea50ef9f5143f5a019e96aa66c5154 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.889710   431 tablet_replica.cc:333] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.890338   431 raft_consensus.cc:2243] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:37.891104   431 raft_consensus.cc:2272] T 92ea8c96386a441db4e7f2525862c020 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:37.894001   431 tablet_replica.cc:333] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154: stopping tablet replica
I20260709 13:05:37.894577   431 raft_consensus.cc:2243] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:37.895138   431 raft_consensus.cc:2272] T b96de0a197bf4f04b94aaa0f84d4c239 P 00ea50ef9f5143f5a019e96aa66c5154 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:37.907711 10768 consensus_peers.cc:597] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:37.916079 10766 consensus_peers.cc:597] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 -> Peer 00ea50ef9f5143f5a019e96aa66c5154 (127.0.107.194:41601): Couldn't send request to peer 00ea50ef9f5143f5a019e96aa66c5154. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.946913   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:05:38.002292 10768 consensus_peers.cc:597] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 -> Peer 85c88fd77ae44877b903aa43df3211a9 (127.0.107.193:42049): Couldn't send request to peer 85c88fd77ae44877b903aa43df3211a9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:42049: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.009958   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:05:38.063470   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:38.067978   431 tablet_replica.cc:333] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.069684   431 raft_consensus.cc:2243] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.070500   431 raft_consensus.cc:2272] T b6c0d8f75799427faa37c4ffdcc174ad P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.073320   431 tablet_replica.cc:333] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.074117   431 raft_consensus.cc:2243] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.074664   431 raft_consensus.cc:2272] T 206927a5de3d4b0e9b12c1c65cdd8662 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.077104   431 tablet_replica.cc:333] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.077692   431 raft_consensus.cc:2243] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.078202   431 raft_consensus.cc:2272] T 40c046c421954ec19cfdd961d5ad66bf P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.080621   431 tablet_replica.cc:333] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.081252   431 raft_consensus.cc:2243] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.082139   431 raft_consensus.cc:2272] T b028b012543345579519d6731939c9d9 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.084437   431 tablet_replica.cc:333] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.085124   431 raft_consensus.cc:2243] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.085611   431 raft_consensus.cc:2272] T ce4b20bf948c4b018cef62addae72b37 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.088140   431 tablet_replica.cc:333] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.088817   431 raft_consensus.cc:2243] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.089352   431 raft_consensus.cc:2272] T 277854f4b12746f3b886af36ac68d74e P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.091840   431 tablet_replica.cc:333] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.092492   431 raft_consensus.cc:2243] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.093423   431 raft_consensus.cc:2272] T b96de0a197bf4f04b94aaa0f84d4c239 P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.095829   431 tablet_replica.cc:333] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.096521   431 raft_consensus.cc:2243] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.097110   431 raft_consensus.cc:2272] T 67de90e515a540dda2a2d1cf7e3d08b5 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.099649   431 tablet_replica.cc:333] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.100399   431 raft_consensus.cc:2243] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.101372   431 raft_consensus.cc:2272] T 12c33d3d53c04acc99ce779a56a0c953 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.103973   431 tablet_replica.cc:333] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.104730   431 raft_consensus.cc:2243] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.105274   431 raft_consensus.cc:2272] T a97cdcbf7fdb42f7bc99ff74b33c85c0 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.107856   431 tablet_replica.cc:333] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.108531   431 raft_consensus.cc:2243] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.109066   431 raft_consensus.cc:2272] T 92ea8c96386a441db4e7f2525862c020 P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.111712   431 tablet_replica.cc:333] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.112464   431 raft_consensus.cc:2243] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.113415   431 raft_consensus.cc:2272] T f588edef19fb4dc8a37155df01a6015e P cbf3815fdab94160b27744ee35801b55 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.115916   431 tablet_replica.cc:333] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.116566   431 raft_consensus.cc:2243] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.117204   431 raft_consensus.cc:2272] T ef8cdfc7d09543dc8af92f7813c524f2 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.119925   431 tablet_replica.cc:333] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.120523   431 raft_consensus.cc:2243] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.120996   431 raft_consensus.cc:2272] T a0fa882d5b5f496e9b9ede0825792d89 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.123311   431 tablet_replica.cc:333] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.123854   431 raft_consensus.cc:2243] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.124384   431 raft_consensus.cc:2272] T 0fd359419f234541886b094b38db3816 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.126650   431 tablet_replica.cc:333] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.127194   431 raft_consensus.cc:2243] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.127694   431 raft_consensus.cc:2272] T 755d9f68be0647e7bd1a073fae32e644 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.130210   431 tablet_replica.cc:333] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.130815   431 raft_consensus.cc:2243] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.131367   431 raft_consensus.cc:2272] T 40d7e9668954487890b00a1f823f4b82 P cbf3815fdab94160b27744ee35801b55 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.133984   431 tablet_replica.cc:333] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55: stopping tablet replica
I20260709 13:05:38.134548   431 raft_consensus.cc:2243] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:38.135038   431 raft_consensus.cc:2272] T e8b4bf606302404890fd04b953fdb519 P cbf3815fdab94160b27744ee35801b55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.185173   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:05:38.240410   431 master.cc:562] Master@127.0.107.254:41097 shutting down...
I20260709 13:05:38.274995   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:38.275731   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:38.276192   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0d4d21ca4e0c4821858f9dfc23ed404d: stopping tablet replica
W20260709 13:05:39.296396   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10583)
W20260709 13:05:40.296938   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10583)
I20260709 13:05:41.112730   431 master.cc:584] Master@127.0.107.254:41097 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (17180 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (30075 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (326395 ms total)
[  PASSED  ] 8 tests.
I20260709 13:05:41.184749   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 578 messages since previous log ~542 seconds ago
I20260709 13:05:41.185051   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 578 messages since previous log ~542 seconds ago
I20260709 13:05:41.185221   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 573 messages since previous log ~542 seconds ago
I20260709 13:05:41.185488   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~38 seconds ago
I20260709 13:05:41.185739   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~38 seconds ago
I20260709 13:05:41.186095   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~155 seconds ago
I20260709 13:05:41.186323   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~155 seconds ago
I20260709 13:05:41.186578   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~158 seconds ago
I20260709 13:05:41.186980   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 13 messages since previous log ~3 seconds ago
I20260709 13:05:41.187353   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 25 messages since previous log ~11 seconds ago
